2025-12-05 06:00:29 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2025-12-05 06:00:29 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2025-12-05 06:00:29 [manheim.gb] INFO: Starting spider manheim.gb
2025-12-05 06:00:29 [scrapy.addons] INFO: Enabled addons:
[]
2025-12-05 06:00:29 [asyncio] DEBUG: Using selector: EpollSelector
2025-12-05 06:00:29 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2025-12-05 06:00:29 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2025-12-05 06:00:29 [scrapy.extensions.telnet] INFO: Telnet Password: 50bafe835f170b0b
2025-12-05 06:00:29 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2025-12-05 06:00:29 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/manheim.gb/task_37_2025-12-05T06_00_02.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2025-12-05 06:00:29 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2025-12-05 06:00:29 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2025-12-05 06:00:29 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2025-12-05 06:00:29 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2025-12-05 06:00:29 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2025-12-05 06:00:29 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2025-12-05 06:00:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:00:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:00:29 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2025-12-05 06:00:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2025-12-05 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:00:29 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2025-12-05 06:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2025-12-05 06:00:29 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2025-12-05 06:00:29 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: low_mileage_for_country.json
2025-12-05 06:00:29 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage.json
2025-12-05 06:00:29 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2025-12-05 06:00:29 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2025-12-05 06:00:29 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2025-12-05 06:00:29 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2025-12-05 06:00:29 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2025-12-05 06:00:29 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2025-12-05 06:00:29 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2025-12-05 06:00:29 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2025-12-05 06:00:29 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: cars_too_new_for_country.json
2025-12-05 06:00:29 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_price_for_currency.json
2025-12-05 06:00:29 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2025-12-05 06:00:29 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2025-12-05 06:00:29 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2025-12-05 06:00:29 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2025-12-05 06:00:29 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage_for_country.json
2025-12-05 06:00:29 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2025-12-05 06:00:29 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2025-12-05 06:00:29 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2025-12-05 06:00:29 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2025-12-05 06:00:29 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2025-12-05 06:00:29 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: registration_date_old.json
2025-12-05 06:00:29 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage_for_make.json
2025-12-05 06:00:29 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2025-12-05 06:00:29 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2025-12-05 06:00:29 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2025-12-05 06:00:29 [scrapy.core.engine] INFO: Spider opened
2025-12-05 06:00:29 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2025-12-05 06:00:29 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6025
2025-12-05 06:00:29 [scrapy-playwright] INFO: Starting download handler
2025-12-05 06:00:29 [scrapy-playwright] INFO: Starting download handler
2025-12-05 06:00:34 [scrapy-playwright] INFO: Launching browser firefox
2025-12-05 06:00:35 [scrapy-playwright] INFO: Browser firefox launched
2025-12-05 06:00:35 [scrapy-playwright] DEBUG: Browser context started: 'default' (persistent=False, remote=False)
2025-12-05 06:00:36 [scrapy-playwright] DEBUG: [Context=default] New page created, page count is 1 (1 for all contexts)
2025-12-05 06:00:36 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/> (resource type: document)
2025-12-05 06:00:36 [scrapy-playwright] DEBUG: [Context=default] Response: <407 https://www.manheim.co.uk/>
2025-12-05 06:00:36 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/> (resource type: document)
2025-12-05 06:00:39 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/>
2025-12-05 06:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/bundle?v=HcGNblHj64wK-Istb_0SemQAL-rwtK13kDPW8q3LCIo1> (resource type: stylesheet, referrer: https://www.manheim.co.uk/)
2025-12-05 06:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/bundles/delete/scripts/homepage?v=CIpuZXIp0V7i0j1sjTB9sUemSg9-D9w8k891UP0sReI1> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-05 06:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/top_navigationlogo.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-05 06:00:39 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/top_navigationlogo.ashx?la=en>
2025-12-05 06:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/homepage_new.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-05 06:00:39 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/homepage_new.ashx?la=en>
2025-12-05 06:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/auction-centre-pages/auction-centre-c114-treated--hero.ashx?la=en&mw=960> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-05 06:00:39 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/auction-centre-pages/auction-centre-c114-treated--hero.ashx?la=en&mw=960>
2025-12-05 06:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/new-website-images-2021/vehicle-solutions/vs-3.ashx?la=en&mw=960> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-05 06:00:39 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/new-website-images-2021/vehicle-solutions/vs-3.ashx?la=en&mw=960>
2025-12-05 06:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/inspections-and-collections/inspections-and-collections-b87-treated---hero.ashx?la=en&mw=960> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-05 06:00:39 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/inspections-and-collections/inspections-and-collections-b87-treated---hero.ashx?la=en&mw=960>
2025-12-05 06:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimvehiclesearchpage2.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-05 06:00:39 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimvehiclesearchpage2.ashx?la=en>
2025-12-05 06:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/Scripts/Manheim/tellnumberchange.js> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-05 06:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/Scripts/Manheim/RemoveSignUpBanner.js> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-05 06:00:39 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/bundle?v=HcGNblHj64wK-Istb_0SemQAL-rwtK13kDPW8q3LCIo1>
2025-12-05 06:00:39 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/bundles/delete/scripts/homepage?v=CIpuZXIp0V7i0j1sjTB9sUemSg9-D9w8k891UP0sReI1>
2025-12-05 06:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/jquery-ui-1.13.2.min.css> (resource type: stylesheet, referrer: https://www.manheim.co.uk/assets/css/bundle?v=HcGNblHj64wK-Istb_0SemQAL-rwtK13kDPW8q3LCIo1)
2025-12-05 06:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/core-blessed1.min.css> (resource type: stylesheet, referrer: https://www.manheim.co.uk/assets/css/bundle?v=HcGNblHj64wK-Istb_0SemQAL-rwtK13kDPW8q3LCIo1)
2025-12-05 06:00:39 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/Scripts/Manheim/tellnumberchange.js>
2025-12-05 06:00:39 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/Scripts/Manheim/RemoveSignUpBanner.js>
2025-12-05 06:00:39 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/jquery-ui-1.13.2.min.css>
2025-12-05 06:00:39 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/core-blessed1.min.css>
2025-12-05 06:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Light.woff> (resource type: font, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-05 06:00:40 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/top_navigationlogo.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-05 06:00:40 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/top_navigationlogo.ashx?la=en>
2025-12-05 06:00:40 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/homepage_new.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-05 06:00:40 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/homepage_new.ashx?la=en>
2025-12-05 06:00:40 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/auction-centre-pages/auction-centre-c114-treated--hero.ashx?la=en&mw=960> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-05 06:00:40 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/auction-centre-pages/auction-centre-c114-treated--hero.ashx?la=en&mw=960>
2025-12-05 06:00:40 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/new-website-images-2021/vehicle-solutions/vs-3.ashx?la=en&mw=960> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-05 06:00:40 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/new-website-images-2021/vehicle-solutions/vs-3.ashx?la=en&mw=960>
2025-12-05 06:00:40 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/inspections-and-collections/inspections-and-collections-b87-treated---hero.ashx?la=en&mw=960> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-05 06:00:40 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/inspections-and-collections/inspections-and-collections-b87-treated---hero.ashx?la=en&mw=960>
2025-12-05 06:00:40 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimvehiclesearchpage2.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-05 06:00:40 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimvehiclesearchpage2.ashx?la=en>
2025-12-05 06:00:40 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/images/filters/dot_pattern.png> (resource type: image, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-05 06:00:40 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/assets/images/filters/dot_pattern.png>
2025-12-05 06:00:40 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/images/branding/dropdown.png> (resource type: image, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-05 06:00:40 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/assets/images/branding/dropdown.png>
2025-12-05 06:00:40 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Regular.woff> (resource type: font, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-05 06:00:40 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Bold.woff> (resource type: font, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-05 06:00:40 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/fonts/Manheim-Icons/Manheim-Icons.woff> (resource type: font, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-05 06:00:40 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.googletagmanager.com/gtm.js?id=GTM-KZS96H> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-05 06:00:40 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.googletagmanager.com/gtm.js?id=GTM-KZS96H>
2025-12-05 06:00:40 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://www.manheim.co.uk/Account/IsCookieExist> (resource type: xhr, referrer: https://www.manheim.co.uk/)
2025-12-05 06:00:40 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/upload/christmasgiveawayhomepage.ashx?la=en&mw=1920> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-05 06:00:40 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/upload/christmasgiveawayhomepage.ashx?la=en&mw=1920>
2025-12-05 06:00:40 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/auction-centre-pages/auction-centre-8665-treated--hero.ashx?la=en&mw=1920> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-05 06:00:40 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/auction-centre-pages/auction-centre-8665-treated--hero.ashx?la=en&mw=1920>
2025-12-05 06:00:40 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Light.woff>
2025-12-05 06:00:40 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Regular.woff>
2025-12-05 06:00:40 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/fonts/Manheim-Icons/Manheim-Icons.woff>
2025-12-05 06:00:40 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Bold.woff>
2025-12-05 06:00:40 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/Account/IsCookieExist>
2025-12-05 06:00:40 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://js-agent.newrelic.com/nr-spa-1.303.0.min.js> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-05 06:00:40 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://pi.pardot.com/pd.js> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-05 06:00:40 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://js-agent.newrelic.com/nr-spa-1.303.0.min.js>
2025-12-05 06:00:40 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://js-agent.newrelic.com/nr-spa-1.303.0.min.js> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-05 06:00:40 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://js-agent.newrelic.com/nr-spa-1.303.0.min.js>
2025-12-05 06:00:43 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://pi.pardot.com/pd.js>
2025-12-05 06:00:43 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://pi.pardot.com/analytics?ver=3&visitor_id=&visitor_id_sign=&pi_opt_in=&campaign_id=24684&account_id=38592&title=Manheim%20%7C%20Auctions%2C%20Vehicle%20Solutions%20%26%20Remarketing&url=https%3A%2F%2Fwww.manheim.co.uk%2F&referrer=> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-05 06:00:43 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://pi.pardot.com/analytics?ver=3&visitor_id=&visitor_id_sign=&pi_opt_in=&campaign_id=24684&account_id=38592&title=Manheim%20%7C%20Auctions%2C%20Vehicle%20Solutions%20%26%20Remarketing&url=https%3A%2F%2Fwww.manheim.co.uk%2F&referrer=>
2025-12-05 06:00:43 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://brands.coxauto.co.uk/analytics?conly=true&visitor_id=919133206&visitor_id_sign=e1986eb54c904559ee6974eba9a8ecb2ea06c244ca429899bf1a12c2d5d6488807ddebba5ad896a16fff016c36f99a8f7067d968&pi_opt_in=&campaign_id=24684&account_id=38592&title=Manheim%20%7C%20Auctions%2C%20Vehicle%20Solutions%20%26%20Remarketing&url=https%3A%2F%2Fwww.manheim.co.uk%2F&referrer=> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-05 06:00:44 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://brands.coxauto.co.uk/analytics?conly=true&visitor_id=919133206&visitor_id_sign=e1986eb54c904559ee6974eba9a8ecb2ea06c244ca429899bf1a12c2d5d6488807ddebba5ad896a16fff016c36f99a8f7067d968&pi_opt_in=&campaign_id=24684&account_id=38592&title=Manheim%20%7C%20Auctions%2C%20Vehicle%20Solutions%20%26%20Remarketing&url=https%3A%2F%2Fwww.manheim.co.uk%2F&referrer=>
2025-12-05 06:00:50 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://www.manheim.co.uk/account/login> (resource type: document, referrer: https://www.manheim.co.uk/)
2025-12-05 06:00:50 [scrapy-playwright] DEBUG: [Context=default] Response: <302 https://www.manheim.co.uk/account/login> (location: /mymanheim/dashboard)
2025-12-05 06:00:50 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/mymanheim/dashboard> (resource type: document, referrer: https://www.manheim.co.uk/)
2025-12-05 06:00:53 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/mymanheim/dashboard>
2025-12-05 06:00:53 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/bundle?v=HcGNblHj64wK-Istb_0SemQAL-rwtK13kDPW8q3LCIo1> (resource type: stylesheet, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-05 06:00:53 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/bundles/delete/scripts/postlogin?v=Bwe963dGqUB3Sdny8E3tKSL2gV9GDgLwX1g6Gq6KF-A1> (resource type: script, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-05 06:00:53 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/SignalR/Hubs> (resource type: script, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-05 06:00:53 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimwhitecoxautomotive3.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-05 06:00:53 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimwhitecoxautomotive3.ashx?la=en>
2025-12-05 06:00:53 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/Scripts/jquery-ui-1.12.1.js> (resource type: script, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-05 06:00:53 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/Content/myManheim.css> (resource type: stylesheet, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-05 06:00:53 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/bundles/simulcast?v=P7s0oLmuXc3p3WQNs8URnZ4NaK3K6qkWLOwf0uOs5gw1> (resource type: script, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-05 06:00:53 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/Content/dashboards.css> (resource type: stylesheet, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-05 06:00:53 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/new-manheim-booking.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-05 06:00:53 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/new-manheim-booking.ashx?la=en>
2025-12-05 06:00:53 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/blog/2025/gavel_2025.ashx?h=176&la=en&w=210&crop=1> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-05 06:00:53 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/blog/2025/gavel_2025.ashx?h=176&la=en&w=210&crop=1>
2025-12-05 06:00:53 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/img_6251.ashx?h=176&la=en&w=210&crop=1> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-05 06:00:53 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/img_6251.ashx?h=176&la=en&w=210&crop=1>
2025-12-05 06:00:53 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/movex/payg1.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-05 06:00:53 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/movex/payg1.ashx?la=en>
2025-12-05 06:00:53 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/v3--design11918banner535x191px-(1).ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-05 06:00:53 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/v3--design11918banner535x191px-(1).ashx?la=en>
2025-12-05 06:00:53 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/campaigns/nama/nama-lcv-location-banner.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-05 06:00:53 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/campaigns/nama/nama-lcv-location-banner.ashx?la=en>
2025-12-05 06:00:53 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/movex/why_pay_more.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-05 06:00:53 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/movex/why_pay_more.ashx?la=en>
2025-12-05 06:00:53 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/banners-and-adverts/products-services/simulcast_banner.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-05 06:00:53 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/banners-and-adverts/products-services/simulcast_banner.ashx?la=en>
2025-12-05 06:00:53 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimlogofooter2.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-05 06:00:53 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimlogofooter2.ashx?la=en>
2025-12-05 06:00:53 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimvehiclesearchpage2.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-05 06:00:53 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimvehiclesearchpage2.ashx?la=en>
2025-12-05 06:00:53 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/Scripts/Manheim/tellnumberchange.js> (resource type: script, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-05 06:00:53 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/Scripts/Manheim/RemoveSignUpBanner.js> (resource type: script, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-05 06:00:53 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/bundle?v=HcGNblHj64wK-Istb_0SemQAL-rwtK13kDPW8q3LCIo1>
2025-12-05 06:00:53 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/jquery-ui-1.13.2.min.css> (resource type: stylesheet, referrer: https://www.manheim.co.uk/assets/css/bundle?v=HcGNblHj64wK-Istb_0SemQAL-rwtK13kDPW8q3LCIo1)
2025-12-05 06:00:53 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/bundles/delete/scripts/postlogin?v=Bwe963dGqUB3Sdny8E3tKSL2gV9GDgLwX1g6Gq6KF-A1>
2025-12-05 06:00:53 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/core-blessed1.min.css> (resource type: stylesheet, referrer: https://www.manheim.co.uk/assets/css/bundle?v=HcGNblHj64wK-Istb_0SemQAL-rwtK13kDPW8q3LCIo1)
2025-12-05 06:00:53 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/SignalR/Hubs>
2025-12-05 06:00:53 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/Content/myManheim.css>
2025-12-05 06:00:53 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/Content/dashboards.css>
2025-12-05 06:00:53 [scrapy-playwright] DEBUG: [Context=default] Response: <302 https://www.manheim.co.uk/Scripts/jquery-ui-1.12.1.js> (location: https://www.manheim.co.uk/404)
2025-12-05 06:00:53 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/bundles/simulcast?v=P7s0oLmuXc3p3WQNs8URnZ4NaK3K6qkWLOwf0uOs5gw1>
2025-12-05 06:00:53 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/404> (resource type: script, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-05 06:00:54 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/jquery-ui-1.13.2.min.css>
2025-12-05 06:00:54 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/core-blessed1.min.css>
2025-12-05 06:00:54 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/Scripts/Manheim/tellnumberchange.js>
2025-12-05 06:00:54 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/Scripts/Manheim/RemoveSignUpBanner.js>
2025-12-05 06:00:54 [scrapy-playwright] DEBUG: [Context=default] Response: <404 https://www.manheim.co.uk/404>
2025-12-05 06:00:54 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Light.woff> (resource type: font, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-05 06:00:54 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimwhitecoxautomotive3.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-05 06:00:54 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimwhitecoxautomotive3.ashx?la=en>
2025-12-05 06:00:54 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/Scripts/jquery-ui-1.12.1.js> (resource type: script, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-05 06:00:54 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Regular.woff> (resource type: font, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-05 06:00:54 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/fonts/Manheim-Icons/Manheim-Icons.woff> (resource type: font, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-05 06:00:54 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.googletagmanager.com/gtm.js?id=GTM-KZS96H> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-05 06:00:54 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.googletagmanager.com/gtm.js?id=GTM-KZS96H>
2025-12-05 06:00:54 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Light.woff>
2025-12-05 06:00:54 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Regular.woff>
2025-12-05 06:00:54 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/fonts/Manheim-Icons/Manheim-Icons.woff>
2025-12-05 06:00:54 [scrapy-playwright] DEBUG: [Context=default] Response: <302 https://www.manheim.co.uk/Scripts/jquery-ui-1.12.1.js> (location: https://www.manheim.co.uk/404)
2025-12-05 06:00:54 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/404> (resource type: script, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-05 06:00:55 [scrapy-playwright] DEBUG: [Context=default] Response: <404 https://www.manheim.co.uk/404>
2025-12-05 06:00:55 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/new-manheim-booking.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-05 06:00:55 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/new-manheim-booking.ashx?la=en>
2025-12-05 06:00:55 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/blog/2025/gavel_2025.ashx?h=176&la=en&w=210&crop=1> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-05 06:00:55 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/blog/2025/gavel_2025.ashx?h=176&la=en&w=210&crop=1>
2025-12-05 06:00:55 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/img_6251.ashx?h=176&la=en&w=210&crop=1> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-05 06:00:55 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/img_6251.ashx?h=176&la=en&w=210&crop=1>
2025-12-05 06:00:55 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/movex/payg1.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-05 06:00:55 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/movex/payg1.ashx?la=en>
2025-12-05 06:00:55 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/v3--design11918banner535x191px-(1).ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-05 06:00:55 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/v3--design11918banner535x191px-(1).ashx?la=en>
2025-12-05 06:00:55 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/campaigns/nama/nama-lcv-location-banner.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-05 06:00:55 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/campaigns/nama/nama-lcv-location-banner.ashx?la=en>
2025-12-05 06:00:55 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/movex/why_pay_more.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-05 06:00:55 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/movex/why_pay_more.ashx?la=en>
2025-12-05 06:00:55 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/banners-and-adverts/products-services/simulcast_banner.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-05 06:00:55 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/banners-and-adverts/products-services/simulcast_banner.ashx?la=en>
2025-12-05 06:00:55 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimlogofooter2.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-05 06:00:55 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimlogofooter2.ashx?la=en>
2025-12-05 06:00:55 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimvehiclesearchpage2.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-05 06:00:55 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimvehiclesearchpage2.ashx?la=en>
2025-12-05 06:00:55 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/images/branding/dropdown.png> (resource type: image, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-05 06:00:55 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/assets/images/branding/dropdown.png>
2025-12-05 06:00:55 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Bold.woff> (resource type: font, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-05 06:00:55 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/images/thickbox/loadingAnimation.gif> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-05 06:00:55 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/assets/images/thickbox/loadingAnimation.gif>
2025-12-05 06:00:55 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://www.manheim.co.uk/Account/IsCookieExist> (resource type: xhr, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-05 06:00:55 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Bold.woff>
2025-12-05 06:00:55 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://js-agent.newrelic.com/nr-spa-1.303.0.min.js> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-05 06:00:55 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://js-agent.newrelic.com/nr-spa-1.303.0.min.js>
2025-12-05 06:00:55 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/Account/IsCookieExist>
2025-12-05 06:00:55 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://pi.pardot.com/pd.js> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-05 06:00:55 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://js-agent.newrelic.com/nr-spa-1.303.0.min.js> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-05 06:00:55 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://js-agent.newrelic.com/nr-spa-1.303.0.min.js>
2025-12-05 06:00:56 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://pi.pardot.com/pd.js>
2025-12-05 06:00:56 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://pi.pardot.com/analytics?ver=3&visitor_id=919133206&visitor_id_sign=e1986eb54c904559ee6974eba9a8ecb2ea06c244ca429899bf1a12c2d5d6488807ddebba5ad896a16fff016c36f99a8f7067d968&pi_opt_in=&campaign_id=24684&account_id=38592&title=Dashboard%20%7C%20Manheim&url=https%3A%2F%2Fwww.manheim.co.uk%2Fmymanheim%2Fdashboard&referrer=https%3A%2F%2Fwww.manheim.co.uk%2F> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-05 06:00:57 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://pi.pardot.com/analytics?ver=3&visitor_id=919133206&visitor_id_sign=e1986eb54c904559ee6974eba9a8ecb2ea06c244ca429899bf1a12c2d5d6488807ddebba5ad896a16fff016c36f99a8f7067d968&pi_opt_in=&campaign_id=24684&account_id=38592&title=Dashboard%20%7C%20Manheim&url=https%3A%2F%2Fwww.manheim.co.uk%2Fmymanheim%2Fdashboard&referrer=https%3A%2F%2Fwww.manheim.co.uk%2F>
2025-12-05 06:00:57 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://brands.coxauto.co.uk/analytics?conly=true&visitor_id=919133206&visitor_id_sign=e1986eb54c904559ee6974eba9a8ecb2ea06c244ca429899bf1a12c2d5d6488807ddebba5ad896a16fff016c36f99a8f7067d968&pi_opt_in=&campaign_id=24684&account_id=38592&title=Dashboard%20%7C%20Manheim&url=https%3A%2F%2Fwww.manheim.co.uk%2Fmymanheim%2Fdashboard&referrer=https%3A%2F%2Fwww.manheim.co.uk%2F> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-05 06:00:57 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://brands.coxauto.co.uk/analytics?conly=true&visitor_id=919133206&visitor_id_sign=e1986eb54c904559ee6974eba9a8ecb2ea06c244ca429899bf1a12c2d5d6488807ddebba5ad896a16fff016c36f99a8f7067d968&pi_opt_in=&campaign_id=24684&account_id=38592&title=Dashboard%20%7C%20Manheim&url=https%3A%2F%2Fwww.manheim.co.uk%2Fmymanheim%2Fdashboard&referrer=https%3A%2F%2Fwww.manheim.co.uk%2F>
2025-12-05 06:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk> (referer: None) ['playwright']
2025-12-05 06:01:00 [manheim.gb] INFO: Cookies from Playwright: [{'name': 'ASP.NET_SessionId', 'value': 'kyqvf1qvwgou00xwgmtvhka3', 'domain': 'www.manheim.co.uk', 'path': '/', 'expires': -1, 'httpOnly': True, 'secure': True, 'sameSite': 'Lax'}, {'name': '__RequestVerificationToken', 'value': 'hq6s7nRn6Q4vz7kE_bkrPkQEdrDIBEuuOU45xb8ZE8Wp6N0s1fwdOYJID0QjCc8MPA1E9xomdmKC_-268o3wFvgtUp01', 'domain': 'www.manheim.co.uk', 'path': '/', 'expires': -1, 'httpOnly': True, 'secure': True, 'sameSite': 'None'}, {'name': 'cb-enabled', 'value': 'enabled', 'domain': 'www.manheim.co.uk', 'path': '/', 'expires': 1796450439, 'httpOnly': False, 'secure': False, 'sameSite': 'None'}, {'name': 'remarketing-web', 'value': 'D4EEE04FBBC3188C05DF5D0F2F8A67F193E7E83757009CA29BE452E91109E568EBF240C054EE103AF66DDB115E55CBC34B85A630E414FB49A5977E65C5CBF3CC6A8E2A2C1ECA9375EE18BA3118AA66B6DA000C89426C40EF217B69977ED74F55795120DBA873AC84211A5C5C75387CBDA95DE496', 'domain': 'www.manheim.co.uk', 'path': '/', 'expires': -1, 'httpOnly': True, 'secure': True, 'sameSite': 'None'}, {'name': 'visitor_id37592', 'value': '919133206', 'domain': 'www.manheim.co.uk', 'path': '/', 'expires': 1796450457, 'httpOnly': False, 'secure': False, 'sameSite': 'None'}, {'name': 'visitor_id37592-hash', 'value': 'e1986eb54c904559ee6974eba9a8ecb2ea06c244ca429899bf1a12c2d5d6488807ddebba5ad896a16fff016c36f99a8f7067d968', 'domain': 'www.manheim.co.uk', 'path': '/', 'expires': 1796450457, 'httpOnly': False, 'secure': False, 'sameSite': 'None'}, {'name': 'visitor_id37592', 'value': '919133206', 'domain': 'brands.coxauto.co.uk', 'path': '/', 'expires': 1796450457, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}, {'name': 'visitor_id37592-hash', 'value': 'e1986eb54c904559ee6974eba9a8ecb2ea06c244ca429899bf1a12c2d5d6488807ddebba5ad896a16fff016c36f99a8f7067d968', 'domain': 'brands.coxauto.co.uk', 'path': '/', 'expires': 1796450457, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}, {'name': 'visitor_id37592', 'value': '919133206', 'domain': '.pardot.com', 'path': '/', 'expires': 1796450457, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}, {'name': 'visitor_id37592-hash', 'value': 'e1986eb54c904559ee6974eba9a8ecb2ea06c244ca429899bf1a12c2d5d6488807ddebba5ad896a16fff016c36f99a8f7067d968', 'domain': '.pardot.com', 'path': '/', 'expires': 1796450457, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}, {'name': 'lpv37592', 'value': 'aHR0cHM6Ly93d3cubWFuaGVpbS5jby51ay9teW1hbmhlaW0vZGFzaGJvYXJk', 'domain': 'pi.pardot.com', 'path': '/', 'expires': 1764916257, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}]
2025-12-05 06:01:00 [manheim.gb] INFO: Scrapy-formatted cookies: [{'name': 'ASP.NET_SessionId', 'value': 'kyqvf1qvwgou00xwgmtvhka3', 'domain': 'www.manheim.co.uk', 'path': '/'}, {'name': '__RequestVerificationToken', 'value': 'hq6s7nRn6Q4vz7kE_bkrPkQEdrDIBEuuOU45xb8ZE8Wp6N0s1fwdOYJID0QjCc8MPA1E9xomdmKC_-268o3wFvgtUp01', 'domain': 'www.manheim.co.uk', 'path': '/'}, {'name': 'cb-enabled', 'value': 'enabled', 'domain': 'www.manheim.co.uk', 'path': '/'}, {'name': 'remarketing-web', 'value': 'D4EEE04FBBC3188C05DF5D0F2F8A67F193E7E83757009CA29BE452E91109E568EBF240C054EE103AF66DDB115E55CBC34B85A630E414FB49A5977E65C5CBF3CC6A8E2A2C1ECA9375EE18BA3118AA66B6DA000C89426C40EF217B69977ED74F55795120DBA873AC84211A5C5C75387CBDA95DE496', 'domain': 'www.manheim.co.uk', 'path': '/'}, {'name': 'visitor_id37592', 'value': '919133206', 'domain': 'www.manheim.co.uk', 'path': '/'}, {'name': 'visitor_id37592-hash', 'value': 'e1986eb54c904559ee6974eba9a8ecb2ea06c244ca429899bf1a12c2d5d6488807ddebba5ad896a16fff016c36f99a8f7067d968', 'domain': 'www.manheim.co.uk', 'path': '/'}, {'name': 'visitor_id37592', 'value': '919133206', 'domain': 'brands.coxauto.co.uk', 'path': '/'}, {'name': 'visitor_id37592-hash', 'value': 'e1986eb54c904559ee6974eba9a8ecb2ea06c244ca429899bf1a12c2d5d6488807ddebba5ad896a16fff016c36f99a8f7067d968', 'domain': 'brands.coxauto.co.uk', 'path': '/'}, {'name': 'visitor_id37592', 'value': '919133206', 'domain': '.pardot.com', 'path': '/'}, {'name': 'visitor_id37592-hash', 'value': 'e1986eb54c904559ee6974eba9a8ecb2ea06c244ca429899bf1a12c2d5d6488807ddebba5ad896a16fff016c36f99a8f7067d968', 'domain': '.pardot.com', 'path': '/'}, {'name': 'lpv37592', 'value': 'aHR0cHM6Ly93d3cubWFuaGVpbS5jby51ay9teW1hbmhlaW0vZGFzaGJvYXJk', 'domain': 'pi.pardot.com', 'path': '/'}]
2025-12-05 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /SpiderData(PartitionKey='Manheim',RowKey='cookies') HTTP/1.1" 204 0
2025-12-05 06:01:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/refine> (referer: https://www.manheim.co.uk/search) ['zyte-api']
2025-12-05 06:01:03 [manheim.gb] INFO: Found listing with ID: 1005857
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271005857%27 HTTP/1.1" 200 None
2025-12-05 06:01:03 [manheim.gb] INFO: Scrape type for 1005857: 2
2025-12-05 06:01:03 [manheim.gb] INFO: Found listing with ID: 1095462
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271095462%27 HTTP/1.1" 200 None
2025-12-05 06:01:03 [manheim.gb] INFO: Scrape type for 1095462: 0
2025-12-05 06:01:03 [manheim.gb] INFO: Found listing with ID: 1127441
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271127441%27 HTTP/1.1" 200 None
2025-12-05 06:01:03 [manheim.gb] INFO: Scrape type for 1127441: 2
2025-12-05 06:01:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:01:03 [manheim.gb] INFO: Found listing with ID: 1249898
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271249898%27 HTTP/1.1" 200 None
2025-12-05 06:01:03 [manheim.gb] INFO: Scrape type for 1249898: 0
2025-12-05 06:01:03 [manheim.gb] INFO: Found listing with ID: 1257174
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271257174%27 HTTP/1.1" 200 None
2025-12-05 06:01:03 [manheim.gb] INFO: Scrape type for 1257174: 0
2025-12-05 06:01:03 [manheim.gb] INFO: Found listing with ID: 1271730
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271271730%27 HTTP/1.1" 200 None
2025-12-05 06:01:03 [manheim.gb] INFO: Scrape type for 1271730: 2
2025-12-05 06:01:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:01:03 [manheim.gb] INFO: Found listing with ID: 1297328
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271297328%27 HTTP/1.1" 200 None
2025-12-05 06:01:03 [manheim.gb] INFO: Scrape type for 1297328: 0
2025-12-05 06:01:03 [manheim.gb] INFO: Found listing with ID: 1318037
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271318037%27 HTTP/1.1" 200 None
2025-12-05 06:01:03 [manheim.gb] INFO: Scrape type for 1318037: 0
2025-12-05 06:01:03 [manheim.gb] INFO: Found listing with ID: 1319653
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271319653%27 HTTP/1.1" 200 None
2025-12-05 06:01:03 [manheim.gb] INFO: Scrape type for 1319653: 2
2025-12-05 06:01:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:01:03 [manheim.gb] INFO: Found listing with ID: 1342103
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271342103%27 HTTP/1.1" 200 None
2025-12-05 06:01:03 [manheim.gb] INFO: Scrape type for 1342103: 0
2025-12-05 06:01:03 [manheim.gb] INFO: Found listing with ID: 1376686
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271376686%27 HTTP/1.1" 200 None
2025-12-05 06:01:03 [manheim.gb] INFO: Scrape type for 1376686: 2
2025-12-05 06:01:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:01:03 [manheim.gb] INFO: Found listing with ID: 1403363
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271403363%27 HTTP/1.1" 200 None
2025-12-05 06:01:03 [manheim.gb] INFO: Scrape type for 1403363: 0
2025-12-05 06:01:03 [manheim.gb] INFO: Found listing with ID: 1410764
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271410764%27 HTTP/1.1" 200 None
2025-12-05 06:01:03 [manheim.gb] INFO: Scrape type for 1410764: 0
2025-12-05 06:01:03 [manheim.gb] INFO: Found listing with ID: 1430865
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271430865%27 HTTP/1.1" 200 None
2025-12-05 06:01:03 [manheim.gb] INFO: Scrape type for 1430865: 0
2025-12-05 06:01:03 [manheim.gb] INFO: Found listing with ID: 1479833
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271479833%27 HTTP/1.1" 200 None
2025-12-05 06:01:03 [manheim.gb] INFO: Scrape type for 1479833: 0
2025-12-05 06:01:03 [manheim.gb] INFO: Found listing with ID: 1484153
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271484153%27 HTTP/1.1" 200 None
2025-12-05 06:01:03 [manheim.gb] INFO: Scrape type for 1484153: 0
2025-12-05 06:01:03 [manheim.gb] INFO: Found listing with ID: 1535266
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271535266%27 HTTP/1.1" 200 None
2025-12-05 06:01:03 [manheim.gb] INFO: Scrape type for 1535266: 2
2025-12-05 06:01:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:01:03 [manheim.gb] INFO: Found listing with ID: 1563459
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271563459%27 HTTP/1.1" 200 None
2025-12-05 06:01:03 [manheim.gb] INFO: Scrape type for 1563459: 0
2025-12-05 06:01:03 [manheim.gb] INFO: Found listing with ID: 1564179
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271564179%27 HTTP/1.1" 200 None
2025-12-05 06:01:03 [manheim.gb] INFO: Scrape type for 1564179: 0
2025-12-05 06:01:03 [manheim.gb] INFO: Found listing with ID: 1603150
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271603150%27 HTTP/1.1" 200 None
2025-12-05 06:01:03 [manheim.gb] INFO: Scrape type for 1603150: 0
2025-12-05 06:01:03 [manheim.gb] INFO: Found listing with ID: 1611374
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271611374%27 HTTP/1.1" 200 None
2025-12-05 06:01:03 [manheim.gb] INFO: Scrape type for 1611374: 0
2025-12-05 06:01:03 [manheim.gb] INFO: Found listing with ID: 1678661
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271678661%27 HTTP/1.1" 200 None
2025-12-05 06:01:03 [manheim.gb] INFO: Scrape type for 1678661: 0
2025-12-05 06:01:03 [manheim.gb] INFO: Found listing with ID: 1708581
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271708581%27 HTTP/1.1" 200 None
2025-12-05 06:01:03 [manheim.gb] INFO: Scrape type for 1708581: 0
2025-12-05 06:01:03 [manheim.gb] INFO: Found listing with ID: 1714274
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271714274%27 HTTP/1.1" 200 None
2025-12-05 06:01:03 [manheim.gb] INFO: Scrape type for 1714274: 2
2025-12-05 06:01:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:01:03 [manheim.gb] INFO: Found listing with ID: 1727332
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271727332%27 HTTP/1.1" 200 None
2025-12-05 06:01:03 [manheim.gb] INFO: Scrape type for 1727332: 0
2025-12-05 06:01:03 [manheim.gb] INFO: Found listing with ID: 1749068
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271749068%27 HTTP/1.1" 200 None
2025-12-05 06:01:03 [manheim.gb] INFO: Scrape type for 1749068: 0
2025-12-05 06:01:03 [manheim.gb] INFO: Found listing with ID: 1753030
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271753030%27 HTTP/1.1" 200 None
2025-12-05 06:01:03 [manheim.gb] INFO: Scrape type for 1753030: 2
2025-12-05 06:01:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:01:03 [manheim.gb] INFO: Found listing with ID: 1761741
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271761741%27 HTTP/1.1" 200 None
2025-12-05 06:01:03 [manheim.gb] INFO: Scrape type for 1761741: 0
2025-12-05 06:01:03 [manheim.gb] INFO: Found listing with ID: 1783769
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271783769%27 HTTP/1.1" 200 None
2025-12-05 06:01:03 [manheim.gb] INFO: Scrape type for 1783769: 2
2025-12-05 06:01:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:01:03 [manheim.gb] INFO: Found listing with ID: 1877473
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271877473%27 HTTP/1.1" 200 None
2025-12-05 06:01:03 [manheim.gb] INFO: Scrape type for 1877473: 0
2025-12-05 06:01:03 [manheim.gb] INFO: Found listing with ID: 1962040
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271962040%27 HTTP/1.1" 200 None
2025-12-05 06:01:03 [manheim.gb] INFO: Scrape type for 1962040: 0
2025-12-05 06:01:03 [manheim.gb] INFO: Found listing with ID: 1966868
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271966868%27 HTTP/1.1" 200 None
2025-12-05 06:01:03 [manheim.gb] INFO: Scrape type for 1966868: 0
2025-12-05 06:01:03 [manheim.gb] INFO: Found listing with ID: 1976170
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271976170%27 HTTP/1.1" 200 None
2025-12-05 06:01:03 [manheim.gb] INFO: Scrape type for 1976170: 0
2025-12-05 06:01:03 [manheim.gb] INFO: Found listing with ID: 1995165
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271995165%27 HTTP/1.1" 200 None
2025-12-05 06:01:03 [manheim.gb] INFO: Scrape type for 1995165: 2
2025-12-05 06:01:03 [manheim.gb] INFO: Found listing with ID: 2022887
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272022887%27 HTTP/1.1" 200 None
2025-12-05 06:01:03 [manheim.gb] INFO: Scrape type for 2022887: 0
2025-12-05 06:01:03 [manheim.gb] INFO: Found listing with ID: 2029104
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272029104%27 HTTP/1.1" 200 None
2025-12-05 06:01:03 [manheim.gb] INFO: Scrape type for 2029104: 0
2025-12-05 06:01:03 [manheim.gb] INFO: Found listing with ID: 2057516
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272057516%27 HTTP/1.1" 200 None
2025-12-05 06:01:03 [manheim.gb] INFO: Scrape type for 2057516: 0
2025-12-05 06:01:03 [manheim.gb] INFO: Found listing with ID: 2058572
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272058572%27 HTTP/1.1" 200 None
2025-12-05 06:01:03 [manheim.gb] INFO: Scrape type for 2058572: 0
2025-12-05 06:01:03 [manheim.gb] INFO: Found listing with ID: 2063938
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272063938%27 HTTP/1.1" 200 None
2025-12-05 06:01:03 [manheim.gb] INFO: Scrape type for 2063938: 2
2025-12-05 06:01:03 [manheim.gb] INFO: Found listing with ID: 2075642
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272075642%27 HTTP/1.1" 200 None
2025-12-05 06:01:03 [manheim.gb] INFO: Scrape type for 2075642: 0
2025-12-05 06:01:03 [manheim.gb] INFO: Found listing with ID: 2107189
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272107189%27 HTTP/1.1" 200 None
2025-12-05 06:01:03 [manheim.gb] INFO: Scrape type for 2107189: 0
2025-12-05 06:01:03 [manheim.gb] INFO: Found listing with ID: 2171364
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272171364%27 HTTP/1.1" 200 None
2025-12-05 06:01:03 [manheim.gb] INFO: Scrape type for 2171364: 0
2025-12-05 06:01:03 [manheim.gb] INFO: Found listing with ID: 2176421
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272176421%27 HTTP/1.1" 200 None
2025-12-05 06:01:03 [manheim.gb] INFO: Scrape type for 2176421: 2
2025-12-05 06:01:04 [manheim.gb] INFO: Found listing with ID: 2213009
2025-12-05 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272213009%27 HTTP/1.1" 200 None
2025-12-05 06:01:04 [manheim.gb] INFO: Scrape type for 2213009: 0
2025-12-05 06:01:04 [manheim.gb] INFO: Found listing with ID: 2213672
2025-12-05 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272213672%27 HTTP/1.1" 200 None
2025-12-05 06:01:04 [manheim.gb] INFO: Scrape type for 2213672: 0
2025-12-05 06:01:04 [manheim.gb] INFO: Found listing with ID: 2216514
2025-12-05 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272216514%27 HTTP/1.1" 200 None
2025-12-05 06:01:04 [manheim.gb] INFO: Scrape type for 2216514: 0
2025-12-05 06:01:04 [manheim.gb] INFO: Found listing with ID: 2237239
2025-12-05 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272237239%27 HTTP/1.1" 200 None
2025-12-05 06:01:04 [manheim.gb] INFO: Scrape type for 2237239: 0
2025-12-05 06:01:04 [manheim.gb] INFO: Found listing with ID: 2247450
2025-12-05 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272247450%27 HTTP/1.1" 200 None
2025-12-05 06:01:04 [manheim.gb] INFO: Scrape type for 2247450: 0
2025-12-05 06:01:04 [manheim.gb] INFO: Found listing with ID: 2262431
2025-12-05 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272262431%27 HTTP/1.1" 200 None
2025-12-05 06:01:04 [manheim.gb] INFO: Scrape type for 2262431: 0
2025-12-05 06:01:04 [manheim.gb] INFO: Found listing with ID: 2265358
2025-12-05 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272265358%27 HTTP/1.1" 200 None
2025-12-05 06:01:04 [manheim.gb] INFO: Scrape type for 2265358: 0
2025-12-05 06:01:04 [manheim.gb] INFO: Found listing with ID: 2274146
2025-12-05 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272274146%27 HTTP/1.1" 200 None
2025-12-05 06:01:04 [manheim.gb] INFO: Scrape type for 2274146: 0
2025-12-05 06:01:04 [manheim.gb] INFO: Found listing with ID: 2283791
2025-12-05 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272283791%27 HTTP/1.1" 200 None
2025-12-05 06:01:04 [manheim.gb] INFO: Scrape type for 2283791: 0
2025-12-05 06:01:04 [manheim.gb] INFO: Found listing with ID: 2286249
2025-12-05 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272286249%27 HTTP/1.1" 200 None
2025-12-05 06:01:04 [manheim.gb] INFO: Scrape type for 2286249: 0
2025-12-05 06:01:04 [manheim.gb] INFO: Found listing with ID: 2292492
2025-12-05 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272292492%27 HTTP/1.1" 200 None
2025-12-05 06:01:04 [manheim.gb] INFO: Scrape type for 2292492: 2
2025-12-05 06:01:04 [manheim.gb] INFO: Found listing with ID: 2316345
2025-12-05 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272316345%27 HTTP/1.1" 200 None
2025-12-05 06:01:04 [manheim.gb] INFO: Scrape type for 2316345: 2
2025-12-05 06:01:04 [manheim.gb] INFO: Found listing with ID: 233754
2025-12-05 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27233754%27 HTTP/1.1" 200 None
2025-12-05 06:01:04 [manheim.gb] INFO: Scrape type for 233754: 0
2025-12-05 06:01:04 [manheim.gb] INFO: Found listing with ID: 2354571
2025-12-05 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272354571%27 HTTP/1.1" 200 None
2025-12-05 06:01:04 [manheim.gb] INFO: Scrape type for 2354571: 0
2025-12-05 06:01:04 [manheim.gb] INFO: Found listing with ID: 2374569
2025-12-05 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272374569%27 HTTP/1.1" 200 None
2025-12-05 06:01:04 [manheim.gb] INFO: Scrape type for 2374569: 0
2025-12-05 06:01:04 [manheim.gb] INFO: Found listing with ID: 2383831
2025-12-05 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272383831%27 HTTP/1.1" 200 None
2025-12-05 06:01:04 [manheim.gb] INFO: Scrape type for 2383831: 2
2025-12-05 06:01:04 [manheim.gb] INFO: Found listing with ID: 2395632
2025-12-05 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272395632%27 HTTP/1.1" 200 None
2025-12-05 06:01:04 [manheim.gb] INFO: Scrape type for 2395632: 2
2025-12-05 06:01:04 [manheim.gb] INFO: Found listing with ID: 2407950
2025-12-05 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272407950%27 HTTP/1.1" 200 None
2025-12-05 06:01:04 [manheim.gb] INFO: Scrape type for 2407950: 2
2025-12-05 06:01:04 [manheim.gb] INFO: Found listing with ID: 2408993
2025-12-05 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272408993%27 HTTP/1.1" 200 None
2025-12-05 06:01:04 [manheim.gb] INFO: Scrape type for 2408993: 1
2025-12-05 06:01:04 [manheim.gb] INFO: Found listing with ID: 2414514
2025-12-05 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272414514%27 HTTP/1.1" 200 None
2025-12-05 06:01:04 [manheim.gb] INFO: Scrape type for 2414514: 1
2025-12-05 06:01:04 [manheim.gb] INFO: Found listing with ID: 2443996
2025-12-05 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272443996%27 HTTP/1.1" 200 None
2025-12-05 06:01:04 [manheim.gb] INFO: Scrape type for 2443996: 0
2025-12-05 06:01:04 [manheim.gb] INFO: Found listing with ID: 2445301
2025-12-05 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272445301%27 HTTP/1.1" 200 None
2025-12-05 06:01:04 [manheim.gb] INFO: Scrape type for 2445301: 1
2025-12-05 06:01:04 [manheim.gb] INFO: Found listing with ID: 2454963
2025-12-05 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272454963%27 HTTP/1.1" 200 None
2025-12-05 06:01:04 [manheim.gb] INFO: Scrape type for 2454963: 1
2025-12-05 06:01:04 [manheim.gb] INFO: Found listing with ID: 2456004
2025-12-05 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272456004%27 HTTP/1.1" 200 None
2025-12-05 06:01:04 [manheim.gb] INFO: Scrape type for 2456004: 2
2025-12-05 06:01:04 [manheim.gb] INFO: Found listing with ID: 24566
2025-12-05 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%2724566%27 HTTP/1.1" 200 None
2025-12-05 06:01:04 [manheim.gb] INFO: Scrape type for 24566: 1
2025-12-05 06:01:04 [manheim.gb] INFO: Found listing with ID: 2458076
2025-12-05 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272458076%27 HTTP/1.1" 200 None
2025-12-05 06:01:04 [manheim.gb] INFO: Scrape type for 2458076: 0
2025-12-05 06:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/BMW/1SERIES?id=1005857&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231005857&indx=1> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:01:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:01:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 946a5f62-8538-51e2-8a56-aa2cb9cce320 with identifier: 1005857
2025-12-05 06:01:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 946a5f62-8538-51e2-8a56-aa2cb9cce320 with scrape type 2
2025-12-05 06:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 946a5f62-8538-51e2-8a56-aa2cb9cce320 with scrape type 2
2025-12-05 06:01:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 946a5f62-8538-51e2-8a56-aa2cb9cce320, identifier: 1005857
2025-12-05 06:01:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 946a5f62-8538-51e2-8a56-aa2cb9cce320 with identifier: 1005857
2025-12-05 06:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 06:01:28 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Orange HTTP/1.1" 200 None
2025-12-05 06:01:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 06:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 06:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 06:01:29 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Diesel HTTP/1.1" 200 None
2025-12-05 06:01:29 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 06:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 06:01:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 946a5f62-8538-51e2-8a56-aa2cb9cce320 with identifier: 1005857
2025-12-05 06:01:29 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 11 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    11
2025-12-05 06:01:29 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: 946a5f62-8538-51e2-8a56-aa2cb9cce320 spider: manheim.gb
2025-12-05 06:01:29 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 946a5f62-8538-51e2-8a56-aa2cb9cce320 due to rule: registration_date_old.json, error: 11 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    11
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001005857-01989086-001.pdf',
 'color': 'Orange',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': '2025-12-11T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '946a5f62-8538-51e2-8a56-aa2cb9cce320',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'GU14UBE',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/BMW/1%20SERIES?id=1005857',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'BMW',
 'model': '1 SERIES',
 'odometer': 83102,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-07',
 'seller_name': 'Big Motoring World Ltd',
 'title': 'BMW 1 SERIES 116d EfficientDynamics Business 5dr',
 'transmission': 'manual',
 'trim': '116d EfficientDynamics Business 5dr',
 'year': 2014}
2025-12-05 06:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271005857%27 HTTP/1.1" 200 None
2025-12-05 06:01:29 [manheim.gb] INFO: Saving data for 1005857: {'auction_closing_time': 1765443600.0, 'created_time': 1764792092.125789, 'last_price_update_time': 1764914489.303837}
2025-12-05 06:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1005857') HTTP/1.1" 204 0
2025-12-05 06:01:29 [scrapy.extensions.logstats] INFO: Crawled 3 pages (at 3 pages/min), scraped 0 items (at 0 items/min)
2025-12-05 06:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=1753030&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231753030&indx=46> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:01:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:01:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bef5f407-3c99-5c87-a16b-82c79f70164d with identifier: 1753030
2025-12-05 06:01:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bef5f407-3c99-5c87-a16b-82c79f70164d with scrape type 2
2025-12-05 06:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bef5f407-3c99-5c87-a16b-82c79f70164d with scrape type 2
2025-12-05 06:01:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: bef5f407-3c99-5c87-a16b-82c79f70164d, identifier: 1753030
2025-12-05 06:01:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: bef5f407-3c99-5c87-a16b-82c79f70164d with identifier: 1753030
2025-12-05 06:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 06:01:30 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Black HTTP/1.1" 200 None
2025-12-05 06:01:31 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 06:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 06:01:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: bef5f407-3c99-5c87-a16b-82c79f70164d with identifier: 1753030
2025-12-05 06:01:31 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 179116 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    179116
2025-12-05 06:01:31 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: bef5f407-3c99-5c87-a16b-82c79f70164d spider: manheim.gb
2025-12-05 06:01:31 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: bef5f407-3c99-5c87-a16b-82c79f70164d due to rule: high_mileage_for_country.json, error: 179116 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    179116
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001753030-01987836-001.pdf',
 'color': 'Black',
 'currency': 'GBP',
 'engine': '1.5L',
 'expiration_date': '2025-12-11T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'bef5f407-3c99-5c87-a16b-82c79f70164d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'EF61KNX',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=1753030',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 111298,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-12-17',
 'seller_name': 'Big Motoring World Ltd',
 'title': 'NISSAN QASHQAI 1.5 dCi [110] N-Tec 5dr',
 'transmission': 'manual',
 'trim': '1.5 dCi [110] N-Tec 5dr',
 'year': 2011}
2025-12-05 06:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271753030%27 HTTP/1.1" 200 None
2025-12-05 06:01:31 [manheim.gb] INFO: Saving data for 1753030: {'auction_closing_time': 1765443600.0, 'created_time': 1764792506.70633, 'last_price_update_time': 1764914491.458396}
2025-12-05 06:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1753030') HTTP/1.1" 204 0
2025-12-05 06:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/AUDI/A3?id=1271730&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231271730&indx=12> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:01:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:01:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4a0736a-e8b2-5da1-a77a-8ad67053ade3 with identifier: 1271730
2025-12-05 06:01:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4a0736a-e8b2-5da1-a77a-8ad67053ade3 with scrape type 2
2025-12-05 06:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d4a0736a-e8b2-5da1-a77a-8ad67053ade3 with scrape type 2
2025-12-05 06:01:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: d4a0736a-e8b2-5da1-a77a-8ad67053ade3, identifier: 1271730
2025-12-05 06:01:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: d4a0736a-e8b2-5da1-a77a-8ad67053ade3 with identifier: 1271730
2025-12-05 06:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 06:01:31 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=WHITE HTTP/1.1" 200 None
2025-12-05 06:01:31 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 06:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 06:01:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: d4a0736a-e8b2-5da1-a77a-8ad67053ade3 with identifier: 1271730
2025-12-05 06:01:31 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': 'startline motor finance', 'price_includes_vat': False, 'title': 'audi a3 1.6 tdi sport 5dr', 'price': 0, 'currency': 'gbp', 'make': 'audi', 'model': 'a3', 'transmission': 'manual', 'engine': '1.6l', 'fuel_type': 'diesel', 'odometer': 147738, 'odometer_reading_unit': 'mi', 'registration_date': '2014-03-25', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/audi/a3?id=1271730', 'location': 'manchester', 'origin_country_code': 'gb', 'trim': '1.6 tdi sport 5dr', 'license_plate': 'hj14azn', 'year': 2014, 'listing': 'auction', 'c_o_2_emission_value': 99, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0001271730-01978519-010.pdf', 'expiration_date': '2025-12-09t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': 'd4a0736a-e8b2-5da1-a77a-8ad67053ade3', 'current_year_diff': 11, 'age_in_months': 140, 'make_model': 'audi a3', 'sanitized_make': 'audi', 'odometer_in_km': 237760}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 140,
     'auction_title': '',
     'c_o_2_emission_value': 99,
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0001271730-01978519-010.pdf',
     'color': 'white',
     'currency': 'gbp',
     'current_year_diff': 11,
     'engine': '1.6l',
     'expiration_date': '2025-12-09t09:00:00z',
     'fuel_type': 'diesel',
     'id': 'd4a0736a-e8b2-5da1-a77a-8ad67053ade3',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'hj14azn',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/audi/a3?id=1271730',
     'listing': 'auction',
     'location': 'manchester',
     'make': 'audi',
     'make_model': 'audi a3',
     'model': 'a3',
     'odometer': 147738,
     'odometer_in_km': 237760,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2014-03-25',
     'sanitized_make': 'audi',
     'seller_name': 'startline motor finance',
     'title': 'audi a3 1.6 tdi sport 5dr',
     'transmission': 'manual',
     'trim': '1.6 tdi sport 5dr',
     'year': 2014}
2025-12-05 06:01:31 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: d4a0736a-e8b2-5da1-a77a-8ad67053ade3 spider: manheim.gb
2025-12-05 06:01:32 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: d4a0736a-e8b2-5da1-a77a-8ad67053ade3 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': 'startline motor finance', 'price_includes_vat': False, 'title': 'audi a3 1.6 tdi sport 5dr', 'price': 0, 'currency': 'gbp', 'make': 'audi', 'model': 'a3', 'transmission': 'manual', 'engine': '1.6l', 'fuel_type': 'diesel', 'odometer': 147738, 'odometer_reading_unit': 'mi', 'registration_date': '2014-03-25', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/audi/a3?id=1271730', 'location': 'manchester', 'origin_country_code': 'gb', 'trim': '1.6 tdi sport 5dr', 'license_plate': 'hj14azn', 'year': 2014, 'listing': 'auction', 'c_o_2_emission_value': 99, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0001271730-01978519-010.pdf', 'expiration_date': '2025-12-09t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': 'd4a0736a-e8b2-5da1-a77a-8ad67053ade3', 'current_year_diff': 11, 'age_in_months': 140, 'make_model': 'audi a3', 'sanitized_make': 'audi', 'odometer_in_km': 237760}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 140,
     'auction_title': '',
     'c_o_2_emission_value': 99,
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0001271730-01978519-010.pdf',
     'color': 'white',
     'currency': 'gbp',
     'current_year_diff': 11,
     'engine': '1.6l',
     'expiration_date': '2025-12-09t09:00:00z',
     'fuel_type': 'diesel',
     'id': 'd4a0736a-e8b2-5da1-a77a-8ad67053ade3',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'hj14azn',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/audi/a3?id=1271730',
     'listing': 'auction',
     'location': 'manchester',
     'make': 'audi',
     'make_model': 'audi a3',
     'model': 'a3',
     'odometer': 147738,
     'odometer_in_km': 237760,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2014-03-25',
     'sanitized_make': 'audi',
     'seller_name': 'startline motor finance',
     'title': 'audi a3 1.6 tdi sport 5dr',
     'transmission': 'manual',
     'trim': '1.6 tdi sport 5dr',
     'year': 2014}
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001271730-01978519-010.pdf',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'd4a0736a-e8b2-5da1-a77a-8ad67053ade3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'HJ14AZN',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/AUDI/A3?id=1271730',
 'listing': 'auction',
 'location': 'Manchester',
 'make': 'AUDI',
 'model': 'A3',
 'odometer': 147738,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-25',
 'seller_name': 'Startline Motor Finance',
 'title': 'AUDI A3 1.6 TDI Sport 5dr',
 'transmission': 'manual',
 'trim': '1.6 TDI Sport 5dr',
 'year': 2014}
2025-12-05 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271271730%27 HTTP/1.1" 200 None
2025-12-05 06:01:32 [manheim.gb] INFO: Saving data for 1271730: {'auction_closing_time': 1765270800.0, 'created_time': 1763496159.632345, 'last_price_update_time': 1764914492.103433}
2025-12-05 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1271730') HTTP/1.1" 204 0
2025-12-05 06:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/POLO?id=1319653&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231319653&indx=16> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:01:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:01:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49d6b157-3392-5cff-8885-cfc8805f6e7a with identifier: 1319653
2025-12-05 06:01:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49d6b157-3392-5cff-8885-cfc8805f6e7a with scrape type 2
2025-12-05 06:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 49d6b157-3392-5cff-8885-cfc8805f6e7a with scrape type 2
2025-12-05 06:01:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 49d6b157-3392-5cff-8885-cfc8805f6e7a, identifier: 1319653
2025-12-05 06:01:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 49d6b157-3392-5cff-8885-cfc8805f6e7a with identifier: 1319653
2025-12-05 06:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 06:01:32 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Red HTTP/1.1" 200 None
2025-12-05 06:01:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 06:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 06:01:32 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Petrol HTTP/1.1" 200 None
2025-12-05 06:01:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 06:01:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 49d6b157-3392-5cff-8885-cfc8805f6e7a with identifier: 1319653
2025-12-05 06:01:32 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 10 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    10
2025-12-05 06:01:32 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: 49d6b157-3392-5cff-8885-cfc8805f6e7a spider: manheim.gb
2025-12-05 06:01:32 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 49d6b157-3392-5cff-8885-cfc8805f6e7a due to rule: registration_date_old.json, error: 10 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    10
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001319653-01990134-002.pdf',
 'color': 'Red',
 'currency': 'GBP',
 'engine': '1.0L',
 'expiration_date': '2025-12-12T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '49d6b157-3392-5cff-8885-cfc8805f6e7a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'RJ65ZNC',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/POLO?id=1319653',
 'listing': 'auction',
 'location': 'Birmingham',
 'make': 'VOLKSWAGEN',
 'model': 'POLO',
 'odometer': 55916,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-20',
 'seller_name': 'Sandicliffe',
 'title': 'VOLKSWAGEN POLO 1.0 SE 5dr',
 'transmission': 'manual',
 'trim': '1.0 SE 5dr',
 'year': 2015}
2025-12-05 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271319653%27 HTTP/1.1" 200 None
2025-12-05 06:01:32 [manheim.gb] INFO: Saving data for 1319653: {'auction_closing_time': 1765530000.0, 'created_time': 1764792082.005274, 'last_price_update_time': 1764914492.977162}
2025-12-05 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1319653') HTTP/1.1" 204 0
2025-12-05 06:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/PASSAT?id=1127441&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231127441&indx=6> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:01:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:01:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5be135ec-c9fe-55f1-b809-f70ed7ffc818 with identifier: 1127441
2025-12-05 06:01:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5be135ec-c9fe-55f1-b809-f70ed7ffc818 with scrape type 2
2025-12-05 06:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5be135ec-c9fe-55f1-b809-f70ed7ffc818 with scrape type 2
2025-12-05 06:01:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 5be135ec-c9fe-55f1-b809-f70ed7ffc818, identifier: 1127441
2025-12-05 06:01:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 5be135ec-c9fe-55f1-b809-f70ed7ffc818 with identifier: 1127441
2025-12-05 06:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 06:01:33 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=RED HTTP/1.1" 200 None
2025-12-05 06:01:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 06:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 06:01:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 5be135ec-c9fe-55f1-b809-f70ed7ffc818 with identifier: 1127441
2025-12-05 06:01:34 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': 'mawsley motor company ltd', 'price_includes_vat': False, 'title': 'volkswagen passat 2.0 tdi bluemotion tech highline 5dr', 'price': 0, 'currency': 'gbp', 'make': 'volkswagen', 'model': 'passat', 'transmission': 'manual', 'engine': '2.0l', 'fuel_type': 'diesel', 'odometer': 135871, 'odometer_reading_unit': 'mi', 'registration_date': '2013-03-08', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/volkswagen/passat?id=1127441', 'location': 'northampton', 'origin_country_code': 'gb', 'trim': '2.0 tdi bluemotion tech highline 5dr', 'license_plate': 'rx13mhf', 'year': 2013, 'listing': 'auction', 'c_o_2_emission_value': 120, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0001127441-01988485-003.pdf', 'expiration_date': '2025-12-09t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': '5be135ec-c9fe-55f1-b809-f70ed7ffc818', 'current_year_diff': 12, 'age_in_months': 152, 'make_model': 'volkswagen passat', 'sanitized_make': 'volkswagen', 'odometer_in_km': 218662}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 152,
     'auction_title': '',
     'c_o_2_emission_value': 120,
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0001127441-01988485-003.pdf',
     'color': 'red',
     'currency': 'gbp',
     'current_year_diff': 12,
     'engine': '2.0l',
     'expiration_date': '2025-12-09t09:00:00z',
     'fuel_type': 'diesel',
     'id': '5be135ec-c9fe-55f1-b809-f70ed7ffc818',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'rx13mhf',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/volkswagen/passat?id=1127441',
     'listing': 'auction',
     'location': 'northampton',
     'make': 'volkswagen',
     'make_model': 'volkswagen passat',
     'model': 'passat',
     'odometer': 135871,
     'odometer_in_km': 218662,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2013-03-08',
     'sanitized_make': 'volkswagen',
     'seller_name': 'mawsley motor company ltd',
     'title': 'volkswagen passat 2.0 tdi bluemotion tech highline 5dr',
     'transmission': 'manual',
     'trim': '2.0 tdi bluemotion tech highline 5dr',
     'year': 2013}
2025-12-05 06:01:34 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 5be135ec-c9fe-55f1-b809-f70ed7ffc818 spider: manheim.gb
2025-12-05 06:01:34 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 5be135ec-c9fe-55f1-b809-f70ed7ffc818 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': 'mawsley motor company ltd', 'price_includes_vat': False, 'title': 'volkswagen passat 2.0 tdi bluemotion tech highline 5dr', 'price': 0, 'currency': 'gbp', 'make': 'volkswagen', 'model': 'passat', 'transmission': 'manual', 'engine': '2.0l', 'fuel_type': 'diesel', 'odometer': 135871, 'odometer_reading_unit': 'mi', 'registration_date': '2013-03-08', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/volkswagen/passat?id=1127441', 'location': 'northampton', 'origin_country_code': 'gb', 'trim': '2.0 tdi bluemotion tech highline 5dr', 'license_plate': 'rx13mhf', 'year': 2013, 'listing': 'auction', 'c_o_2_emission_value': 120, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0001127441-01988485-003.pdf', 'expiration_date': '2025-12-09t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': '5be135ec-c9fe-55f1-b809-f70ed7ffc818', 'current_year_diff': 12, 'age_in_months': 152, 'make_model': 'volkswagen passat', 'sanitized_make': 'volkswagen', 'odometer_in_km': 218662}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 152,
     'auction_title': '',
     'c_o_2_emission_value': 120,
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0001127441-01988485-003.pdf',
     'color': 'red',
     'currency': 'gbp',
     'current_year_diff': 12,
     'engine': '2.0l',
     'expiration_date': '2025-12-09t09:00:00z',
     'fuel_type': 'diesel',
     'id': '5be135ec-c9fe-55f1-b809-f70ed7ffc818',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'rx13mhf',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/volkswagen/passat?id=1127441',
     'listing': 'auction',
     'location': 'northampton',
     'make': 'volkswagen',
     'make_model': 'volkswagen passat',
     'model': 'passat',
     'odometer': 135871,
     'odometer_in_km': 218662,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2013-03-08',
     'sanitized_make': 'volkswagen',
     'seller_name': 'mawsley motor company ltd',
     'title': 'volkswagen passat 2.0 tdi bluemotion tech highline 5dr',
     'transmission': 'manual',
     'trim': '2.0 tdi bluemotion tech highline 5dr',
     'year': 2013}
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001127441-01988485-003.pdf',
 'color': 'RED',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '5be135ec-c9fe-55f1-b809-f70ed7ffc818',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'RX13MHF',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/PASSAT?id=1127441',
 'listing': 'auction',
 'location': 'Northampton',
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT',
 'odometer': 135871,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-08',
 'seller_name': 'MAWSLEY MOTOR COMPANY LTD',
 'title': 'VOLKSWAGEN PASSAT 2.0 TDI Bluemotion Tech Highline 5dr',
 'transmission': 'manual',
 'trim': '2.0 TDI Bluemotion Tech Highline 5dr',
 'year': 2013}
2025-12-05 06:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271127441%27 HTTP/1.1" 200 None
2025-12-05 06:01:34 [manheim.gb] INFO: Saving data for 1127441: {'auction_closing_time': 1765270800.0, 'created_time': 1764662522.994519, 'last_price_update_time': 1764914494.148862}
2025-12-05 06:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1127441') HTTP/1.1" 204 0
2025-12-05 06:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/JEEP/RENEGADE?id=1714274&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231714274&indx=42> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:01:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:01:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57292f8a-5d70-5ce9-9b84-da5a726be190 with identifier: 1714274
2025-12-05 06:01:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57292f8a-5d70-5ce9-9b84-da5a726be190 with scrape type 2
2025-12-05 06:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 57292f8a-5d70-5ce9-9b84-da5a726be190 with scrape type 2
2025-12-05 06:01:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 57292f8a-5d70-5ce9-9b84-da5a726be190, identifier: 1714274
2025-12-05 06:01:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 57292f8a-5d70-5ce9-9b84-da5a726be190 with identifier: 1714274
2025-12-05 06:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 06:01:36 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=BLACK HTTP/1.1" 200 None
2025-12-05 06:01:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 06:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 06:01:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 57292f8a-5d70-5ce9-9b84-da5a726be190 with identifier: 1714274
2025-12-05 06:01:36 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 198027 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    198027
2025-12-05 06:01:36 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 57292f8a-5d70-5ce9-9b84-da5a726be190 spider: manheim.gb
2025-12-05 06:01:37 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 57292f8a-5d70-5ce9-9b84-da5a726be190 due to rule: high_mileage_for_country.json, error: 198027 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    198027
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001714274-01988520-002.pdf',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '57292f8a-5d70-5ce9-9b84-da5a726be190',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'YH66OGX',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/JEEP/RENEGADE?id=1714274',
 'listing': 'auction',
 'location': 'Bristol',
 'make': 'JEEP',
 'model': 'RENEGADE',
 'odometer': 123049,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-16',
 'seller_name': 'Bridgend Ford',
 'title': 'JEEP RENEGADE 1.6 Multijet Longitude 5dr',
 'transmission': 'manual',
 'trim': '1.6 Multijet Longitude 5dr',
 'year': 2016}
2025-12-05 06:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271714274%27 HTTP/1.1" 200 None
2025-12-05 06:01:37 [manheim.gb] INFO: Saving data for 1714274: {'auction_closing_time': 1765184400.0, 'created_time': 1764792534.390552, 'last_price_update_time': 1764914497.121237}
2025-12-05 06:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1714274') HTTP/1.1" 204 0
2025-12-05 06:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/AUDI/A3?id=1535266&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231535266&indx=31> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:01:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:01:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03d6a766-80d7-59cc-ae37-314c274e99ed with identifier: 1535266
2025-12-05 06:01:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03d6a766-80d7-59cc-ae37-314c274e99ed with scrape type 2
2025-12-05 06:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03d6a766-80d7-59cc-ae37-314c274e99ed with scrape type 2
2025-12-05 06:01:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 03d6a766-80d7-59cc-ae37-314c274e99ed, identifier: 1535266
2025-12-05 06:01:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 03d6a766-80d7-59cc-ae37-314c274e99ed with identifier: 1535266
2025-12-05 06:01:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 03d6a766-80d7-59cc-ae37-314c274e99ed with identifier: 1535266
2025-12-05 06:01:38 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 189863 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    189863
2025-12-05 06:01:38 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 03d6a766-80d7-59cc-ae37-314c274e99ed spider: manheim.gb
2025-12-05 06:01:38 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 03d6a766-80d7-59cc-ae37-314c274e99ed due to rule: high_mileage_for_country.json, error: 189863 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    189863
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001535266-01990369-003.pdf',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '03d6a766-80d7-59cc-ae37-314c274e99ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'WF64CMK',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/AUDI/A3?id=1535266',
 'listing': 'auction',
 'location': 'Manchester',
 'make': 'AUDI',
 'model': 'A3',
 'odometer': 117976,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-29',
 'seller_name': 'LSH Auto Group',
 'title': 'AUDI A3 2.0 TDI Sport 5dr',
 'transmission': 'manual',
 'trim': '2.0 TDI Sport 5dr',
 'year': 2014}
2025-12-05 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271535266%27 HTTP/1.1" 200 None
2025-12-05 06:01:38 [manheim.gb] INFO: Saving data for 1535266: {'auction_closing_time': 1765270800.0, 'created_time': 1764792569.477623, 'last_price_update_time': 1764914498.247622}
2025-12-05 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1535266') HTTP/1.1" 204 0
2025-12-05 06:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/MAZDA/CX5?id=1376686&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231376686&indx=18> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:01:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:01:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f8d1df0-3667-5cb5-beba-c9437681bc85 with identifier: 1376686
2025-12-05 06:01:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f8d1df0-3667-5cb5-beba-c9437681bc85 with scrape type 2
2025-12-05 06:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f8d1df0-3667-5cb5-beba-c9437681bc85 with scrape type 2
2025-12-05 06:01:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 4f8d1df0-3667-5cb5-beba-c9437681bc85, identifier: 1376686
2025-12-05 06:01:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 4f8d1df0-3667-5cb5-beba-c9437681bc85 with identifier: 1376686
2025-12-05 06:01:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 4f8d1df0-3667-5cb5-beba-c9437681bc85 with identifier: 1376686
2025-12-05 06:01:40 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 190964 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    190964
2025-12-05 06:01:40 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 4f8d1df0-3667-5cb5-beba-c9437681bc85 spider: manheim.gb
2025-12-05 06:01:40 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 4f8d1df0-3667-5cb5-beba-c9437681bc85 due to rule: high_mileage_for_country.json, error: 190964 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    190964
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001376686-01914162-005.pdf',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': '2025-12-05T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '4f8d1df0-3667-5cb5-beba-c9437681bc85',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'PJ63BVD',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MAZDA/CX-5?id=1376686',
 'listing': 'auction',
 'location': 'Bristol',
 'make': 'MAZDA',
 'model': 'CX-5',
 'odometer': 118660,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-12-03',
 'seller_name': 'Bluewater Vehicle Redistribution',
 'title': 'MAZDA CX-5 2.0 Sport Nav 5dr',
 'transmission': 'manual',
 'trim': '2.0 Sport Nav 5dr',
 'year': 2013}
2025-12-05 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271376686%27 HTTP/1.1" 200 None
2025-12-05 06:01:40 [manheim.gb] INFO: Saving data for 1376686: {'auction_closing_time': 1764925200.0, 'created_time': 1764669714.696571, 'last_price_update_time': 1764914500.510853}
2025-12-05 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1376686') HTTP/1.1" 204 0
2025-12-05 06:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/NISSAN/JUKE?id=1783769&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231783769&indx=48> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:01:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:01:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f with identifier: 1783769
2025-12-05 06:01:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f with scrape type 2
2025-12-05 06:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f with scrape type 2
2025-12-05 06:01:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f, identifier: 1783769
2025-12-05 06:01:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f with identifier: 1783769
2025-12-05 06:01:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f with identifier: 1783769
2025-12-05 06:01:57 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f with identifier: 1783769 to the API
2025-12-05 06:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 06:01:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 06:01:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/NISSAN/JUKE?id=1783769&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231783769&indx=48>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001783769-01975507-003.pdf',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '82448f5e-61a0-5d17-b6f1-78f5f0f3fa1f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'NV67AXY',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/NISSAN/JUKE?id=1783769',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'NISSAN',
 'model': 'JUKE',
 'odometer': 70962,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-14',
 'seller_name': 'Santander Consumer',
 'title': 'NISSAN JUKE 1.2 DiG-T Tekna 5dr',
 'transmission': 'manual',
 'trim': '1.2 DiG-T Tekna 5dr',
 'year': 2017}
2025-12-05 06:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271783769%27 HTTP/1.1" 200 None
2025-12-05 06:01:58 [manheim.gb] INFO: Saving data for 1783769: {'auction_closing_time': 1765270800.0, 'created_time': 1764669811.932753, 'last_price_update_time': 1764914518.539133}
2025-12-05 06:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1783769') HTTP/1.1" 204 0
2025-12-05 06:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/SLK?id=2176421&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232176421&indx=66> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:01:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:01:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03c494f2-3371-5bde-b401-c1f85e4e32fc with identifier: 2176421
2025-12-05 06:01:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03c494f2-3371-5bde-b401-c1f85e4e32fc with scrape type 2
2025-12-05 06:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03c494f2-3371-5bde-b401-c1f85e4e32fc with scrape type 2
2025-12-05 06:01:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 03c494f2-3371-5bde-b401-c1f85e4e32fc, identifier: 2176421
2025-12-05 06:01:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 03c494f2-3371-5bde-b401-c1f85e4e32fc with identifier: 2176421
2025-12-05 06:01:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 03c494f2-3371-5bde-b401-c1f85e4e32fc with identifier: 2176421
2025-12-05 06:01:58 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 165480 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    165480
2025-12-05 06:01:58 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 03c494f2-3371-5bde-b401-c1f85e4e32fc spider: manheim.gb
2025-12-05 06:01:59 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 03c494f2-3371-5bde-b401-c1f85e4e32fc due to rule: high_mileage_for_country.json, error: 165480 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    165480
{'auction_title': '',
 'c_o_2_emission_value': 211,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002176421-01989517-003.pdf',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.8L',
 'expiration_date': '2025-12-05T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '03c494f2-3371-5bde-b401-c1f85e4e32fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'VU08ZYS',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/SLK?id=2176421',
 'listing': 'auction',
 'location': 'Birmingham',
 'make': 'MERCEDES-BENZ',
 'model': 'SLK',
 'odometer': 102825,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-03-07',
 'seller_name': 'Arbury',
 'title': 'MERCEDES-BENZ SLK SLK 200K 2dr Tip Auto',
 'transmission': 'automatic',
 'trim': 'SLK 200K 2dr Tip Auto',
 'year': 2008}
2025-12-05 06:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272176421%27 HTTP/1.1" 200 None
2025-12-05 06:01:59 [manheim.gb] INFO: Saving data for 2176421: {'auction_closing_time': 1764925200.0, 'created_time': 1764792133.690517, 'last_price_update_time': 1764914519.028792}
2025-12-05 06:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2176421') HTTP/1.1" 204 0
2025-12-05 06:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=1995165&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231995165&indx=56> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:01:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:01:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ebe8f7b-048e-525e-945f-a870f3e3c810 with identifier: 1995165
2025-12-05 06:01:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ebe8f7b-048e-525e-945f-a870f3e3c810 with scrape type 2
2025-12-05 06:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ebe8f7b-048e-525e-945f-a870f3e3c810 with scrape type 2
2025-12-05 06:01:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 3ebe8f7b-048e-525e-945f-a870f3e3c810, identifier: 1995165
2025-12-05 06:01:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 3ebe8f7b-048e-525e-945f-a870f3e3c810 with identifier: 1995165
2025-12-05 06:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 06:01:59 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=BLUE HTTP/1.1" 200 None
2025-12-05 06:01:59 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 06:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 06:01:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 3ebe8f7b-048e-525e-945f-a870f3e3c810 with identifier: 1995165
2025-12-05 06:01:59 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 3ebe8f7b-048e-525e-945f-a870f3e3c810 with identifier: 1995165 to the API
2025-12-05 06:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 06:01:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 06:01:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=1995165&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231995165&indx=56>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001995165-01987332-001.pdf',
 'color': 'BLUE',
 'currency': 'GBP',
 'engine': '1.5L',
 'expiration_date': '2025-12-05T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '3ebe8f7b-048e-525e-945f-a870f3e3c810',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'YF17JZL',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=1995165',
 'listing': 'auction',
 'location': 'Birmingham',
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 56810,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-31',
 'seller_name': None,
 'title': 'NISSAN QASHQAI 1.5 dCi N-Vision 5dr',
 'transmission': 'manual',
 'trim': '1.5 dCi N-Vision 5dr',
 'year': 2017}
2025-12-05 06:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271995165%27 HTTP/1.1" 200 None
2025-12-05 06:01:59 [manheim.gb] INFO: Saving data for 1995165: {'auction_closing_time': 1764925200.0, 'created_time': 1764583968.142286, 'last_price_update_time': 1764914519.747693}
2025-12-05 06:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1995165') HTTP/1.1" 204 0
2025-12-05 06:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/PASSATCC?id=2063938&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232063938&indx=61> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:02:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/refine> (referer: https://www.manheim.co.uk/search) ['zyte-api']
2025-12-05 06:02:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:02:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 994e3fc3-2da0-5354-9217-b30b79c65433 with identifier: 2063938
2025-12-05 06:02:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 994e3fc3-2da0-5354-9217-b30b79c65433 with scrape type 2
2025-12-05 06:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 994e3fc3-2da0-5354-9217-b30b79c65433 with scrape type 2
2025-12-05 06:02:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 994e3fc3-2da0-5354-9217-b30b79c65433, identifier: 2063938
2025-12-05 06:02:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 994e3fc3-2da0-5354-9217-b30b79c65433 with identifier: 2063938
2025-12-05 06:02:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 994e3fc3-2da0-5354-9217-b30b79c65433 with identifier: 2063938
2025-12-05 06:02:00 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': 'swansway garages', 'price_includes_vat': False, 'title': 'volkswagen passat cc 2.0 tdi bluemotion tech gt 4dr dsg', 'price': 0, 'currency': 'gbp', 'make': 'volkswagen', 'model': 'passat cc', 'transmission': 'automatic', 'engine': '2.0l', 'fuel_type': 'diesel', 'odometer': 148963, 'odometer_reading_unit': 'mi', 'registration_date': '2013-10-14', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/volkswagen/passat%20cc?id=2063938', 'location': 'manchester', 'origin_country_code': 'gb', 'trim': '2.0 tdi bluemotion tech gt 4dr dsg', 'license_plate': 'lm63apy', 'year': 2013, 'listing': 'auction', 'c_o_2_emission_value': 134, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002063938-01989700-008.pdf', 'expiration_date': '2025-12-09t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': '994e3fc3-2da0-5354-9217-b30b79c65433', 'current_year_diff': 12, 'age_in_months': 145, 'make_model': 'volkswagen passat cc', 'sanitized_make': 'volkswagen', 'odometer_in_km': 239732}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 145,
     'auction_title': '',
     'c_o_2_emission_value': 134,
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002063938-01989700-008.pdf',
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 12,
     'engine': '2.0l',
     'expiration_date': '2025-12-09t09:00:00z',
     'fuel_type': 'diesel',
     'id': '994e3fc3-2da0-5354-9217-b30b79c65433',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'lm63apy',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/volkswagen/passat%20cc?id=2063938',
     'listing': 'auction',
     'location': 'manchester',
     'make': 'volkswagen',
     'make_model': 'volkswagen passat cc',
     'model': 'passat cc',
     'odometer': 148963,
     'odometer_in_km': 239732,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2013-10-14',
     'sanitized_make': 'volkswagen',
     'seller_name': 'swansway garages',
     'title': 'volkswagen passat cc 2.0 tdi bluemotion tech gt 4dr dsg',
     'transmission': 'automatic',
     'trim': '2.0 tdi bluemotion tech gt 4dr dsg',
     'year': 2013}
2025-12-05 06:02:00 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 994e3fc3-2da0-5354-9217-b30b79c65433 spider: manheim.gb
2025-12-05 06:02:01 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 994e3fc3-2da0-5354-9217-b30b79c65433 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': 'swansway garages', 'price_includes_vat': False, 'title': 'volkswagen passat cc 2.0 tdi bluemotion tech gt 4dr dsg', 'price': 0, 'currency': 'gbp', 'make': 'volkswagen', 'model': 'passat cc', 'transmission': 'automatic', 'engine': '2.0l', 'fuel_type': 'diesel', 'odometer': 148963, 'odometer_reading_unit': 'mi', 'registration_date': '2013-10-14', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/volkswagen/passat%20cc?id=2063938', 'location': 'manchester', 'origin_country_code': 'gb', 'trim': '2.0 tdi bluemotion tech gt 4dr dsg', 'license_plate': 'lm63apy', 'year': 2013, 'listing': 'auction', 'c_o_2_emission_value': 134, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002063938-01989700-008.pdf', 'expiration_date': '2025-12-09t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': '994e3fc3-2da0-5354-9217-b30b79c65433', 'current_year_diff': 12, 'age_in_months': 145, 'make_model': 'volkswagen passat cc', 'sanitized_make': 'volkswagen', 'odometer_in_km': 239732}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 145,
     'auction_title': '',
     'c_o_2_emission_value': 134,
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002063938-01989700-008.pdf',
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 12,
     'engine': '2.0l',
     'expiration_date': '2025-12-09t09:00:00z',
     'fuel_type': 'diesel',
     'id': '994e3fc3-2da0-5354-9217-b30b79c65433',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'lm63apy',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/volkswagen/passat%20cc?id=2063938',
     'listing': 'auction',
     'location': 'manchester',
     'make': 'volkswagen',
     'make_model': 'volkswagen passat cc',
     'model': 'passat cc',
     'odometer': 148963,
     'odometer_in_km': 239732,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2013-10-14',
     'sanitized_make': 'volkswagen',
     'seller_name': 'swansway garages',
     'title': 'volkswagen passat cc 2.0 tdi bluemotion tech gt 4dr dsg',
     'transmission': 'automatic',
     'trim': '2.0 tdi bluemotion tech gt 4dr dsg',
     'year': 2013}
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002063938-01989700-008.pdf',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '994e3fc3-2da0-5354-9217-b30b79c65433',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'LM63APY',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/PASSAT%20CC?id=2063938',
 'listing': 'auction',
 'location': 'Manchester',
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT CC',
 'odometer': 148963,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-14',
 'seller_name': 'Swansway Garages',
 'title': 'VOLKSWAGEN PASSAT CC 2.0 TDI BlueMotion Tech GT 4dr DSG',
 'transmission': 'automatic',
 'trim': '2.0 TDI BlueMotion Tech GT 4dr DSG',
 'year': 2013}
2025-12-05 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272063938%27 HTTP/1.1" 200 None
2025-12-05 06:02:01 [manheim.gb] INFO: Saving data for 2063938: {'auction_closing_time': 1765270800.0, 'created_time': 1764792480.326333, 'last_price_update_time': 1764914521.13534}
2025-12-05 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2063938') HTTP/1.1" 204 0
2025-12-05 06:02:01 [manheim.gb] INFO: Found listing with ID: 2528107
2025-12-05 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272528107%27 HTTP/1.1" 200 None
2025-12-05 06:02:01 [manheim.gb] INFO: Scrape type for 2528107: 0
2025-12-05 06:02:01 [manheim.gb] INFO: Found listing with ID: 2528639
2025-12-05 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272528639%27 HTTP/1.1" 200 None
2025-12-05 06:02:01 [manheim.gb] INFO: Scrape type for 2528639: 2
2025-12-05 06:02:01 [manheim.gb] INFO: Found listing with ID: 2542025
2025-12-05 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272542025%27 HTTP/1.1" 200 None
2025-12-05 06:02:01 [manheim.gb] INFO: Scrape type for 2542025: 0
2025-12-05 06:02:01 [manheim.gb] INFO: Found listing with ID: 2550798
2025-12-05 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272550798%27 HTTP/1.1" 200 None
2025-12-05 06:02:01 [manheim.gb] INFO: Scrape type for 2550798: 1
2025-12-05 06:02:01 [manheim.gb] INFO: Found listing with ID: 255681
2025-12-05 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27255681%27 HTTP/1.1" 200 None
2025-12-05 06:02:01 [manheim.gb] INFO: Scrape type for 255681: 2
2025-12-05 06:02:01 [manheim.gb] INFO: Found listing with ID: 2561807
2025-12-05 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272561807%27 HTTP/1.1" 200 None
2025-12-05 06:02:01 [manheim.gb] INFO: Scrape type for 2561807: 2
2025-12-05 06:02:01 [manheim.gb] INFO: Found listing with ID: 2562472
2025-12-05 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272562472%27 HTTP/1.1" 200 None
2025-12-05 06:02:01 [manheim.gb] INFO: Scrape type for 2562472: 0
2025-12-05 06:02:01 [manheim.gb] INFO: Found listing with ID: 2577653
2025-12-05 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272577653%27 HTTP/1.1" 200 None
2025-12-05 06:02:01 [manheim.gb] INFO: Scrape type for 2577653: 2
2025-12-05 06:02:01 [manheim.gb] INFO: Found listing with ID: 2585181
2025-12-05 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272585181%27 HTTP/1.1" 200 None
2025-12-05 06:02:01 [manheim.gb] INFO: Scrape type for 2585181: 1
2025-12-05 06:02:01 [manheim.gb] INFO: Found listing with ID: 2589156
2025-12-05 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272589156%27 HTTP/1.1" 200 None
2025-12-05 06:02:01 [manheim.gb] INFO: Scrape type for 2589156: 0
2025-12-05 06:02:01 [manheim.gb] INFO: Found listing with ID: 2590049
2025-12-05 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272590049%27 HTTP/1.1" 200 None
2025-12-05 06:02:01 [manheim.gb] INFO: Scrape type for 2590049: 2
2025-12-05 06:02:01 [manheim.gb] INFO: Found listing with ID: 2606673
2025-12-05 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272606673%27 HTTP/1.1" 200 None
2025-12-05 06:02:01 [manheim.gb] INFO: Scrape type for 2606673: 0
2025-12-05 06:02:01 [manheim.gb] INFO: Found listing with ID: 2609231
2025-12-05 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272609231%27 HTTP/1.1" 200 None
2025-12-05 06:02:01 [manheim.gb] INFO: Scrape type for 2609231: 2
2025-12-05 06:02:01 [manheim.gb] INFO: Found listing with ID: 2628170
2025-12-05 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272628170%27 HTTP/1.1" 200 None
2025-12-05 06:02:01 [manheim.gb] INFO: Scrape type for 2628170: 2
2025-12-05 06:02:01 [manheim.gb] INFO: Found listing with ID: 2652071
2025-12-05 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272652071%27 HTTP/1.1" 200 None
2025-12-05 06:02:01 [manheim.gb] INFO: Scrape type for 2652071: 1
2025-12-05 06:02:01 [manheim.gb] INFO: Found listing with ID: 2654910
2025-12-05 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272654910%27 HTTP/1.1" 200 None
2025-12-05 06:02:01 [manheim.gb] INFO: Scrape type for 2654910: 2
2025-12-05 06:02:01 [manheim.gb] INFO: Found listing with ID: 2660446
2025-12-05 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272660446%27 HTTP/1.1" 200 None
2025-12-05 06:02:01 [manheim.gb] INFO: Scrape type for 2660446: 2
2025-12-05 06:02:01 [manheim.gb] INFO: Found listing with ID: 2664010
2025-12-05 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272664010%27 HTTP/1.1" 200 None
2025-12-05 06:02:01 [manheim.gb] INFO: Scrape type for 2664010: 0
2025-12-05 06:02:01 [manheim.gb] INFO: Found listing with ID: 2699424
2025-12-05 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272699424%27 HTTP/1.1" 200 None
2025-12-05 06:02:01 [manheim.gb] INFO: Scrape type for 2699424: 2
2025-12-05 06:02:01 [manheim.gb] INFO: Found listing with ID: 2733772
2025-12-05 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272733772%27 HTTP/1.1" 200 None
2025-12-05 06:02:01 [manheim.gb] INFO: Scrape type for 2733772: 2
2025-12-05 06:02:01 [manheim.gb] INFO: Found listing with ID: 2744515
2025-12-05 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272744515%27 HTTP/1.1" 200 None
2025-12-05 06:02:01 [manheim.gb] INFO: Scrape type for 2744515: 2
2025-12-05 06:02:01 [manheim.gb] INFO: Found listing with ID: 2746923
2025-12-05 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272746923%27 HTTP/1.1" 200 None
2025-12-05 06:02:01 [manheim.gb] INFO: Scrape type for 2746923: 2
2025-12-05 06:02:01 [manheim.gb] INFO: Found listing with ID: 2765368
2025-12-05 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272765368%27 HTTP/1.1" 200 None
2025-12-05 06:02:01 [manheim.gb] INFO: Scrape type for 2765368: 2
2025-12-05 06:02:01 [manheim.gb] INFO: Found listing with ID: 2778685
2025-12-05 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272778685%27 HTTP/1.1" 200 None
2025-12-05 06:02:01 [manheim.gb] INFO: Scrape type for 2778685: 0
2025-12-05 06:02:01 [manheim.gb] INFO: Found listing with ID: 2782744
2025-12-05 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272782744%27 HTTP/1.1" 200 None
2025-12-05 06:02:01 [manheim.gb] INFO: Scrape type for 2782744: 2
2025-12-05 06:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VOLVO/V40?id=2292492&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232292492&indx=80> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:02:01 [manheim.gb] INFO: Found listing with ID: 2809184
2025-12-05 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272809184%27 HTTP/1.1" 200 None
2025-12-05 06:02:01 [manheim.gb] INFO: Scrape type for 2809184: 0
2025-12-05 06:02:01 [manheim.gb] INFO: Found listing with ID: 2871207
2025-12-05 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272871207%27 HTTP/1.1" 200 None
2025-12-05 06:02:01 [manheim.gb] INFO: Scrape type for 2871207: 2
2025-12-05 06:02:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:02:01 [manheim.gb] INFO: Found listing with ID: 2886723
2025-12-05 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272886723%27 HTTP/1.1" 200 None
2025-12-05 06:02:01 [manheim.gb] INFO: Scrape type for 2886723: 2
2025-12-05 06:02:01 [manheim.gb] INFO: Found listing with ID: 2891297
2025-12-05 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272891297%27 HTTP/1.1" 200 None
2025-12-05 06:02:01 [manheim.gb] INFO: Scrape type for 2891297: 0
2025-12-05 06:02:01 [manheim.gb] INFO: Found listing with ID: 2893691
2025-12-05 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272893691%27 HTTP/1.1" 200 None
2025-12-05 06:02:01 [manheim.gb] INFO: Scrape type for 2893691: 0
2025-12-05 06:02:01 [manheim.gb] INFO: Found listing with ID: 2896151
2025-12-05 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272896151%27 HTTP/1.1" 200 None
2025-12-05 06:02:01 [manheim.gb] INFO: Scrape type for 2896151: 0
2025-12-05 06:02:01 [manheim.gb] INFO: Found listing with ID: 2907623
2025-12-05 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272907623%27 HTTP/1.1" 200 None
2025-12-05 06:02:01 [manheim.gb] INFO: Scrape type for 2907623: 2
2025-12-05 06:02:01 [manheim.gb] INFO: Found listing with ID: 2933109
2025-12-05 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272933109%27 HTTP/1.1" 200 None
2025-12-05 06:02:01 [manheim.gb] INFO: Scrape type for 2933109: 0
2025-12-05 06:02:01 [manheim.gb] INFO: Found listing with ID: 2935429
2025-12-05 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272935429%27 HTTP/1.1" 200 None
2025-12-05 06:02:01 [manheim.gb] INFO: Scrape type for 2935429: 1
2025-12-05 06:02:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cde290e2-2d86-573e-94d1-ea49b94d51a8 with identifier: 2292492
2025-12-05 06:02:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cde290e2-2d86-573e-94d1-ea49b94d51a8 with scrape type 2
2025-12-05 06:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cde290e2-2d86-573e-94d1-ea49b94d51a8 with scrape type 2
2025-12-05 06:02:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: cde290e2-2d86-573e-94d1-ea49b94d51a8, identifier: 2292492
2025-12-05 06:02:02 [manheim.gb] INFO: Found listing with ID: 2936605
2025-12-05 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272936605%27 HTTP/1.1" 200 None
2025-12-05 06:02:02 [manheim.gb] INFO: Scrape type for 2936605: 2
2025-12-05 06:02:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: cde290e2-2d86-573e-94d1-ea49b94d51a8 with identifier: 2292492
2025-12-05 06:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 06:02:02 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=BRONZE HTTP/1.1" 200 None
2025-12-05 06:02:02 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 06:02:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: cde290e2-2d86-573e-94d1-ea49b94d51a8 with identifier: 2292492
2025-12-05 06:02:02 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 12 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    12
2025-12-05 06:02:02 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: cde290e2-2d86-573e-94d1-ea49b94d51a8 spider: manheim.gb
2025-12-05 06:02:02 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: cde290e2-2d86-573e-94d1-ea49b94d51a8 due to rule: registration_date_old.json, error: 12 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    12
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002292492-01989901-003.pdf',
 'color': 'BRONZE',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'cde290e2-2d86-573e-94d1-ea49b94d51a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'GK13KJF',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VOLVO/V40?id=2292492',
 'listing': 'auction',
 'location': 'Manchester',
 'make': 'VOLVO',
 'model': 'V40',
 'odometer': 55439,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-30',
 'seller_name': 'LSH Auto Group',
 'title': 'VOLVO V40 D2 SE 5dr',
 'transmission': 'manual',
 'trim': 'D2 SE 5dr',
 'year': 2013}
2025-12-05 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272292492%27 HTTP/1.1" 200 None
2025-12-05 06:02:02 [manheim.gb] INFO: Saving data for 2292492: {'auction_closing_time': 1765270800.0, 'created_time': 1764792445.499163, 'last_price_update_time': 1764914522.43166}
2025-12-05 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2292492') HTTP/1.1" 204 0
2025-12-05 06:02:02 [manheim.gb] INFO: Found listing with ID: 2948457
2025-12-05 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272948457%27 HTTP/1.1" 200 None
2025-12-05 06:02:02 [manheim.gb] INFO: Scrape type for 2948457: 0
2025-12-05 06:02:02 [manheim.gb] INFO: Found listing with ID: 2968035
2025-12-05 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272968035%27 HTTP/1.1" 200 None
2025-12-05 06:02:02 [manheim.gb] INFO: Scrape type for 2968035: 2
2025-12-05 06:02:02 [manheim.gb] INFO: Found listing with ID: 2968609
2025-12-05 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272968609%27 HTTP/1.1" 200 None
2025-12-05 06:02:02 [manheim.gb] INFO: Scrape type for 2968609: 0
2025-12-05 06:02:02 [manheim.gb] INFO: Found listing with ID: 2976938
2025-12-05 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272976938%27 HTTP/1.1" 200 None
2025-12-05 06:02:02 [manheim.gb] INFO: Scrape type for 2976938: 2
2025-12-05 06:02:02 [manheim.gb] INFO: Found listing with ID: 2998686
2025-12-05 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272998686%27 HTTP/1.1" 200 None
2025-12-05 06:02:02 [manheim.gb] INFO: Scrape type for 2998686: 1
2025-12-05 06:02:02 [manheim.gb] INFO: Found listing with ID: 3004217
2025-12-05 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273004217%27 HTTP/1.1" 200 None
2025-12-05 06:02:02 [manheim.gb] INFO: Scrape type for 3004217: 2
2025-12-05 06:02:02 [manheim.gb] INFO: Found listing with ID: 3049627
2025-12-05 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273049627%27 HTTP/1.1" 200 None
2025-12-05 06:02:02 [manheim.gb] INFO: Scrape type for 3049627: 2
2025-12-05 06:02:02 [manheim.gb] INFO: Found listing with ID: 3052566
2025-12-05 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273052566%27 HTTP/1.1" 200 None
2025-12-05 06:02:02 [manheim.gb] INFO: Scrape type for 3052566: 0
2025-12-05 06:02:02 [manheim.gb] INFO: Found listing with ID: 3060716
2025-12-05 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273060716%27 HTTP/1.1" 200 None
2025-12-05 06:02:02 [manheim.gb] INFO: Scrape type for 3060716: 0
2025-12-05 06:02:02 [manheim.gb] INFO: Found listing with ID: 3066375
2025-12-05 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273066375%27 HTTP/1.1" 200 None
2025-12-05 06:02:02 [manheim.gb] INFO: Scrape type for 3066375: 2
2025-12-05 06:02:02 [manheim.gb] INFO: Found listing with ID: 3076903
2025-12-05 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273076903%27 HTTP/1.1" 200 None
2025-12-05 06:02:02 [manheim.gb] INFO: Scrape type for 3076903: 1
2025-12-05 06:02:02 [manheim.gb] INFO: Found listing with ID: 3107402
2025-12-05 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273107402%27 HTTP/1.1" 200 None
2025-12-05 06:02:02 [manheim.gb] INFO: Scrape type for 3107402: 2
2025-12-05 06:02:02 [manheim.gb] INFO: Found listing with ID: 3135542
2025-12-05 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273135542%27 HTTP/1.1" 200 None
2025-12-05 06:02:02 [manheim.gb] INFO: Scrape type for 3135542: 1
2025-12-05 06:02:02 [manheim.gb] INFO: Found listing with ID: 3161787
2025-12-05 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273161787%27 HTTP/1.1" 200 None
2025-12-05 06:02:02 [manheim.gb] INFO: Scrape type for 3161787: 2
2025-12-05 06:02:02 [manheim.gb] INFO: Found listing with ID: 3163606
2025-12-05 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273163606%27 HTTP/1.1" 200 None
2025-12-05 06:02:02 [manheim.gb] INFO: Scrape type for 3163606: 2
2025-12-05 06:02:02 [manheim.gb] INFO: Found listing with ID: 3167377
2025-12-05 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273167377%27 HTTP/1.1" 200 None
2025-12-05 06:02:02 [manheim.gb] INFO: Scrape type for 3167377: 2
2025-12-05 06:02:02 [manheim.gb] INFO: Found listing with ID: 3171741
2025-12-05 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273171741%27 HTTP/1.1" 200 None
2025-12-05 06:02:02 [manheim.gb] INFO: Scrape type for 3171741: 2
2025-12-05 06:02:02 [manheim.gb] INFO: Found listing with ID: 3174678
2025-12-05 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273174678%27 HTTP/1.1" 200 None
2025-12-05 06:02:02 [manheim.gb] INFO: Scrape type for 3174678: 2
2025-12-05 06:02:02 [manheim.gb] INFO: Found listing with ID: 3193354
2025-12-05 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273193354%27 HTTP/1.1" 200 None
2025-12-05 06:02:02 [manheim.gb] INFO: Scrape type for 3193354: 2
2025-12-05 06:02:02 [manheim.gb] INFO: Found listing with ID: 320240
2025-12-05 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27320240%27 HTTP/1.1" 200 None
2025-12-05 06:02:03 [manheim.gb] INFO: Scrape type for 320240: 0
2025-12-05 06:02:03 [manheim.gb] INFO: Found listing with ID: 3209297
2025-12-05 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273209297%27 HTTP/1.1" 200 None
2025-12-05 06:02:03 [manheim.gb] INFO: Scrape type for 3209297: 0
2025-12-05 06:02:03 [manheim.gb] INFO: Found listing with ID: 3210152
2025-12-05 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273210152%27 HTTP/1.1" 200 None
2025-12-05 06:02:03 [manheim.gb] INFO: Scrape type for 3210152: 2
2025-12-05 06:02:03 [manheim.gb] INFO: Found listing with ID: 3213348
2025-12-05 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273213348%27 HTTP/1.1" 200 None
2025-12-05 06:02:03 [manheim.gb] INFO: Scrape type for 3213348: 2
2025-12-05 06:02:03 [manheim.gb] INFO: Found listing with ID: 3227836
2025-12-05 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273227836%27 HTTP/1.1" 200 None
2025-12-05 06:02:03 [manheim.gb] INFO: Scrape type for 3227836: 2
2025-12-05 06:02:03 [manheim.gb] INFO: Found listing with ID: 3234444
2025-12-05 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273234444%27 HTTP/1.1" 200 None
2025-12-05 06:02:03 [manheim.gb] INFO: Scrape type for 3234444: 2
2025-12-05 06:02:03 [manheim.gb] INFO: Found listing with ID: 3243502
2025-12-05 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273243502%27 HTTP/1.1" 200 None
2025-12-05 06:02:03 [manheim.gb] INFO: Scrape type for 3243502: 2
2025-12-05 06:02:03 [manheim.gb] INFO: Found listing with ID: 3252975
2025-12-05 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273252975%27 HTTP/1.1" 200 None
2025-12-05 06:02:03 [manheim.gb] INFO: Scrape type for 3252975: 1
2025-12-05 06:02:03 [manheim.gb] INFO: Found listing with ID: 3256779
2025-12-05 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273256779%27 HTTP/1.1" 200 None
2025-12-05 06:02:03 [manheim.gb] INFO: Scrape type for 3256779: 1
2025-12-05 06:02:03 [manheim.gb] INFO: Found listing with ID: 3267329
2025-12-05 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273267329%27 HTTP/1.1" 200 None
2025-12-05 06:02:03 [manheim.gb] INFO: Scrape type for 3267329: 2
2025-12-05 06:02:03 [manheim.gb] INFO: Found listing with ID: 3272956
2025-12-05 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273272956%27 HTTP/1.1" 200 None
2025-12-05 06:02:03 [manheim.gb] INFO: Scrape type for 3272956: 2
2025-12-05 06:02:03 [manheim.gb] INFO: Found listing with ID: 3278878
2025-12-05 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273278878%27 HTTP/1.1" 200 None
2025-12-05 06:02:03 [manheim.gb] INFO: Scrape type for 3278878: 0
2025-12-05 06:02:03 [manheim.gb] INFO: Found listing with ID: 3288325
2025-12-05 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273288325%27 HTTP/1.1" 200 None
2025-12-05 06:02:03 [manheim.gb] INFO: Scrape type for 3288325: 2
2025-12-05 06:02:03 [manheim.gb] INFO: Found listing with ID: 3290272
2025-12-05 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273290272%27 HTTP/1.1" 200 None
2025-12-05 06:02:03 [manheim.gb] INFO: Scrape type for 3290272: 2
2025-12-05 06:02:03 [manheim.gb] INFO: Found listing with ID: 3292131
2025-12-05 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273292131%27 HTTP/1.1" 200 None
2025-12-05 06:02:03 [manheim.gb] INFO: Scrape type for 3292131: 2
2025-12-05 06:02:03 [manheim.gb] INFO: Found listing with ID: 3300121
2025-12-05 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273300121%27 HTTP/1.1" 200 None
2025-12-05 06:02:03 [manheim.gb] INFO: Scrape type for 3300121: 2
2025-12-05 06:02:03 [manheim.gb] INFO: Found listing with ID: 3303034
2025-12-05 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273303034%27 HTTP/1.1" 200 None
2025-12-05 06:02:03 [manheim.gb] INFO: Scrape type for 3303034: 2
2025-12-05 06:02:03 [manheim.gb] INFO: Found listing with ID: 3305810
2025-12-05 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273305810%27 HTTP/1.1" 200 None
2025-12-05 06:02:03 [manheim.gb] INFO: Scrape type for 3305810: 2
2025-12-05 06:02:03 [manheim.gb] INFO: Found listing with ID: 3318690
2025-12-05 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273318690%27 HTTP/1.1" 200 None
2025-12-05 06:02:03 [manheim.gb] INFO: Scrape type for 3318690: 2
2025-12-05 06:02:03 [manheim.gb] INFO: Found listing with ID: 3331358
2025-12-05 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273331358%27 HTTP/1.1" 200 None
2025-12-05 06:02:03 [manheim.gb] INFO: Scrape type for 3331358: 2
2025-12-05 06:02:03 [manheim.gb] INFO: Found listing with ID: 3333029
2025-12-05 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273333029%27 HTTP/1.1" 200 None
2025-12-05 06:02:03 [manheim.gb] INFO: Scrape type for 3333029: 2
2025-12-05 06:02:03 [manheim.gb] INFO: Found listing with ID: 3338885
2025-12-05 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273338885%27 HTTP/1.1" 200 None
2025-12-05 06:02:03 [manheim.gb] INFO: Scrape type for 3338885: 2
2025-12-05 06:02:03 [manheim.gb] INFO: Found listing with ID: 3342805
2025-12-05 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273342805%27 HTTP/1.1" 200 None
2025-12-05 06:02:03 [manheim.gb] INFO: Scrape type for 3342805: 0
2025-12-05 06:02:03 [manheim.gb] INFO: Found listing with ID: 334453
2025-12-05 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27334453%27 HTTP/1.1" 200 None
2025-12-05 06:02:03 [manheim.gb] INFO: Scrape type for 334453: 1
2025-12-05 06:02:03 [manheim.gb] INFO: Found listing with ID: 3346181
2025-12-05 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273346181%27 HTTP/1.1" 200 None
2025-12-05 06:02:03 [manheim.gb] INFO: Scrape type for 3346181: 1
2025-12-05 06:02:03 [manheim.gb] INFO: Found listing with ID: 3348750
2025-12-05 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273348750%27 HTTP/1.1" 200 None
2025-12-05 06:02:03 [manheim.gb] INFO: Scrape type for 3348750: 2
2025-12-05 06:02:03 [manheim.gb] INFO: Found listing with ID: 3352809
2025-12-05 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273352809%27 HTTP/1.1" 200 None
2025-12-05 06:02:03 [manheim.gb] INFO: Scrape type for 3352809: 2
2025-12-05 06:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/LAND%20ROVER/RANGEROVEREVOQUE?id=2316345&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232316345&indx=81> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:02:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:02:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5eaa6529-614d-5baa-a891-8bdb8d7ebb77 with identifier: 2316345
2025-12-05 06:02:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5eaa6529-614d-5baa-a891-8bdb8d7ebb77 with scrape type 2
2025-12-05 06:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5eaa6529-614d-5baa-a891-8bdb8d7ebb77 with scrape type 2
2025-12-05 06:02:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 5eaa6529-614d-5baa-a891-8bdb8d7ebb77, identifier: 2316345
2025-12-05 06:02:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 5eaa6529-614d-5baa-a891-8bdb8d7ebb77 with identifier: 2316345
2025-12-05 06:02:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 5eaa6529-614d-5baa-a891-8bdb8d7ebb77 with identifier: 2316345
2025-12-05 06:02:06 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 157189 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    157189
2025-12-05 06:02:06 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 5eaa6529-614d-5baa-a891-8bdb8d7ebb77 spider: manheim.gb
2025-12-05 06:02:06 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 5eaa6529-614d-5baa-a891-8bdb8d7ebb77 due to rule: high_mileage_for_country.json, error: 157189 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    157189
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002316345-01989419-002.pdf',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '5eaa6529-614d-5baa-a891-8bdb8d7ebb77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'BN17ZCT',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/LAND%20ROVER/RANGE%20ROVER%20EVOQUE?id=2316345',
 'listing': 'auction',
 'location': 'Manchester',
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER EVOQUE',
 'odometer': 97673,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-22',
 'seller_name': 'MotoNovo Finance',
 'title': 'LAND ROVER RANGE ROVER EVOQUE 2.0 eD4 SE Tech 5dr 2WD',
 'transmission': 'manual',
 'trim': '2.0 eD4 SE Tech 5dr 2WD',
 'year': 2017}
2025-12-05 06:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272316345%27 HTTP/1.1" 200 None
2025-12-05 06:02:06 [manheim.gb] INFO: Saving data for 2316345: {'auction_closing_time': 1765270800.0, 'created_time': 1764669859.912424, 'last_price_update_time': 1764914526.163009}
2025-12-05 06:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2316345') HTTP/1.1" 204 0
2025-12-05 06:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/FORD/FIESTA?id=2383831&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232383831&indx=86> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:02:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:02:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d03c6b00-faf3-55e8-baa0-a5ea066e6b18 with identifier: 2383831
2025-12-05 06:02:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d03c6b00-faf3-55e8-baa0-a5ea066e6b18 with scrape type 2
2025-12-05 06:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d03c6b00-faf3-55e8-baa0-a5ea066e6b18 with scrape type 2
2025-12-05 06:02:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: d03c6b00-faf3-55e8-baa0-a5ea066e6b18, identifier: 2383831
2025-12-05 06:02:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: d03c6b00-faf3-55e8-baa0-a5ea066e6b18 with identifier: 2383831
2025-12-05 06:02:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: d03c6b00-faf3-55e8-baa0-a5ea066e6b18 with identifier: 2383831
2025-12-05 06:02:06 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: d03c6b00-faf3-55e8-baa0-a5ea066e6b18 with identifier: 2383831 to the API
2025-12-05 06:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 06:02:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 06:02:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/FORD/FIESTA?id=2383831&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232383831&indx=86>
{'auction_title': '',
 'c_o_2_emission_value': 97,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002383831-01992409-001.pdf',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.0L',
 'expiration_date': '2025-12-10T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'd03c6b00-faf3-55e8-baa0-a5ea066e6b18',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'VN67PYF',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FORD/FIESTA?id=2383831',
 'listing': 'directbuy',
 'location': 'Plymouth',
 'make': 'FORD',
 'model': 'FIESTA',
 'odometer': 92705,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-09',
 'seller_name': 'Vospers Group',
 'title': 'FORD FIESTA 1.0 EcoBoost Titanium 5dr',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost Titanium 5dr',
 'year': 2018}
2025-12-05 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272383831%27 HTTP/1.1" 200 None
2025-12-05 06:02:08 [manheim.gb] INFO: Saving data for 2383831: {'auction_closing_time': 1765357200.0, 'created_time': 1764583891.38004, 'last_price_update_time': 1764914528.971429}
2025-12-05 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2383831') HTTP/1.1" 204 0
2025-12-05 06:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/ALFA%20ROMEO/GIULIA?id=2395632&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232395632&indx=89> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:02:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:02:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cff3433a-b298-5f4c-9a16-3ec38eb84ccc with identifier: 2395632
2025-12-05 06:02:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cff3433a-b298-5f4c-9a16-3ec38eb84ccc with scrape type 2
2025-12-05 06:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cff3433a-b298-5f4c-9a16-3ec38eb84ccc with scrape type 2
2025-12-05 06:02:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: cff3433a-b298-5f4c-9a16-3ec38eb84ccc, identifier: 2395632
2025-12-05 06:02:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: cff3433a-b298-5f4c-9a16-3ec38eb84ccc with identifier: 2395632
2025-12-05 06:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 06:02:11 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=SILVER HTTP/1.1" 200 None
2025-12-05 06:02:11 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 06:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 06:02:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: cff3433a-b298-5f4c-9a16-3ec38eb84ccc with identifier: 2395632
2025-12-05 06:02:11 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: cff3433a-b298-5f4c-9a16-3ec38eb84ccc with identifier: 2395632 to the API
2025-12-05 06:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 06:02:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 06:02:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/ALFA%20ROMEO/GIULIA?id=2395632&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232395632&indx=89>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002395632-01992854-002.pdf',
 'color': 'SILVER',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'cff3433a-b298-5f4c-9a16-3ec38eb84ccc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'MD18VEF',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/ALFA%20ROMEO/GIULIA?id=2395632',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'ALFA ROMEO',
 'model': 'GIULIA',
 'odometer': 54144,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-29',
 'seller_name': 'FCA Group',
 'title': 'ALFA ROMEO GIULIA 2.0 TB 280 Veloce 4dr Auto',
 'transmission': 'automatic',
 'trim': '2.0 TB 280 Veloce 4dr Auto',
 'year': 2018}
2025-12-05 06:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272395632%27 HTTP/1.1" 200 None
2025-12-05 06:02:11 [manheim.gb] INFO: Saving data for 2395632: {'auction_closing_time': 1765184400.0, 'created_time': 1764792162.470853, 'last_price_update_time': 1764914531.709435}
2025-12-05 06:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2395632') HTTP/1.1" 204 0
2025-12-05 06:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/AUDI/A3?id=24566&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%2324566&indx=98> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:02:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/FORD/FOCUS?id=2456004&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232456004&indx=97> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:02:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:02:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8180ded5-50e8-5729-b20a-a1d68523c708 with identifier: 24566
2025-12-05 06:02:23 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 8180ded5-50e8-5729-b20a-a1d68523c708
2025-12-05 06:02:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b53128c4-e05d-54e6-a7ad-dd80dd9160fe with identifier: 2456004
2025-12-05 06:02:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b53128c4-e05d-54e6-a7ad-dd80dd9160fe with scrape type 2
2025-12-05 06:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b53128c4-e05d-54e6-a7ad-dd80dd9160fe with scrape type 2
2025-12-05 06:02:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: b53128c4-e05d-54e6-a7ad-dd80dd9160fe, identifier: 2456004
2025-12-05 06:02:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: b53128c4-e05d-54e6-a7ad-dd80dd9160fe with identifier: 2456004
2025-12-05 06:02:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: b53128c4-e05d-54e6-a7ad-dd80dd9160fe with identifier: 2456004
2025-12-05 06:02:23 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: b53128c4-e05d-54e6-a7ad-dd80dd9160fe with identifier: 2456004 to the API
2025-12-05 06:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 06:02:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 06:02:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/FORD/FOCUS?id=2456004&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232456004&indx=97>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002456004-01989664-003.pdf',
 'color': 'SILVER',
 'currency': 'GBP',
 'engine': '1.0L',
 'expiration_date': '2025-12-05T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'b53128c4-e05d-54e6-a7ad-dd80dd9160fe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'WT19LFA',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FORD/FOCUS?id=2456004',
 'listing': 'auction',
 'location': 'Washington',
 'make': 'FORD',
 'model': 'FOCUS',
 'odometer': 40337,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-30',
 'seller_name': 'Available Car',
 'title': 'FORD FOCUS 1.0 EcoBoost 125 Titanium 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.0 EcoBoost 125 Titanium 5dr Auto',
 'year': 2019}
2025-12-05 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272456004%27 HTTP/1.1" 200 None
2025-12-05 06:02:24 [manheim.gb] INFO: Saving data for 2456004: {'auction_closing_time': 1764925200.0, 'created_time': 1764756156.073772, 'last_price_update_time': 1764914544.639658}
2025-12-05 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2456004') HTTP/1.1" 204 0
2025-12-05 06:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/ACLASS?id=2445301&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232445301&indx=94> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:02:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:02:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c00db30e-97d1-5780-baf0-2570c7931598 with identifier: 2445301
2025-12-05 06:02:26 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item c00db30e-97d1-5780-baf0-2570c7931598
2025-12-05 06:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0000024566-01989096-001.pdf> (referer: None)
2025-12-05 06:02:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:02:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234155f750>
2025-12-05 06:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:02:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8180ded5-50e8-5729-b20a-a1d68523c708/8180ded5-50e8-5729-b20a-a1d68523c708_expert_report_file_ad487fb0-bb6e-4ea5-94dd-f50e2815cef8.pdf HTTP/1.1" 201 0
2025-12-05 06:02:27 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 8180ded5-50e8-5729-b20a-a1d68523c708
2025-12-05 06:02:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8180ded5-50e8-5729-b20a-a1d68523c708, skipping ID generation
2025-12-05 06:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 8180ded5-50e8-5729-b20a-a1d68523c708
2025-12-05 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa5b754e0-60f8-4428-ac15-0e69e9f17ec1_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a5b754e0-60f8-4428-ac15-0e69e9f17ec1_ext_7.jpg not downloaded yet
2025-12-05 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa5b754e0-60f8-4428-ac15-0e69e9f17ec1_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a5b754e0-60f8-4428-ac15-0e69e9f17ec1_ext_7.jpg not downloaded yet
2025-12-05 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa5b754e0-60f8-4428-ac15-0e69e9f17ec1_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a5b754e0-60f8-4428-ac15-0e69e9f17ec1_ext_6.jpg not downloaded yet
2025-12-05 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa5b754e0-60f8-4428-ac15-0e69e9f17ec1_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a5b754e0-60f8-4428-ac15-0e69e9f17ec1_ext_1.jpg not downloaded yet
2025-12-05 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa5b754e0-60f8-4428-ac15-0e69e9f17ec1_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a5b754e0-60f8-4428-ac15-0e69e9f17ec1_5.jpg not downloaded yet
2025-12-05 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa5b754e0-60f8-4428-ac15-0e69e9f17ec1_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a5b754e0-60f8-4428-ac15-0e69e9f17ec1_4.jpg not downloaded yet
2025-12-05 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa5b754e0-60f8-4428-ac15-0e69e9f17ec1_11.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a5b754e0-60f8-4428-ac15-0e69e9f17ec1_11.jpg not downloaded yet
2025-12-05 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa5b754e0-60f8-4428-ac15-0e69e9f17ec1_10.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a5b754e0-60f8-4428-ac15-0e69e9f17ec1_10.jpg not downloaded yet
2025-12-05 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa5b754e0-60f8-4428-ac15-0e69e9f17ec1_9.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a5b754e0-60f8-4428-ac15-0e69e9f17ec1_9.jpg not downloaded yet
2025-12-05 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa5b754e0-60f8-4428-ac15-0e69e9f17ec1_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a5b754e0-60f8-4428-ac15-0e69e9f17ec1_ext_2.jpg not downloaded yet
2025-12-05 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa5b754e0-60f8-4428-ac15-0e69e9f17ec1_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a5b754e0-60f8-4428-ac15-0e69e9f17ec1_ext_5.jpg not downloaded yet
2025-12-05 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa5b754e0-60f8-4428-ac15-0e69e9f17ec1_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a5b754e0-60f8-4428-ac15-0e69e9f17ec1_ext_3.jpg not downloaded yet
2025-12-05 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa5b754e0-60f8-4428-ac15-0e69e9f17ec1_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a5b754e0-60f8-4428-ac15-0e69e9f17ec1_ext_4.jpg not downloaded yet
2025-12-05 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-24566-4008738-13.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-24566-4008738-13.jpg not downloaded yet
2025-12-05 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-24566-4008738-1000.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-24566-4008738-1000.jpg not downloaded yet
2025-12-05 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-24566-4008738-1001.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-24566-4008738-1001.jpg not downloaded yet
2025-12-05 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-24566-4008738-1002.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-24566-4008738-1002.jpg not downloaded yet
2025-12-05 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-24566-4008738-1003.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-24566-4008738-1003.jpg not downloaded yet
2025-12-05 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-24566-4008738-1004.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-24566-4008738-1004.jpg not downloaded yet
2025-12-05 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-24566-4008738-1005.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-24566-4008738-1005.jpg not downloaded yet
2025-12-05 06:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0002445301-01989097-003.pdf> (referer: None)
2025-12-05 06:02:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:02:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341583910>
2025-12-05 06:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:02:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c00db30e-97d1-5780-baf0-2570c7931598/c00db30e-97d1-5780-baf0-2570c7931598_expert_report_file_c43cc458-dc5c-4ed1-981b-03181de0cf9a.pdf HTTP/1.1" 201 0
2025-12-05 06:02:28 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item c00db30e-97d1-5780-baf0-2570c7931598
2025-12-05 06:02:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c00db30e-97d1-5780-baf0-2570c7931598, skipping ID generation
2025-12-05 06:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item c00db30e-97d1-5780-baf0-2570c7931598
2025-12-05 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F35d32ec0-02df-42bd-bed7-0390cc81834b_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/35d32ec0-02df-42bd-bed7-0390cc81834b_ext_7.jpg not downloaded yet
2025-12-05 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F35d32ec0-02df-42bd-bed7-0390cc81834b_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/35d32ec0-02df-42bd-bed7-0390cc81834b_ext_7.jpg not downloaded yet
2025-12-05 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F35d32ec0-02df-42bd-bed7-0390cc81834b_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/35d32ec0-02df-42bd-bed7-0390cc81834b_ext_6.jpg not downloaded yet
2025-12-05 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F35d32ec0-02df-42bd-bed7-0390cc81834b_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/35d32ec0-02df-42bd-bed7-0390cc81834b_ext_1.jpg not downloaded yet
2025-12-05 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F35d32ec0-02df-42bd-bed7-0390cc81834b_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/35d32ec0-02df-42bd-bed7-0390cc81834b_5.jpg not downloaded yet
2025-12-05 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F35d32ec0-02df-42bd-bed7-0390cc81834b_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/35d32ec0-02df-42bd-bed7-0390cc81834b_4.jpg not downloaded yet
2025-12-05 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F35d32ec0-02df-42bd-bed7-0390cc81834b_11.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/35d32ec0-02df-42bd-bed7-0390cc81834b_11.jpg not downloaded yet
2025-12-05 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F35d32ec0-02df-42bd-bed7-0390cc81834b_10.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/35d32ec0-02df-42bd-bed7-0390cc81834b_10.jpg not downloaded yet
2025-12-05 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F35d32ec0-02df-42bd-bed7-0390cc81834b_9.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/35d32ec0-02df-42bd-bed7-0390cc81834b_9.jpg not downloaded yet
2025-12-05 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F35d32ec0-02df-42bd-bed7-0390cc81834b_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/35d32ec0-02df-42bd-bed7-0390cc81834b_ext_2.jpg not downloaded yet
2025-12-05 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F35d32ec0-02df-42bd-bed7-0390cc81834b_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/35d32ec0-02df-42bd-bed7-0390cc81834b_ext_5.jpg not downloaded yet
2025-12-05 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F35d32ec0-02df-42bd-bed7-0390cc81834b_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/35d32ec0-02df-42bd-bed7-0390cc81834b_ext_3.jpg not downloaded yet
2025-12-05 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F35d32ec0-02df-42bd-bed7-0390cc81834b_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/35d32ec0-02df-42bd-bed7-0390cc81834b_ext_4.jpg not downloaded yet
2025-12-05 06:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-24566-4008738-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000024566-01989096-001.pdf)
2025-12-05 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2445301-4008912-13.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2445301-4008912-13.jpg not downloaded yet
2025-12-05 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2445301-4008912-1000.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2445301-4008912-1000.jpg not downloaded yet
2025-12-05 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2445301-4008912-1001.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2445301-4008912-1001.jpg not downloaded yet
2025-12-05 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2445301-4008912-1002.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2445301-4008912-1002.jpg not downloaded yet
2025-12-05 06:02:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:02:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23415a2e90>
2025-12-05 06:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:02:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8180ded5-50e8-5729-b20a-a1d68523c708/8180ded5-50e8-5729-b20a-a1d68523c708_image_19.jpg HTTP/1.1" 201 0
2025-12-05 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-24566-4008738-1005.jpg') HTTP/1.1" 204 0
2025-12-05 06:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-24566-4008738-1005.jpg saved to cache
2025-12-05 06:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 8180ded5-50e8-5729-b20a-a1d68523c708
2025-12-05 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2445301-4008912-1003.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2445301-4008912-1003.jpg not downloaded yet
2025-12-05 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2445301-4008912-1004.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2445301-4008912-1004.jpg not downloaded yet
2025-12-05 06:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/35d32ec0-02df-42bd-bed7-0390cc81834b_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002445301-01989097-003.pdf)
2025-12-05 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2445301-4008912-1005.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2445301-4008912-1005.jpg not downloaded yet
2025-12-05 06:02:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:02:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23415eab90>
2025-12-05 06:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:02:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c00db30e-97d1-5780-baf0-2570c7931598/c00db30e-97d1-5780-baf0-2570c7931598_image_12.jpg HTTP/1.1" 201 0
2025-12-05 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F35d32ec0-02df-42bd-bed7-0390cc81834b_ext_4.jpg') HTTP/1.1" 204 0
2025-12-05 06:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/35d32ec0-02df-42bd-bed7-0390cc81834b_ext_4.jpg saved to cache
2025-12-05 06:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item c00db30e-97d1-5780-baf0-2570c7931598
2025-12-05 06:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2445301-4008912-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002445301-01989097-003.pdf)
2025-12-05 06:02:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:02:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342562ad0>
2025-12-05 06:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:02:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c00db30e-97d1-5780-baf0-2570c7931598/c00db30e-97d1-5780-baf0-2570c7931598_image_18.jpg HTTP/1.1" 201 0
2025-12-05 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2445301-4008912-1004.jpg') HTTP/1.1" 204 0
2025-12-05 06:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2445301-4008912-1004.jpg saved to cache
2025-12-05 06:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item c00db30e-97d1-5780-baf0-2570c7931598
2025-12-05 06:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2445301-4008912-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002445301-01989097-003.pdf)
2025-12-05 06:02:29 [scrapy.extensions.logstats] INFO: Crawled 25 pages (at 22 pages/min), scraped 5 items (at 5 items/min)
2025-12-05 06:02:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:02:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23415c4910>
2025-12-05 06:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:02:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c00db30e-97d1-5780-baf0-2570c7931598/c00db30e-97d1-5780-baf0-2570c7931598_image_19.jpg HTTP/1.1" 201 0
2025-12-05 06:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2445301-4008912-1005.jpg') HTTP/1.1" 204 0
2025-12-05 06:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2445301-4008912-1005.jpg saved to cache
2025-12-05 06:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item c00db30e-97d1-5780-baf0-2570c7931598
2025-12-05 06:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2445301-4008912-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002445301-01989097-003.pdf)
2025-12-05 06:02:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:02:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23428e1590>
2025-12-05 06:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:02:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c00db30e-97d1-5780-baf0-2570c7931598/c00db30e-97d1-5780-baf0-2570c7931598_image_17.jpg HTTP/1.1" 201 0
2025-12-05 06:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2445301-4008912-1003.jpg') HTTP/1.1" 204 0
2025-12-05 06:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2445301-4008912-1003.jpg saved to cache
2025-12-05 06:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item c00db30e-97d1-5780-baf0-2570c7931598
2025-12-05 06:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/GOLF?id=2454963&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232454963&indx=96> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:02:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:02:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9eb1d05d-3c8a-51b8-b171-759c7da99902 with identifier: 2454963
2025-12-05 06:02:30 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 9eb1d05d-3c8a-51b8-b171-759c7da99902
2025-12-05 06:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2445301-4008912-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002445301-01989097-003.pdf)
2025-12-05 06:02:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:02:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341f26e90>
2025-12-05 06:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:02:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c00db30e-97d1-5780-baf0-2570c7931598/c00db30e-97d1-5780-baf0-2570c7931598_image_16.jpg HTTP/1.1" 201 0
2025-12-05 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2445301-4008912-1002.jpg') HTTP/1.1" 204 0
2025-12-05 06:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2445301-4008912-1002.jpg saved to cache
2025-12-05 06:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item c00db30e-97d1-5780-baf0-2570c7931598
2025-12-05 06:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2445301-4008912-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002445301-01989097-003.pdf)
2025-12-05 06:02:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:02:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425245d0>
2025-12-05 06:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:02:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c00db30e-97d1-5780-baf0-2570c7931598/c00db30e-97d1-5780-baf0-2570c7931598_image_15.jpg HTTP/1.1" 201 0
2025-12-05 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2445301-4008912-1001.jpg') HTTP/1.1" 204 0
2025-12-05 06:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2445301-4008912-1001.jpg saved to cache
2025-12-05 06:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item c00db30e-97d1-5780-baf0-2570c7931598
2025-12-05 06:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0002454963-01992219-004.pdf> (referer: None)
2025-12-05 06:02:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:02:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23415eb650>
2025-12-05 06:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:02:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9eb1d05d-3c8a-51b8-b171-759c7da99902/9eb1d05d-3c8a-51b8-b171-759c7da99902_expert_report_file_c2b95b72-bbd0-49c0-81ab-222026d05e08.pdf HTTP/1.1" 201 0
2025-12-05 06:02:32 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 9eb1d05d-3c8a-51b8-b171-759c7da99902
2025-12-05 06:02:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9eb1d05d-3c8a-51b8-b171-759c7da99902, skipping ID generation
2025-12-05 06:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 9eb1d05d-3c8a-51b8-b171-759c7da99902
2025-12-05 06:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fadae43d2-2b0d-4d47-844e-5ead2ca4f11c_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/adae43d2-2b0d-4d47-844e-5ead2ca4f11c_ext_7.jpg not downloaded yet
2025-12-05 06:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fadae43d2-2b0d-4d47-844e-5ead2ca4f11c_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/adae43d2-2b0d-4d47-844e-5ead2ca4f11c_ext_7.jpg not downloaded yet
2025-12-05 06:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/FIAT/500X?id=2408993&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232408993&indx=91> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fadae43d2-2b0d-4d47-844e-5ead2ca4f11c_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/adae43d2-2b0d-4d47-844e-5ead2ca4f11c_ext_6.jpg not downloaded yet
2025-12-05 06:02:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2445301-4008912-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002445301-01989097-003.pdf)
2025-12-05 06:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2445301-4008912-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002445301-01989097-003.pdf)
2025-12-05 06:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fadae43d2-2b0d-4d47-844e-5ead2ca4f11c_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/adae43d2-2b0d-4d47-844e-5ead2ca4f11c_ext_1.jpg not downloaded yet
2025-12-05 06:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fadae43d2-2b0d-4d47-844e-5ead2ca4f11c_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/adae43d2-2b0d-4d47-844e-5ead2ca4f11c_5.jpg not downloaded yet
2025-12-05 06:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fadae43d2-2b0d-4d47-844e-5ead2ca4f11c_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/adae43d2-2b0d-4d47-844e-5ead2ca4f11c_4.jpg not downloaded yet
2025-12-05 06:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fadae43d2-2b0d-4d47-844e-5ead2ca4f11c_11.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/adae43d2-2b0d-4d47-844e-5ead2ca4f11c_11.jpg not downloaded yet
2025-12-05 06:02:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827 with identifier: 2408993
2025-12-05 06:02:32 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827
2025-12-05 06:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fadae43d2-2b0d-4d47-844e-5ead2ca4f11c_10.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/adae43d2-2b0d-4d47-844e-5ead2ca4f11c_10.jpg not downloaded yet
2025-12-05 06:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fadae43d2-2b0d-4d47-844e-5ead2ca4f11c_9.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/adae43d2-2b0d-4d47-844e-5ead2ca4f11c_9.jpg not downloaded yet
2025-12-05 06:02:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:02:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23423a8b10>
2025-12-05 06:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:02:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c00db30e-97d1-5780-baf0-2570c7931598/c00db30e-97d1-5780-baf0-2570c7931598_image_13.jpg HTTP/1.1" 201 0
2025-12-05 06:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2445301-4008912-13.jpg') HTTP/1.1" 204 0
2025-12-05 06:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2445301-4008912-13.jpg saved to cache
2025-12-05 06:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item c00db30e-97d1-5780-baf0-2570c7931598
2025-12-05 06:02:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:02:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425f2750>
2025-12-05 06:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:02:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c00db30e-97d1-5780-baf0-2570c7931598/c00db30e-97d1-5780-baf0-2570c7931598_image_14.jpg HTTP/1.1" 201 0
2025-12-05 06:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2445301-4008912-1000.jpg') HTTP/1.1" 204 0
2025-12-05 06:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2445301-4008912-1000.jpg saved to cache
2025-12-05 06:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item c00db30e-97d1-5780-baf0-2570c7931598
2025-12-05 06:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fadae43d2-2b0d-4d47-844e-5ead2ca4f11c_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/adae43d2-2b0d-4d47-844e-5ead2ca4f11c_ext_2.jpg not downloaded yet
2025-12-05 06:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fadae43d2-2b0d-4d47-844e-5ead2ca4f11c_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/adae43d2-2b0d-4d47-844e-5ead2ca4f11c_ext_5.jpg not downloaded yet
2025-12-05 06:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/adae43d2-2b0d-4d47-844e-5ead2ca4f11c_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002454963-01992219-004.pdf)
2025-12-05 06:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fadae43d2-2b0d-4d47-844e-5ead2ca4f11c_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/adae43d2-2b0d-4d47-844e-5ead2ca4f11c_ext_3.jpg not downloaded yet
2025-12-05 06:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/adae43d2-2b0d-4d47-844e-5ead2ca4f11c_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002454963-01992219-004.pdf)
2025-12-05 06:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fadae43d2-2b0d-4d47-844e-5ead2ca4f11c_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/adae43d2-2b0d-4d47-844e-5ead2ca4f11c_ext_4.jpg not downloaded yet
2025-12-05 06:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/adae43d2-2b0d-4d47-844e-5ead2ca4f11c_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002454963-01992219-004.pdf)
2025-12-05 06:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2454963-4008560-13.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2454963-4008560-13.jpg not downloaded yet
2025-12-05 06:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2454963-4008560-1000.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2454963-4008560-1000.jpg not downloaded yet
2025-12-05 06:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2454963-4008560-1001.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2454963-4008560-1001.jpg not downloaded yet
2025-12-05 06:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2454963-4008560-1002.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2454963-4008560-1002.jpg not downloaded yet
2025-12-05 06:02:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:02:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341f00490>
2025-12-05 06:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:02:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9eb1d05d-3c8a-51b8-b171-759c7da99902/9eb1d05d-3c8a-51b8-b171-759c7da99902_image_1.jpg HTTP/1.1" 201 0
2025-12-05 06:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fadae43d2-2b0d-4d47-844e-5ead2ca4f11c_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 06:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/adae43d2-2b0d-4d47-844e-5ead2ca4f11c_ext_7.jpg saved to cache
2025-12-05 06:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9eb1d05d-3c8a-51b8-b171-759c7da99902
2025-12-05 06:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2454963-4008560-1003.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2454963-4008560-1003.jpg not downloaded yet
2025-12-05 06:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/AUDI/Q5?id=2407950&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232407950&indx=90> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:02:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:02:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342343410>
2025-12-05 06:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:02:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9eb1d05d-3c8a-51b8-b171-759c7da99902/9eb1d05d-3c8a-51b8-b171-759c7da99902_image_2.jpg HTTP/1.1" 201 0
2025-12-05 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fadae43d2-2b0d-4d47-844e-5ead2ca4f11c_ext_6.jpg') HTTP/1.1" 204 0
2025-12-05 06:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/adae43d2-2b0d-4d47-844e-5ead2ca4f11c_ext_6.jpg saved to cache
2025-12-05 06:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9eb1d05d-3c8a-51b8-b171-759c7da99902
2025-12-05 06:02:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:02:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23424adf90>
2025-12-05 06:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:02:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9eb1d05d-3c8a-51b8-b171-759c7da99902/9eb1d05d-3c8a-51b8-b171-759c7da99902_image_0.jpg HTTP/1.1" 201 0
2025-12-05 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fadae43d2-2b0d-4d47-844e-5ead2ca4f11c_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 06:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/adae43d2-2b0d-4d47-844e-5ead2ca4f11c_ext_7.jpg saved to cache
2025-12-05 06:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9eb1d05d-3c8a-51b8-b171-759c7da99902
2025-12-05 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2454963-4008560-1004.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2454963-4008560-1004.jpg not downloaded yet
2025-12-05 06:02:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/adae43d2-2b0d-4d47-844e-5ead2ca4f11c_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002454963-01992219-004.pdf)
2025-12-05 06:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/adae43d2-2b0d-4d47-844e-5ead2ca4f11c_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002454963-01992219-004.pdf)
2025-12-05 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2454963-4008560-1005.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2454963-4008560-1005.jpg not downloaded yet
2025-12-05 06:02:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c7b23d3-2d65-54db-9f4c-4b1609f74249 with identifier: 2407950
2025-12-05 06:02:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c7b23d3-2d65-54db-9f4c-4b1609f74249 with scrape type 2
2025-12-05 06:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c7b23d3-2d65-54db-9f4c-4b1609f74249 with scrape type 2
2025-12-05 06:02:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 9c7b23d3-2d65-54db-9f4c-4b1609f74249, identifier: 2407950
2025-12-05 06:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/adae43d2-2b0d-4d47-844e-5ead2ca4f11c_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002454963-01992219-004.pdf)
2025-12-05 06:02:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 9c7b23d3-2d65-54db-9f4c-4b1609f74249 with identifier: 2407950
2025-12-05 06:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 06:02:34 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Grey HTTP/1.1" 200 None
2025-12-05 06:02:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 06:02:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 9c7b23d3-2d65-54db-9f4c-4b1609f74249 with identifier: 2407950
2025-12-05 06:02:35 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 9c7b23d3-2d65-54db-9f4c-4b1609f74249 with identifier: 2407950 to the API
2025-12-05 06:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 06:02:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 06:02:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/AUDI/Q5?id=2407950&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232407950&indx=90>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002407950-01986793-003.pdf',
 'color': 'Grey',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '9c7b23d3-2d65-54db-9f4c-4b1609f74249',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'RE17ZXN',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/AUDI/Q5?id=2407950',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'AUDI',
 'model': 'Q5',
 'odometer': 66754,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-15',
 'seller_name': 'Lookers',
 'title': 'AUDI Q5 2.0T FSI Quattro S Line 5dr S Tronic',
 'transmission': 'automatic',
 'trim': '2.0T FSI Quattro S Line 5dr S Tronic',
 'year': 2017}
2025-12-05 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272407950%27 HTTP/1.1" 200 None
2025-12-05 06:02:35 [manheim.gb] INFO: Saving data for 2407950: {'auction_closing_time': 1765270800.0, 'created_time': 1764669772.727267, 'last_price_update_time': 1764914555.937575}
2025-12-05 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2407950') HTTP/1.1" 204 0
2025-12-05 06:02:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:02:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425d4910>
2025-12-05 06:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:02:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9eb1d05d-3c8a-51b8-b171-759c7da99902/9eb1d05d-3c8a-51b8-b171-759c7da99902_image_10.jpg HTTP/1.1" 201 0
2025-12-05 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fadae43d2-2b0d-4d47-844e-5ead2ca4f11c_ext_5.jpg') HTTP/1.1" 204 0
2025-12-05 06:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/adae43d2-2b0d-4d47-844e-5ead2ca4f11c_ext_5.jpg saved to cache
2025-12-05 06:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 9eb1d05d-3c8a-51b8-b171-759c7da99902
2025-12-05 06:02:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:02:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425b08d0>
2025-12-05 06:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:02:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9eb1d05d-3c8a-51b8-b171-759c7da99902/9eb1d05d-3c8a-51b8-b171-759c7da99902_image_11.jpg HTTP/1.1" 201 0
2025-12-05 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fadae43d2-2b0d-4d47-844e-5ead2ca4f11c_ext_3.jpg') HTTP/1.1" 204 0
2025-12-05 06:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/adae43d2-2b0d-4d47-844e-5ead2ca4f11c_ext_3.jpg saved to cache
2025-12-05 06:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 9eb1d05d-3c8a-51b8-b171-759c7da99902
2025-12-05 06:02:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:02:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341589f50>
2025-12-05 06:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:02:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9eb1d05d-3c8a-51b8-b171-759c7da99902/9eb1d05d-3c8a-51b8-b171-759c7da99902_image_9.jpg HTTP/1.1" 201 0
2025-12-05 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fadae43d2-2b0d-4d47-844e-5ead2ca4f11c_ext_2.jpg') HTTP/1.1" 204 0
2025-12-05 06:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/adae43d2-2b0d-4d47-844e-5ead2ca4f11c_ext_2.jpg saved to cache
2025-12-05 06:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9eb1d05d-3c8a-51b8-b171-759c7da99902
2025-12-05 06:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2454963-4008560-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002454963-01992219-004.pdf)
2025-12-05 06:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2454963-4008560-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002454963-01992219-004.pdf)
2025-12-05 06:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VAUXHALL/CORSA?id=2528639&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232528639&indx=103> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:02:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2454963-4008560-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002454963-01992219-004.pdf)
2025-12-05 06:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2454963-4008560-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002454963-01992219-004.pdf)
2025-12-05 06:02:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:02:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425ebd90>
2025-12-05 06:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:02:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9eb1d05d-3c8a-51b8-b171-759c7da99902/9eb1d05d-3c8a-51b8-b171-759c7da99902_image_18.jpg HTTP/1.1" 201 0
2025-12-05 06:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2454963-4008560-1004.jpg') HTTP/1.1" 204 0
2025-12-05 06:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2454963-4008560-1004.jpg saved to cache
2025-12-05 06:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 9eb1d05d-3c8a-51b8-b171-759c7da99902
2025-12-05 06:02:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:02:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425f0110>
2025-12-05 06:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:02:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9eb1d05d-3c8a-51b8-b171-759c7da99902/9eb1d05d-3c8a-51b8-b171-759c7da99902_image_16.jpg HTTP/1.1" 201 0
2025-12-05 06:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2454963-4008560-1002.jpg') HTTP/1.1" 204 0
2025-12-05 06:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2454963-4008560-1002.jpg saved to cache
2025-12-05 06:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 9eb1d05d-3c8a-51b8-b171-759c7da99902
2025-12-05 06:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2454963-4008560-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002454963-01992219-004.pdf)
2025-12-05 06:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/adae43d2-2b0d-4d47-844e-5ead2ca4f11c_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002454963-01992219-004.pdf)
2025-12-05 06:02:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a0a6fd2-fb60-5b78-93a9-68ac472b1511 with identifier: 2528639
2025-12-05 06:02:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a0a6fd2-fb60-5b78-93a9-68ac472b1511 with scrape type 2
2025-12-05 06:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a0a6fd2-fb60-5b78-93a9-68ac472b1511 with scrape type 2
2025-12-05 06:02:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 8a0a6fd2-fb60-5b78-93a9-68ac472b1511, identifier: 2528639
2025-12-05 06:02:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:02:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234487c910>
2025-12-05 06:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:02:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9eb1d05d-3c8a-51b8-b171-759c7da99902/9eb1d05d-3c8a-51b8-b171-759c7da99902_image_19.jpg HTTP/1.1" 201 0
2025-12-05 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2454963-4008560-1005.jpg') HTTP/1.1" 204 0
2025-12-05 06:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2454963-4008560-1005.jpg saved to cache
2025-12-05 06:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 9eb1d05d-3c8a-51b8-b171-759c7da99902
2025-12-05 06:02:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:02:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23424eb0d0>
2025-12-05 06:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:02:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9eb1d05d-3c8a-51b8-b171-759c7da99902/9eb1d05d-3c8a-51b8-b171-759c7da99902_image_17.jpg HTTP/1.1" 201 0
2025-12-05 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2454963-4008560-1003.jpg') HTTP/1.1" 204 0
2025-12-05 06:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2454963-4008560-1003.jpg saved to cache
2025-12-05 06:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 9eb1d05d-3c8a-51b8-b171-759c7da99902
2025-12-05 06:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2454963-4008560-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002454963-01992219-004.pdf)
2025-12-05 06:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2454963-4008560-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002454963-01992219-004.pdf)
2025-12-05 06:02:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 8a0a6fd2-fb60-5b78-93a9-68ac472b1511 with identifier: 2528639
2025-12-05 06:02:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 8a0a6fd2-fb60-5b78-93a9-68ac472b1511 with identifier: 2528639
2025-12-05 06:02:38 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 12 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    12
2025-12-05 06:02:38 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: 8a0a6fd2-fb60-5b78-93a9-68ac472b1511 spider: manheim.gb
2025-12-05 06:02:38 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 8a0a6fd2-fb60-5b78-93a9-68ac472b1511 due to rule: registration_date_old.json, error: 12 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    12
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002528639-01982955-002.pdf',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '1.0L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '8a0a6fd2-fb60-5b78-93a9-68ac472b1511',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'SH13AXV',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VAUXHALL/CORSA?id=2528639',
 'listing': 'auction',
 'location': 'Leeds',
 'make': 'VAUXHALL',
 'model': 'CORSA',
 'odometer': 91300,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-30',
 'seller_name': 'Lookers',
 'title': 'VAUXHALL CORSA 1.0 ecoFLEX S 3dr',
 'transmission': 'manual',
 'trim': '1.0 ecoFLEX S 3dr',
 'year': 2013}
2025-12-05 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272528639%27 HTTP/1.1" 200 None
2025-12-05 06:02:38 [manheim.gb] INFO: Saving data for 2528639: {'auction_closing_time': 1765184400.0, 'created_time': 1764792587.29961, 'last_price_update_time': 1764914558.577183}
2025-12-05 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2528639') HTTP/1.1" 204 0
2025-12-05 06:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/adae43d2-2b0d-4d47-844e-5ead2ca4f11c_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002454963-01992219-004.pdf)
2025-12-05 06:02:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:02:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234244dc90>
2025-12-05 06:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:02:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9eb1d05d-3c8a-51b8-b171-759c7da99902/9eb1d05d-3c8a-51b8-b171-759c7da99902_image_14.jpg HTTP/1.1" 201 0
2025-12-05 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2454963-4008560-1000.jpg') HTTP/1.1" 204 0
2025-12-05 06:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2454963-4008560-1000.jpg saved to cache
2025-12-05 06:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 9eb1d05d-3c8a-51b8-b171-759c7da99902
2025-12-05 06:02:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:02:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342598d10>
2025-12-05 06:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:02:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9eb1d05d-3c8a-51b8-b171-759c7da99902/9eb1d05d-3c8a-51b8-b171-759c7da99902_image_8.jpg HTTP/1.1" 201 0
2025-12-05 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fadae43d2-2b0d-4d47-844e-5ead2ca4f11c_9.jpg') HTTP/1.1" 204 0
2025-12-05 06:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/adae43d2-2b0d-4d47-844e-5ead2ca4f11c_9.jpg saved to cache
2025-12-05 06:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9eb1d05d-3c8a-51b8-b171-759c7da99902
2025-12-05 06:02:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:02:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425a0d10>
2025-12-05 06:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:02:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9eb1d05d-3c8a-51b8-b171-759c7da99902/9eb1d05d-3c8a-51b8-b171-759c7da99902_image_13.jpg HTTP/1.1" 201 0
2025-12-05 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2454963-4008560-13.jpg') HTTP/1.1" 204 0
2025-12-05 06:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2454963-4008560-13.jpg saved to cache
2025-12-05 06:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 9eb1d05d-3c8a-51b8-b171-759c7da99902
2025-12-05 06:02:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:02:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342599d10>
2025-12-05 06:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:02:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9eb1d05d-3c8a-51b8-b171-759c7da99902/9eb1d05d-3c8a-51b8-b171-759c7da99902_image_15.jpg HTTP/1.1" 201 0
2025-12-05 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2454963-4008560-1001.jpg') HTTP/1.1" 204 0
2025-12-05 06:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2454963-4008560-1001.jpg saved to cache
2025-12-05 06:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 9eb1d05d-3c8a-51b8-b171-759c7da99902
2025-12-05 06:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/adae43d2-2b0d-4d47-844e-5ead2ca4f11c_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002454963-01992219-004.pdf)
2025-12-05 06:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/refine> (referer: https://www.manheim.co.uk/search) ['zyte-api']
2025-12-05 06:02:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/adae43d2-2b0d-4d47-844e-5ead2ca4f11c_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002454963-01992219-004.pdf)
2025-12-05 06:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/adae43d2-2b0d-4d47-844e-5ead2ca4f11c_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002454963-01992219-004.pdf)
2025-12-05 06:02:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:02:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341567710>
2025-12-05 06:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:02:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9eb1d05d-3c8a-51b8-b171-759c7da99902/9eb1d05d-3c8a-51b8-b171-759c7da99902_image_12.jpg HTTP/1.1" 201 0
2025-12-05 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fadae43d2-2b0d-4d47-844e-5ead2ca4f11c_ext_4.jpg') HTTP/1.1" 204 0
2025-12-05 06:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/adae43d2-2b0d-4d47-844e-5ead2ca4f11c_ext_4.jpg saved to cache
2025-12-05 06:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 9eb1d05d-3c8a-51b8-b171-759c7da99902
2025-12-05 06:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/adae43d2-2b0d-4d47-844e-5ead2ca4f11c_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002454963-01992219-004.pdf)
2025-12-05 06:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/adae43d2-2b0d-4d47-844e-5ead2ca4f11c_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002454963-01992219-004.pdf)
2025-12-05 06:02:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:02:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234243d250>
2025-12-05 06:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:02:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9eb1d05d-3c8a-51b8-b171-759c7da99902/9eb1d05d-3c8a-51b8-b171-759c7da99902_image_7.jpg HTTP/1.1" 201 0
2025-12-05 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fadae43d2-2b0d-4d47-844e-5ead2ca4f11c_10.jpg') HTTP/1.1" 204 0
2025-12-05 06:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/adae43d2-2b0d-4d47-844e-5ead2ca4f11c_10.jpg saved to cache
2025-12-05 06:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9eb1d05d-3c8a-51b8-b171-759c7da99902
2025-12-05 06:02:40 [manheim.gb] INFO: Found listing with ID: 3356576
2025-12-05 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273356576%27 HTTP/1.1" 200 None
2025-12-05 06:02:40 [manheim.gb] INFO: Scrape type for 3356576: 2
2025-12-05 06:02:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:02:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234278e650>
2025-12-05 06:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:02:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 06:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9eb1d05d-3c8a-51b8-b171-759c7da99902/9eb1d05d-3c8a-51b8-b171-759c7da99902_image_5.jpg HTTP/1.1" 201 0
2025-12-05 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fadae43d2-2b0d-4d47-844e-5ead2ca4f11c_4.jpg') HTTP/1.1" 204 0
2025-12-05 06:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/adae43d2-2b0d-4d47-844e-5ead2ca4f11c_4.jpg saved to cache
2025-12-05 06:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9eb1d05d-3c8a-51b8-b171-759c7da99902
2025-12-05 06:02:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:02:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342776a10>
2025-12-05 06:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:02:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9eb1d05d-3c8a-51b8-b171-759c7da99902/9eb1d05d-3c8a-51b8-b171-759c7da99902_image_6.jpg HTTP/1.1" 201 0
2025-12-05 06:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fadae43d2-2b0d-4d47-844e-5ead2ca4f11c_11.jpg') HTTP/1.1" 204 0
2025-12-05 06:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/adae43d2-2b0d-4d47-844e-5ead2ca4f11c_11.jpg saved to cache
2025-12-05 06:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9eb1d05d-3c8a-51b8-b171-759c7da99902
2025-12-05 06:02:41 [manheim.gb] INFO: Found listing with ID: 3358545
2025-12-05 06:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273358545%27 HTTP/1.1" 200 None
2025-12-05 06:02:41 [manheim.gb] INFO: Scrape type for 3358545: 2
2025-12-05 06:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/35d32ec0-02df-42bd-bed7-0390cc81834b_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002445301-01989097-003.pdf)
2025-12-05 06:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/35d32ec0-02df-42bd-bed7-0390cc81834b_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002445301-01989097-003.pdf)
2025-12-05 06:02:41 [manheim.gb] INFO: Found listing with ID: 3366127
2025-12-05 06:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273366127%27 HTTP/1.1" 200 None
2025-12-05 06:02:41 [manheim.gb] INFO: Scrape type for 3366127: 2
2025-12-05 06:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/35d32ec0-02df-42bd-bed7-0390cc81834b_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002445301-01989097-003.pdf)
2025-12-05 06:02:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:02:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425b1e10>
2025-12-05 06:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:02:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9eb1d05d-3c8a-51b8-b171-759c7da99902/9eb1d05d-3c8a-51b8-b171-759c7da99902_image_4.jpg HTTP/1.1" 201 0
2025-12-05 06:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fadae43d2-2b0d-4d47-844e-5ead2ca4f11c_5.jpg') HTTP/1.1" 204 0
2025-12-05 06:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/adae43d2-2b0d-4d47-844e-5ead2ca4f11c_5.jpg saved to cache
2025-12-05 06:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9eb1d05d-3c8a-51b8-b171-759c7da99902
2025-12-05 06:02:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:02:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234279e250>
2025-12-05 06:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:02:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9eb1d05d-3c8a-51b8-b171-759c7da99902/9eb1d05d-3c8a-51b8-b171-759c7da99902_image_3.jpg HTTP/1.1" 201 0
2025-12-05 06:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fadae43d2-2b0d-4d47-844e-5ead2ca4f11c_ext_1.jpg') HTTP/1.1" 204 0
2025-12-05 06:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/adae43d2-2b0d-4d47-844e-5ead2ca4f11c_ext_1.jpg saved to cache
2025-12-05 06:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9eb1d05d-3c8a-51b8-b171-759c7da99902
2025-12-05 06:02:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9eb1d05d-3c8a-51b8-b171-759c7da99902, skipping ID generation
2025-12-05 06:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 9eb1d05d-3c8a-51b8-b171-759c7da99902 from tracking dictionaries
2025-12-05 06:02:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9eb1d05d-3c8a-51b8-b171-759c7da99902 sending to next pipeline
2025-12-05 06:02:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 9eb1d05d-3c8a-51b8-b171-759c7da99902, identifier: 2454963
2025-12-05 06:02:41 [manheim.gb] INFO: Found listing with ID: 3367434
2025-12-05 06:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273367434%27 HTTP/1.1" 200 None
2025-12-05 06:02:41 [manheim.gb] INFO: Scrape type for 3367434: 0
2025-12-05 06:02:41 [manheim.gb] INFO: Found listing with ID: 3367441
2025-12-05 06:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273367441%27 HTTP/1.1" 200 None
2025-12-05 06:02:41 [manheim.gb] INFO: Scrape type for 3367441: 0
2025-12-05 06:02:41 [manheim.gb] INFO: Found listing with ID: 3368334
2025-12-05 06:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273368334%27 HTTP/1.1" 200 None
2025-12-05 06:02:41 [manheim.gb] INFO: Scrape type for 3368334: 2
2025-12-05 06:02:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 9eb1d05d-3c8a-51b8-b171-759c7da99902 with identifier: 2454963
2025-12-05 06:02:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 9eb1d05d-3c8a-51b8-b171-759c7da99902 with identifier: 2454963
2025-12-05 06:02:42 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 150685 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    150685
2025-12-05 06:02:42 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 9eb1d05d-3c8a-51b8-b171-759c7da99902 spider: manheim.gb
2025-12-05 06:02:42 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 9eb1d05d-3c8a-51b8-b171-759c7da99902 due to rule: high_mileage_for_country.json, error: 150685 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    150685
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eb1d05d-3c8a-51b8-b171-759c7da99902/9eb1d05d-3c8a-51b8-b171-759c7da99902_expert_report_file_c2b95b72-bbd0-49c0-81ab-222026d05e08.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002454963-01992219-004.pdf',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.4L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '9eb1d05d-3c8a-51b8-b171-759c7da99902',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'BG59DPN',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/GOLF?id=2454963',
 'listing': 'auction',
 'location': 'Northampton',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF',
 'odometer': 93632,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 32,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eb1d05d-3c8a-51b8-b171-759c7da99902/9eb1d05d-3c8a-51b8-b171-759c7da99902_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 229297,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/adae43d2-2b0d-4d47-844e-5ead2ca4f11c_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eb1d05d-3c8a-51b8-b171-759c7da99902/9eb1d05d-3c8a-51b8-b171-759c7da99902_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 229297,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/adae43d2-2b0d-4d47-844e-5ead2ca4f11c_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eb1d05d-3c8a-51b8-b171-759c7da99902/9eb1d05d-3c8a-51b8-b171-759c7da99902_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 263450,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/adae43d2-2b0d-4d47-844e-5ead2ca4f11c_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eb1d05d-3c8a-51b8-b171-759c7da99902/9eb1d05d-3c8a-51b8-b171-759c7da99902_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 208224,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/adae43d2-2b0d-4d47-844e-5ead2ca4f11c_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eb1d05d-3c8a-51b8-b171-759c7da99902/9eb1d05d-3c8a-51b8-b171-759c7da99902_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 207572,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/adae43d2-2b0d-4d47-844e-5ead2ca4f11c_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eb1d05d-3c8a-51b8-b171-759c7da99902/9eb1d05d-3c8a-51b8-b171-759c7da99902_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 206282,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/adae43d2-2b0d-4d47-844e-5ead2ca4f11c_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eb1d05d-3c8a-51b8-b171-759c7da99902/9eb1d05d-3c8a-51b8-b171-759c7da99902_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 219700,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/adae43d2-2b0d-4d47-844e-5ead2ca4f11c_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eb1d05d-3c8a-51b8-b171-759c7da99902/9eb1d05d-3c8a-51b8-b171-759c7da99902_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 211826,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/adae43d2-2b0d-4d47-844e-5ead2ca4f11c_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eb1d05d-3c8a-51b8-b171-759c7da99902/9eb1d05d-3c8a-51b8-b171-759c7da99902_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 221830,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/adae43d2-2b0d-4d47-844e-5ead2ca4f11c_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eb1d05d-3c8a-51b8-b171-759c7da99902/9eb1d05d-3c8a-51b8-b171-759c7da99902_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 295287,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/adae43d2-2b0d-4d47-844e-5ead2ca4f11c_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eb1d05d-3c8a-51b8-b171-759c7da99902/9eb1d05d-3c8a-51b8-b171-759c7da99902_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 248839,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/adae43d2-2b0d-4d47-844e-5ead2ca4f11c_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eb1d05d-3c8a-51b8-b171-759c7da99902/9eb1d05d-3c8a-51b8-b171-759c7da99902_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 249403,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/adae43d2-2b0d-4d47-844e-5ead2ca4f11c_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eb1d05d-3c8a-51b8-b171-759c7da99902/9eb1d05d-3c8a-51b8-b171-759c7da99902_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 296825,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/adae43d2-2b0d-4d47-844e-5ead2ca4f11c_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eb1d05d-3c8a-51b8-b171-759c7da99902/9eb1d05d-3c8a-51b8-b171-759c7da99902_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 282519,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2454963-4008560-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eb1d05d-3c8a-51b8-b171-759c7da99902/9eb1d05d-3c8a-51b8-b171-759c7da99902_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 156520,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2454963-4008560-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eb1d05d-3c8a-51b8-b171-759c7da99902/9eb1d05d-3c8a-51b8-b171-759c7da99902_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 318574,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2454963-4008560-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eb1d05d-3c8a-51b8-b171-759c7da99902/9eb1d05d-3c8a-51b8-b171-759c7da99902_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 277252,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2454963-4008560-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eb1d05d-3c8a-51b8-b171-759c7da99902/9eb1d05d-3c8a-51b8-b171-759c7da99902_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 284586,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2454963-4008560-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eb1d05d-3c8a-51b8-b171-759c7da99902/9eb1d05d-3c8a-51b8-b171-759c7da99902_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 311680,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2454963-4008560-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eb1d05d-3c8a-51b8-b171-759c7da99902/9eb1d05d-3c8a-51b8-b171-759c7da99902_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 248460,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2454963-4008560-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-10-31',
 'seller_name': 'Perrys',
 'title': 'VOLKSWAGEN GOLF 1.4 TSI SE 5dr',
 'transmission': 'manual',
 'trim': '1.4 TSI SE 5dr',
 'year': 2009}
2025-12-05 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272454963%27 HTTP/1.1" 200 None
2025-12-05 06:02:42 [manheim.gb] INFO: Saving data for 2454963: {'created_time': 1764914562.519079, 'last_price_update_time': 1764914562.519098, 'auction_closing_time': 1765270800.0}
2025-12-05 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2454963') HTTP/1.1" 204 0
2025-12-05 06:02:42 [manheim.gb] INFO: Found listing with ID: 3375071
2025-12-05 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273375071%27 HTTP/1.1" 200 None
2025-12-05 06:02:42 [manheim.gb] INFO: Scrape type for 3375071: 1
2025-12-05 06:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/35d32ec0-02df-42bd-bed7-0390cc81834b_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002445301-01989097-003.pdf)
2025-12-05 06:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/35d32ec0-02df-42bd-bed7-0390cc81834b_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002445301-01989097-003.pdf)
2025-12-05 06:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/35d32ec0-02df-42bd-bed7-0390cc81834b_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002445301-01989097-003.pdf)
2025-12-05 06:02:42 [manheim.gb] INFO: Found listing with ID: 3376327
2025-12-05 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273376327%27 HTTP/1.1" 200 None
2025-12-05 06:02:42 [manheim.gb] INFO: Scrape type for 3376327: 2
2025-12-05 06:02:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:02:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234253f5d0>
2025-12-05 06:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:02:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c00db30e-97d1-5780-baf0-2570c7931598/c00db30e-97d1-5780-baf0-2570c7931598_image_11.jpg HTTP/1.1" 201 0
2025-12-05 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F35d32ec0-02df-42bd-bed7-0390cc81834b_ext_3.jpg') HTTP/1.1" 204 0
2025-12-05 06:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/35d32ec0-02df-42bd-bed7-0390cc81834b_ext_3.jpg saved to cache
2025-12-05 06:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item c00db30e-97d1-5780-baf0-2570c7931598
2025-12-05 06:02:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:02:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341566d10>
2025-12-05 06:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:02:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 06:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c00db30e-97d1-5780-baf0-2570c7931598/c00db30e-97d1-5780-baf0-2570c7931598_image_10.jpg HTTP/1.1" 201 0
2025-12-05 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F35d32ec0-02df-42bd-bed7-0390cc81834b_ext_5.jpg') HTTP/1.1" 204 0
2025-12-05 06:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/35d32ec0-02df-42bd-bed7-0390cc81834b_ext_5.jpg saved to cache
2025-12-05 06:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item c00db30e-97d1-5780-baf0-2570c7931598
2025-12-05 06:02:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:02:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425c7cd0>
2025-12-05 06:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:02:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c00db30e-97d1-5780-baf0-2570c7931598/c00db30e-97d1-5780-baf0-2570c7931598_image_9.jpg HTTP/1.1" 201 0
2025-12-05 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F35d32ec0-02df-42bd-bed7-0390cc81834b_ext_2.jpg') HTTP/1.1" 204 0
2025-12-05 06:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/35d32ec0-02df-42bd-bed7-0390cc81834b_ext_2.jpg saved to cache
2025-12-05 06:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c00db30e-97d1-5780-baf0-2570c7931598
2025-12-05 06:02:43 [manheim.gb] INFO: Found listing with ID: 3377309
2025-12-05 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273377309%27 HTTP/1.1" 200 None
2025-12-05 06:02:43 [manheim.gb] INFO: Scrape type for 3377309: 1
2025-12-05 06:02:43 [manheim.gb] INFO: Found listing with ID: 3409801
2025-12-05 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273409801%27 HTTP/1.1" 200 None
2025-12-05 06:02:43 [manheim.gb] INFO: Scrape type for 3409801: 2
2025-12-05 06:02:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:02:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23424eb710>
2025-12-05 06:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:02:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c00db30e-97d1-5780-baf0-2570c7931598/c00db30e-97d1-5780-baf0-2570c7931598_image_7.jpg HTTP/1.1" 201 0
2025-12-05 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F35d32ec0-02df-42bd-bed7-0390cc81834b_10.jpg') HTTP/1.1" 204 0
2025-12-05 06:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/35d32ec0-02df-42bd-bed7-0390cc81834b_10.jpg saved to cache
2025-12-05 06:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c00db30e-97d1-5780-baf0-2570c7931598
2025-12-05 06:02:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:02:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23424ea810>
2025-12-05 06:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:02:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c00db30e-97d1-5780-baf0-2570c7931598/c00db30e-97d1-5780-baf0-2570c7931598_image_8.jpg HTTP/1.1" 201 0
2025-12-05 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F35d32ec0-02df-42bd-bed7-0390cc81834b_9.jpg') HTTP/1.1" 204 0
2025-12-05 06:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/35d32ec0-02df-42bd-bed7-0390cc81834b_9.jpg saved to cache
2025-12-05 06:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c00db30e-97d1-5780-baf0-2570c7931598
2025-12-05 06:02:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:02:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234243f850>
2025-12-05 06:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:02:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c00db30e-97d1-5780-baf0-2570c7931598/c00db30e-97d1-5780-baf0-2570c7931598_image_6.jpg HTTP/1.1" 201 0
2025-12-05 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F35d32ec0-02df-42bd-bed7-0390cc81834b_11.jpg') HTTP/1.1" 204 0
2025-12-05 06:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/35d32ec0-02df-42bd-bed7-0390cc81834b_11.jpg saved to cache
2025-12-05 06:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c00db30e-97d1-5780-baf0-2570c7931598
2025-12-05 06:02:44 [manheim.gb] INFO: Found listing with ID: 3417454
2025-12-05 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273417454%27 HTTP/1.1" 200 None
2025-12-05 06:02:44 [manheim.gb] INFO: Scrape type for 3417454: 2
2025-12-05 06:02:44 [manheim.gb] INFO: Found listing with ID: 3421582
2025-12-05 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273421582%27 HTTP/1.1" 200 None
2025-12-05 06:02:44 [manheim.gb] INFO: Scrape type for 3421582: 1
2025-12-05 06:02:44 [manheim.gb] INFO: Found listing with ID: 3424031
2025-12-05 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273424031%27 HTTP/1.1" 200 None
2025-12-05 06:02:44 [manheim.gb] INFO: Scrape type for 3424031: 1
2025-12-05 06:02:44 [manheim.gb] INFO: Found listing with ID: 3432289
2025-12-05 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273432289%27 HTTP/1.1" 200 None
2025-12-05 06:02:44 [manheim.gb] INFO: Scrape type for 3432289: 2
2025-12-05 06:02:44 [manheim.gb] INFO: Found listing with ID: 343802
2025-12-05 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27343802%27 HTTP/1.1" 200 None
2025-12-05 06:02:44 [manheim.gb] INFO: Scrape type for 343802: 2
2025-12-05 06:02:44 [manheim.gb] INFO: Found listing with ID: 3445714
2025-12-05 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273445714%27 HTTP/1.1" 200 None
2025-12-05 06:02:44 [manheim.gb] INFO: Scrape type for 3445714: 2
2025-12-05 06:02:44 [manheim.gb] INFO: Found listing with ID: 3476246
2025-12-05 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273476246%27 HTTP/1.1" 200 None
2025-12-05 06:02:44 [manheim.gb] INFO: Scrape type for 3476246: 1
2025-12-05 06:02:44 [manheim.gb] INFO: Found listing with ID: 3485191
2025-12-05 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273485191%27 HTTP/1.1" 200 None
2025-12-05 06:02:44 [manheim.gb] INFO: Scrape type for 3485191: 0
2025-12-05 06:02:44 [manheim.gb] INFO: Found listing with ID: 3503375
2025-12-05 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273503375%27 HTTP/1.1" 200 None
2025-12-05 06:02:44 [manheim.gb] INFO: Scrape type for 3503375: 1
2025-12-05 06:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0002408993-01992203-003.pdf> (referer: None)
2025-12-05 06:02:44 [manheim.gb] INFO: Found listing with ID: 3507560
2025-12-05 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273507560%27 HTTP/1.1" 200 None
2025-12-05 06:02:44 [manheim.gb] INFO: Scrape type for 3507560: 2
2025-12-05 06:02:44 [manheim.gb] INFO: Found listing with ID: 3512008
2025-12-05 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273512008%27 HTTP/1.1" 200 None
2025-12-05 06:02:44 [manheim.gb] INFO: Scrape type for 3512008: 0
2025-12-05 06:02:44 [manheim.gb] INFO: Found listing with ID: 3512799
2025-12-05 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273512799%27 HTTP/1.1" 200 None
2025-12-05 06:02:44 [manheim.gb] INFO: Scrape type for 3512799: 2
2025-12-05 06:02:44 [manheim.gb] INFO: Found listing with ID: 3516831
2025-12-05 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273516831%27 HTTP/1.1" 200 None
2025-12-05 06:02:44 [manheim.gb] INFO: Scrape type for 3516831: 0
2025-12-05 06:02:44 [manheim.gb] INFO: Found listing with ID: 3517150
2025-12-05 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273517150%27 HTTP/1.1" 200 None
2025-12-05 06:02:44 [manheim.gb] INFO: Scrape type for 3517150: 1
2025-12-05 06:02:44 [manheim.gb] INFO: Found listing with ID: 3518224
2025-12-05 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273518224%27 HTTP/1.1" 200 None
2025-12-05 06:02:44 [manheim.gb] INFO: Scrape type for 3518224: 0
2025-12-05 06:02:44 [manheim.gb] INFO: Found listing with ID: 352448
2025-12-05 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27352448%27 HTTP/1.1" 200 None
2025-12-05 06:02:44 [manheim.gb] INFO: Scrape type for 352448: 0
2025-12-05 06:02:44 [manheim.gb] INFO: Found listing with ID: 3528421
2025-12-05 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273528421%27 HTTP/1.1" 200 None
2025-12-05 06:02:44 [manheim.gb] INFO: Scrape type for 3528421: 0
2025-12-05 06:02:44 [manheim.gb] INFO: Found listing with ID: 3544627
2025-12-05 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273544627%27 HTTP/1.1" 200 None
2025-12-05 06:02:44 [manheim.gb] INFO: Scrape type for 3544627: 0
2025-12-05 06:02:44 [manheim.gb] INFO: Found listing with ID: 3553764
2025-12-05 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273553764%27 HTTP/1.1" 200 None
2025-12-05 06:02:44 [manheim.gb] INFO: Scrape type for 3553764: 0
2025-12-05 06:02:44 [manheim.gb] INFO: Found listing with ID: 3566423
2025-12-05 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273566423%27 HTTP/1.1" 200 None
2025-12-05 06:02:44 [manheim.gb] INFO: Scrape type for 3566423: 0
2025-12-05 06:02:44 [manheim.gb] INFO: Found listing with ID: 3583550
2025-12-05 06:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273583550%27 HTTP/1.1" 200 None
2025-12-05 06:02:45 [manheim.gb] INFO: Scrape type for 3583550: 0
2025-12-05 06:02:45 [manheim.gb] INFO: Found listing with ID: 3586152
2025-12-05 06:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273586152%27 HTTP/1.1" 200 None
2025-12-05 06:02:45 [manheim.gb] INFO: Scrape type for 3586152: 0
2025-12-05 06:02:45 [manheim.gb] INFO: Found listing with ID: 358707
2025-12-05 06:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27358707%27 HTTP/1.1" 200 None
2025-12-05 06:02:45 [manheim.gb] INFO: Scrape type for 358707: 0
2025-12-05 06:02:45 [manheim.gb] INFO: Found listing with ID: 3591726
2025-12-05 06:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273591726%27 HTTP/1.1" 200 None
2025-12-05 06:02:45 [manheim.gb] INFO: Scrape type for 3591726: 0
2025-12-05 06:02:45 [manheim.gb] INFO: Found listing with ID: 3603120
2025-12-05 06:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273603120%27 HTTP/1.1" 200 None
2025-12-05 06:02:45 [manheim.gb] INFO: Scrape type for 3603120: 0
2025-12-05 06:02:45 [manheim.gb] INFO: Found listing with ID: 3607988
2025-12-05 06:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273607988%27 HTTP/1.1" 200 None
2025-12-05 06:02:45 [manheim.gb] INFO: Scrape type for 3607988: 1
2025-12-05 06:02:45 [manheim.gb] INFO: Found listing with ID: 3612695
2025-12-05 06:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273612695%27 HTTP/1.1" 200 None
2025-12-05 06:02:45 [manheim.gb] INFO: Scrape type for 3612695: 0
2025-12-05 06:02:45 [manheim.gb] INFO: Found listing with ID: 3613252
2025-12-05 06:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273613252%27 HTTP/1.1" 200 None
2025-12-05 06:02:45 [manheim.gb] INFO: Scrape type for 3613252: 0
2025-12-05 06:02:45 [manheim.gb] INFO: Found listing with ID: 3616829
2025-12-05 06:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273616829%27 HTTP/1.1" 200 None
2025-12-05 06:02:45 [manheim.gb] INFO: Scrape type for 3616829: 0
2025-12-05 06:02:45 [manheim.gb] INFO: Found listing with ID: 3619601
2025-12-05 06:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273619601%27 HTTP/1.1" 200 None
2025-12-05 06:02:45 [manheim.gb] INFO: Scrape type for 3619601: 0
2025-12-05 06:02:45 [manheim.gb] INFO: Found listing with ID: 3622853
2025-12-05 06:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273622853%27 HTTP/1.1" 200 None
2025-12-05 06:02:45 [manheim.gb] INFO: Scrape type for 3622853: 0
2025-12-05 06:02:45 [manheim.gb] INFO: Found listing with ID: 363011
2025-12-05 06:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27363011%27 HTTP/1.1" 200 None
2025-12-05 06:02:45 [manheim.gb] INFO: Scrape type for 363011: 0
2025-12-05 06:02:45 [manheim.gb] INFO: Found listing with ID: 3630205
2025-12-05 06:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273630205%27 HTTP/1.1" 200 None
2025-12-05 06:02:45 [manheim.gb] INFO: Scrape type for 3630205: 0
2025-12-05 06:02:45 [manheim.gb] INFO: Found listing with ID: 3633295
2025-12-05 06:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273633295%27 HTTP/1.1" 200 None
2025-12-05 06:02:45 [manheim.gb] INFO: Scrape type for 3633295: 0
2025-12-05 06:02:45 [manheim.gb] INFO: Found listing with ID: 3634767
2025-12-05 06:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273634767%27 HTTP/1.1" 200 None
2025-12-05 06:02:45 [manheim.gb] INFO: Scrape type for 3634767: 0
2025-12-05 06:02:45 [manheim.gb] INFO: Found listing with ID: 3636928
2025-12-05 06:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273636928%27 HTTP/1.1" 200 None
2025-12-05 06:02:45 [manheim.gb] INFO: Scrape type for 3636928: 0
2025-12-05 06:02:45 [manheim.gb] INFO: Found listing with ID: 3637795
2025-12-05 06:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273637795%27 HTTP/1.1" 200 None
2025-12-05 06:02:45 [manheim.gb] INFO: Scrape type for 3637795: 0
2025-12-05 06:02:45 [manheim.gb] INFO: Found listing with ID: 3641838
2025-12-05 06:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273641838%27 HTTP/1.1" 200 None
2025-12-05 06:02:45 [manheim.gb] INFO: Scrape type for 3641838: 1
2025-12-05 06:02:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:02:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341eb0390>
2025-12-05 06:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:02:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827/5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827_expert_report_file_994a5e2f-89ff-4522-b585-4971f576ddd7.pdf HTTP/1.1" 201 0
2025-12-05 06:02:45 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827
2025-12-05 06:02:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827, skipping ID generation
2025-12-05 06:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827
2025-12-05 06:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8f3caae0-90d7-4ece-971c-baf294ce6d68_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8f3caae0-90d7-4ece-971c-baf294ce6d68_ext_7.jpg not downloaded yet
2025-12-05 06:02:45 [manheim.gb] INFO: Found listing with ID: 3655657
2025-12-05 06:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273655657%27 HTTP/1.1" 200 None
2025-12-05 06:02:45 [manheim.gb] INFO: Scrape type for 3655657: 0
2025-12-05 06:02:45 [manheim.gb] INFO: Found listing with ID: 3657400
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273657400%27 HTTP/1.1" 200 None
2025-12-05 06:02:46 [manheim.gb] INFO: Scrape type for 3657400: 0
2025-12-05 06:02:46 [manheim.gb] INFO: Found listing with ID: 3663676
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273663676%27 HTTP/1.1" 200 None
2025-12-05 06:02:46 [manheim.gb] INFO: Scrape type for 3663676: 0
2025-12-05 06:02:46 [manheim.gb] INFO: Found listing with ID: 3667925
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273667925%27 HTTP/1.1" 200 None
2025-12-05 06:02:46 [manheim.gb] INFO: Scrape type for 3667925: 0
2025-12-05 06:02:46 [manheim.gb] INFO: Found listing with ID: 3669473
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273669473%27 HTTP/1.1" 200 None
2025-12-05 06:02:46 [manheim.gb] INFO: Scrape type for 3669473: 0
2025-12-05 06:02:46 [manheim.gb] INFO: Found listing with ID: 3678294
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273678294%27 HTTP/1.1" 200 None
2025-12-05 06:02:46 [manheim.gb] INFO: Scrape type for 3678294: 0
2025-12-05 06:02:46 [manheim.gb] INFO: Found listing with ID: 3682181
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273682181%27 HTTP/1.1" 200 None
2025-12-05 06:02:46 [manheim.gb] INFO: Scrape type for 3682181: 0
2025-12-05 06:02:46 [manheim.gb] INFO: Found listing with ID: 3684881
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273684881%27 HTTP/1.1" 200 None
2025-12-05 06:02:46 [manheim.gb] INFO: Scrape type for 3684881: 0
2025-12-05 06:02:46 [manheim.gb] INFO: Found listing with ID: 3684907
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273684907%27 HTTP/1.1" 200 None
2025-12-05 06:02:46 [manheim.gb] INFO: Scrape type for 3684907: 0
2025-12-05 06:02:46 [manheim.gb] INFO: Found listing with ID: 3684908
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273684908%27 HTTP/1.1" 200 None
2025-12-05 06:02:46 [manheim.gb] INFO: Scrape type for 3684908: 0
2025-12-05 06:02:46 [manheim.gb] INFO: Found listing with ID: 3690345
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273690345%27 HTTP/1.1" 200 None
2025-12-05 06:02:46 [manheim.gb] INFO: Scrape type for 3690345: 1
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8f3caae0-90d7-4ece-971c-baf294ce6d68_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8f3caae0-90d7-4ece-971c-baf294ce6d68_ext_7.jpg not downloaded yet
2025-12-05 06:02:46 [manheim.gb] INFO: Found listing with ID: 3692062
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273692062%27 HTTP/1.1" 200 None
2025-12-05 06:02:46 [manheim.gb] INFO: Scrape type for 3692062: 0
2025-12-05 06:02:46 [manheim.gb] INFO: Found listing with ID: 3693298
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273693298%27 HTTP/1.1" 200 None
2025-12-05 06:02:46 [manheim.gb] INFO: Scrape type for 3693298: 0
2025-12-05 06:02:46 [manheim.gb] INFO: Found listing with ID: 3694568
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273694568%27 HTTP/1.1" 200 None
2025-12-05 06:02:46 [manheim.gb] INFO: Scrape type for 3694568: 0
2025-12-05 06:02:46 [manheim.gb] INFO: Found listing with ID: 3695980
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273695980%27 HTTP/1.1" 200 None
2025-12-05 06:02:46 [manheim.gb] INFO: Scrape type for 3695980: 0
2025-12-05 06:02:46 [manheim.gb] INFO: Found listing with ID: 3696571
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273696571%27 HTTP/1.1" 200 None
2025-12-05 06:02:46 [manheim.gb] INFO: Scrape type for 3696571: 0
2025-12-05 06:02:46 [manheim.gb] INFO: Found listing with ID: 3708538
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273708538%27 HTTP/1.1" 200 None
2025-12-05 06:02:46 [manheim.gb] INFO: Scrape type for 3708538: 0
2025-12-05 06:02:46 [manheim.gb] INFO: Found listing with ID: 3712711
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273712711%27 HTTP/1.1" 200 None
2025-12-05 06:02:46 [manheim.gb] INFO: Scrape type for 3712711: 1
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8f3caae0-90d7-4ece-971c-baf294ce6d68_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8f3caae0-90d7-4ece-971c-baf294ce6d68_ext_6.jpg not downloaded yet
2025-12-05 06:02:46 [manheim.gb] INFO: Found listing with ID: 3721892
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273721892%27 HTTP/1.1" 200 None
2025-12-05 06:02:46 [manheim.gb] INFO: Scrape type for 3721892: 0
2025-12-05 06:02:46 [manheim.gb] INFO: Found listing with ID: 3732689
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273732689%27 HTTP/1.1" 200 None
2025-12-05 06:02:46 [manheim.gb] INFO: Scrape type for 3732689: 0
2025-12-05 06:02:46 [manheim.gb] INFO: Found listing with ID: 3736304
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273736304%27 HTTP/1.1" 200 None
2025-12-05 06:02:46 [manheim.gb] INFO: Scrape type for 3736304: 0
2025-12-05 06:02:46 [manheim.gb] INFO: Found listing with ID: 3737427
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273737427%27 HTTP/1.1" 200 None
2025-12-05 06:02:46 [manheim.gb] INFO: Scrape type for 3737427: 0
2025-12-05 06:02:46 [manheim.gb] INFO: Found listing with ID: 3737655
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273737655%27 HTTP/1.1" 200 None
2025-12-05 06:02:46 [manheim.gb] INFO: Scrape type for 3737655: 0
2025-12-05 06:02:46 [manheim.gb] INFO: Found listing with ID: 3737761
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273737761%27 HTTP/1.1" 200 None
2025-12-05 06:02:46 [manheim.gb] INFO: Scrape type for 3737761: 0
2025-12-05 06:02:46 [manheim.gb] INFO: Found listing with ID: 3737827
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273737827%27 HTTP/1.1" 200 None
2025-12-05 06:02:46 [manheim.gb] INFO: Scrape type for 3737827: 0
2025-12-05 06:02:46 [manheim.gb] INFO: Found listing with ID: 3737837
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273737837%27 HTTP/1.1" 200 None
2025-12-05 06:02:46 [manheim.gb] INFO: Scrape type for 3737837: 0
2025-12-05 06:02:46 [manheim.gb] INFO: Found listing with ID: 3737981
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273737981%27 HTTP/1.1" 200 None
2025-12-05 06:02:46 [manheim.gb] INFO: Scrape type for 3737981: 0
2025-12-05 06:02:46 [manheim.gb] INFO: Found listing with ID: 3739898
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273739898%27 HTTP/1.1" 200 None
2025-12-05 06:02:46 [manheim.gb] INFO: Scrape type for 3739898: 0
2025-12-05 06:02:46 [manheim.gb] INFO: Found listing with ID: 3740756
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273740756%27 HTTP/1.1" 200 None
2025-12-05 06:02:46 [manheim.gb] INFO: Scrape type for 3740756: 0
2025-12-05 06:02:46 [manheim.gb] INFO: Found listing with ID: 3747146
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273747146%27 HTTP/1.1" 200 None
2025-12-05 06:02:46 [manheim.gb] INFO: Scrape type for 3747146: 1
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8f3caae0-90d7-4ece-971c-baf294ce6d68_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8f3caae0-90d7-4ece-971c-baf294ce6d68_ext_1.jpg not downloaded yet
2025-12-05 06:02:46 [manheim.gb] INFO: Found listing with ID: 3748540
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273748540%27 HTTP/1.1" 200 None
2025-12-05 06:02:46 [manheim.gb] INFO: Scrape type for 3748540: 0
2025-12-05 06:02:46 [manheim.gb] INFO: Found listing with ID: 3751763
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273751763%27 HTTP/1.1" 200 None
2025-12-05 06:02:46 [manheim.gb] INFO: Scrape type for 3751763: 0
2025-12-05 06:02:46 [manheim.gb] INFO: Found listing with ID: 3752426
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273752426%27 HTTP/1.1" 200 None
2025-12-05 06:02:46 [manheim.gb] INFO: Scrape type for 3752426: 0
2025-12-05 06:02:46 [manheim.gb] INFO: Found listing with ID: 3752427
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273752427%27 HTTP/1.1" 200 None
2025-12-05 06:02:46 [manheim.gb] INFO: Scrape type for 3752427: 0
2025-12-05 06:02:46 [manheim.gb] INFO: Found listing with ID: 3752430
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273752430%27 HTTP/1.1" 200 None
2025-12-05 06:02:46 [manheim.gb] INFO: Scrape type for 3752430: 0
2025-12-05 06:02:46 [manheim.gb] INFO: Found listing with ID: 3753028
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273753028%27 HTTP/1.1" 200 None
2025-12-05 06:02:46 [manheim.gb] INFO: Scrape type for 3753028: 0
2025-12-05 06:02:46 [manheim.gb] INFO: Found listing with ID: 3753808
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273753808%27 HTTP/1.1" 200 None
2025-12-05 06:02:46 [manheim.gb] INFO: Scrape type for 3753808: 1
2025-12-05 06:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8f3caae0-90d7-4ece-971c-baf294ce6d68_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8f3caae0-90d7-4ece-971c-baf294ce6d68_5.jpg not downloaded yet
2025-12-05 06:02:47 [manheim.gb] INFO: Found listing with ID: 3754025
2025-12-05 06:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273754025%27 HTTP/1.1" 200 None
2025-12-05 06:02:47 [manheim.gb] INFO: Scrape type for 3754025: 0
2025-12-05 06:02:47 [manheim.gb] INFO: Found listing with ID: 3754451
2025-12-05 06:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273754451%27 HTTP/1.1" 200 None
2025-12-05 06:02:47 [manheim.gb] INFO: Scrape type for 3754451: 0
2025-12-05 06:02:47 [manheim.gb] INFO: Found listing with ID: 3754570
2025-12-05 06:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273754570%27 HTTP/1.1" 200 None
2025-12-05 06:02:47 [manheim.gb] INFO: Scrape type for 3754570: 1
2025-12-05 06:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8f3caae0-90d7-4ece-971c-baf294ce6d68_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8f3caae0-90d7-4ece-971c-baf294ce6d68_4.jpg not downloaded yet
2025-12-05 06:02:47 [manheim.gb] INFO: Found listing with ID: 3759664
2025-12-05 06:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273759664%27 HTTP/1.1" 200 None
2025-12-05 06:02:47 [manheim.gb] INFO: Scrape type for 3759664: 1
2025-12-05 06:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8f3caae0-90d7-4ece-971c-baf294ce6d68_11.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8f3caae0-90d7-4ece-971c-baf294ce6d68_11.jpg not downloaded yet
2025-12-05 06:02:47 [manheim.gb] INFO: Found listing with ID: 3759761
2025-12-05 06:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273759761%27 HTTP/1.1" 200 None
2025-12-05 06:02:47 [manheim.gb] INFO: Scrape type for 3759761: 1
2025-12-05 06:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8f3caae0-90d7-4ece-971c-baf294ce6d68_10.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8f3caae0-90d7-4ece-971c-baf294ce6d68_10.jpg not downloaded yet
2025-12-05 06:02:47 [manheim.gb] INFO: Found listing with ID: 3770246
2025-12-05 06:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273770246%27 HTTP/1.1" 200 None
2025-12-05 06:02:47 [manheim.gb] INFO: Scrape type for 3770246: 0
2025-12-05 06:02:47 [manheim.gb] INFO: Found listing with ID: 3770420
2025-12-05 06:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273770420%27 HTTP/1.1" 200 None
2025-12-05 06:02:47 [manheim.gb] INFO: Scrape type for 3770420: 1
2025-12-05 06:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8f3caae0-90d7-4ece-971c-baf294ce6d68_9.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8f3caae0-90d7-4ece-971c-baf294ce6d68_9.jpg not downloaded yet
2025-12-05 06:02:47 [manheim.gb] INFO: Found listing with ID: 3779127
2025-12-05 06:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273779127%27 HTTP/1.1" 200 None
2025-12-05 06:02:47 [manheim.gb] INFO: Scrape type for 3779127: 1
2025-12-05 06:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8f3caae0-90d7-4ece-971c-baf294ce6d68_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8f3caae0-90d7-4ece-971c-baf294ce6d68_ext_2.jpg not downloaded yet
2025-12-05 06:02:47 [manheim.gb] INFO: Found listing with ID: 3780546
2025-12-05 06:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273780546%27 HTTP/1.1" 200 None
2025-12-05 06:02:47 [manheim.gb] INFO: Scrape type for 3780546: 1
2025-12-05 06:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8f3caae0-90d7-4ece-971c-baf294ce6d68_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8f3caae0-90d7-4ece-971c-baf294ce6d68_ext_5.jpg not downloaded yet
2025-12-05 06:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8f3caae0-90d7-4ece-971c-baf294ce6d68_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8f3caae0-90d7-4ece-971c-baf294ce6d68_ext_3.jpg not downloaded yet
2025-12-05 06:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8f3caae0-90d7-4ece-971c-baf294ce6d68_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8f3caae0-90d7-4ece-971c-baf294ce6d68_ext_4.jpg not downloaded yet
2025-12-05 06:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2408993-4008436-13.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2408993-4008436-13.jpg not downloaded yet
2025-12-05 06:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2408993-4008436-1000.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2408993-4008436-1000.jpg not downloaded yet
2025-12-05 06:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2408993-4008436-1001.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2408993-4008436-1001.jpg not downloaded yet
2025-12-05 06:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2408993-4008436-1002.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2408993-4008436-1002.jpg not downloaded yet
2025-12-05 06:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2408993-4008436-1003.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2408993-4008436-1003.jpg not downloaded yet
2025-12-05 06:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2408993-4008436-1004.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2408993-4008436-1004.jpg not downloaded yet
2025-12-05 06:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2408993-4008436-1005.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2408993-4008436-1005.jpg not downloaded yet
2025-12-05 06:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=2414514&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232414514&indx=92> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:02:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:02:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7b96404-71f7-50df-b780-712ffa99f849 with identifier: 2414514
2025-12-05 06:02:49 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item c7b96404-71f7-50df-b780-712ffa99f849
2025-12-05 06:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2408993-4008436-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002408993-01992203-003.pdf)
2025-12-05 06:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/SCLASS?id=2550798&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232550798&indx=107> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:02:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:02:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:02:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23426dac90>
2025-12-05 06:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:02:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827/5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827_image_19.jpg HTTP/1.1" 201 0
2025-12-05 06:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2408993-4008436-1005.jpg') HTTP/1.1" 204 0
2025-12-05 06:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2408993-4008436-1005.jpg saved to cache
2025-12-05 06:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827
2025-12-05 06:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2408993-4008436-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002408993-01992203-003.pdf)
2025-12-05 06:02:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 622888c0-24ad-5e73-9f41-e6c802ed4b38 with identifier: 2550798
2025-12-05 06:02:49 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 622888c0-24ad-5e73-9f41-e6c802ed4b38
2025-12-05 06:02:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:02:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342500bd0>
2025-12-05 06:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:02:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827/5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827_image_18.jpg HTTP/1.1" 201 0
2025-12-05 06:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2408993-4008436-1004.jpg') HTTP/1.1" 204 0
2025-12-05 06:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2408993-4008436-1004.jpg saved to cache
2025-12-05 06:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827
2025-12-05 06:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2408993-4008436-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002408993-01992203-003.pdf)
2025-12-05 06:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0002414514-01986790-002.pdf> (referer: None)
2025-12-05 06:02:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:02:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341ee7bd0>
2025-12-05 06:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:02:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827/5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827_image_17.jpg HTTP/1.1" 201 0
2025-12-05 06:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2408993-4008436-1003.jpg') HTTP/1.1" 204 0
2025-12-05 06:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2408993-4008436-1003.jpg saved to cache
2025-12-05 06:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827
2025-12-05 06:02:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:02:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425c7f90>
2025-12-05 06:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:02:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7b96404-71f7-50df-b780-712ffa99f849/c7b96404-71f7-50df-b780-712ffa99f849_expert_report_file_c6605ba4-6448-4018-bdf4-09c367f134ef.pdf HTTP/1.1" 201 0
2025-12-05 06:02:51 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item c7b96404-71f7-50df-b780-712ffa99f849
2025-12-05 06:02:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c7b96404-71f7-50df-b780-712ffa99f849, skipping ID generation
2025-12-05 06:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item c7b96404-71f7-50df-b780-712ffa99f849
2025-12-05 06:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F621dbea7-ff44-4a68-8943-006ce584aa7e_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/621dbea7-ff44-4a68-8943-006ce584aa7e_ext_7.jpg not downloaded yet
2025-12-05 06:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F621dbea7-ff44-4a68-8943-006ce584aa7e_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/621dbea7-ff44-4a68-8943-006ce584aa7e_ext_7.jpg not downloaded yet
2025-12-05 06:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F621dbea7-ff44-4a68-8943-006ce584aa7e_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/621dbea7-ff44-4a68-8943-006ce584aa7e_ext_6.jpg not downloaded yet
2025-12-05 06:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F621dbea7-ff44-4a68-8943-006ce584aa7e_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/621dbea7-ff44-4a68-8943-006ce584aa7e_ext_1.jpg not downloaded yet
2025-12-05 06:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F621dbea7-ff44-4a68-8943-006ce584aa7e_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/621dbea7-ff44-4a68-8943-006ce584aa7e_5.jpg not downloaded yet
2025-12-05 06:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F621dbea7-ff44-4a68-8943-006ce584aa7e_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/621dbea7-ff44-4a68-8943-006ce584aa7e_4.jpg not downloaded yet
2025-12-05 06:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F621dbea7-ff44-4a68-8943-006ce584aa7e_11.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/621dbea7-ff44-4a68-8943-006ce584aa7e_11.jpg not downloaded yet
2025-12-05 06:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F621dbea7-ff44-4a68-8943-006ce584aa7e_10.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/621dbea7-ff44-4a68-8943-006ce584aa7e_10.jpg not downloaded yet
2025-12-05 06:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F621dbea7-ff44-4a68-8943-006ce584aa7e_9.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/621dbea7-ff44-4a68-8943-006ce584aa7e_9.jpg not downloaded yet
2025-12-05 06:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F621dbea7-ff44-4a68-8943-006ce584aa7e_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/621dbea7-ff44-4a68-8943-006ce584aa7e_ext_2.jpg not downloaded yet
2025-12-05 06:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F621dbea7-ff44-4a68-8943-006ce584aa7e_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/621dbea7-ff44-4a68-8943-006ce584aa7e_ext_5.jpg not downloaded yet
2025-12-05 06:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F621dbea7-ff44-4a68-8943-006ce584aa7e_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/621dbea7-ff44-4a68-8943-006ce584aa7e_ext_3.jpg not downloaded yet
2025-12-05 06:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F621dbea7-ff44-4a68-8943-006ce584aa7e_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/621dbea7-ff44-4a68-8943-006ce584aa7e_ext_4.jpg not downloaded yet
2025-12-05 06:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2414514-4007819-13.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2414514-4007819-13.jpg not downloaded yet
2025-12-05 06:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2414514-4007819-1000.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2414514-4007819-1000.jpg not downloaded yet
2025-12-05 06:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2414514-4007819-1001.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2414514-4007819-1001.jpg not downloaded yet
2025-12-05 06:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2414514-4007819-1002.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2414514-4007819-1002.jpg not downloaded yet
2025-12-05 06:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2414514-4007819-1003.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2414514-4007819-1003.jpg not downloaded yet
2025-12-05 06:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2414514-4007819-1004.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2414514-4007819-1004.jpg not downloaded yet
2025-12-05 06:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2414514-4007819-1005.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2414514-4007819-1005.jpg not downloaded yet
2025-12-05 06:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0002550798-01506735-004.pdf> (referer: None)
2025-12-05 06:02:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:02:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23424acf10>
2025-12-05 06:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:02:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_622888c0-24ad-5e73-9f41-e6c802ed4b38/622888c0-24ad-5e73-9f41-e6c802ed4b38_expert_report_file_2f9a426b-b0fe-45bf-8322-9edee9daa6b9.pdf HTTP/1.1" 201 0
2025-12-05 06:02:52 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 622888c0-24ad-5e73-9f41-e6c802ed4b38
2025-12-05 06:02:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 622888c0-24ad-5e73-9f41-e6c802ed4b38, skipping ID generation
2025-12-05 06:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 622888c0-24ad-5e73-9f41-e6c802ed4b38
2025-12-05 06:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa7fb15c8-a7e1-47df-a85f-4818aedca603_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a7fb15c8-a7e1-47df-a85f-4818aedca603_ext_7.jpg not downloaded yet
2025-12-05 06:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa7fb15c8-a7e1-47df-a85f-4818aedca603_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a7fb15c8-a7e1-47df-a85f-4818aedca603_ext_7.jpg not downloaded yet
2025-12-05 06:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/GOLFPLUS?id=255681&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%23255681&indx=108> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa7fb15c8-a7e1-47df-a85f-4818aedca603_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a7fb15c8-a7e1-47df-a85f-4818aedca603_ext_6.jpg not downloaded yet
2025-12-05 06:02:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa7fb15c8-a7e1-47df-a85f-4818aedca603_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a7fb15c8-a7e1-47df-a85f-4818aedca603_ext_1.jpg not downloaded yet
2025-12-05 06:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2414514-4007819-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002414514-01986790-002.pdf)
2025-12-05 06:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2414514-4007819-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002414514-01986790-002.pdf)
2025-12-05 06:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa7fb15c8-a7e1-47df-a85f-4818aedca603_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a7fb15c8-a7e1-47df-a85f-4818aedca603_5.jpg not downloaded yet
2025-12-05 06:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa7fb15c8-a7e1-47df-a85f-4818aedca603_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a7fb15c8-a7e1-47df-a85f-4818aedca603_4.jpg not downloaded yet
2025-12-05 06:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa7fb15c8-a7e1-47df-a85f-4818aedca603_11.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a7fb15c8-a7e1-47df-a85f-4818aedca603_11.jpg not downloaded yet
2025-12-05 06:02:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62152b2c-4552-5cbe-ad83-888e9e91aff5 with identifier: 255681
2025-12-05 06:02:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62152b2c-4552-5cbe-ad83-888e9e91aff5 with scrape type 2
2025-12-05 06:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62152b2c-4552-5cbe-ad83-888e9e91aff5 with scrape type 2
2025-12-05 06:02:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 62152b2c-4552-5cbe-ad83-888e9e91aff5, identifier: 255681
2025-12-05 06:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa7fb15c8-a7e1-47df-a85f-4818aedca603_10.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a7fb15c8-a7e1-47df-a85f-4818aedca603_10.jpg not downloaded yet
2025-12-05 06:02:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 62152b2c-4552-5cbe-ad83-888e9e91aff5 with identifier: 255681
2025-12-05 06:02:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 62152b2c-4552-5cbe-ad83-888e9e91aff5 with identifier: 255681
2025-12-05 06:02:53 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 157131 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    157131
2025-12-05 06:02:53 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 62152b2c-4552-5cbe-ad83-888e9e91aff5 spider: manheim.gb
2025-12-05 06:02:53 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 62152b2c-4552-5cbe-ad83-888e9e91aff5 due to rule: high_mileage_for_country.json, error: 157131 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    157131
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0000255681-01986652-004.pdf',
 'color': 'RED',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '62152b2c-4552-5cbe-ad83-888e9e91aff5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'YR62HKF',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/GOLF%20PLUS?id=255681',
 'listing': 'auction',
 'location': 'Northampton',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF PLUS',
 'odometer': 97637,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-26',
 'seller_name': 'Sytner',
 'title': 'VOLKSWAGEN GOLF PLUS 1.6 TDI 105 BlueMotion SE 5dr',
 'transmission': 'manual',
 'trim': '1.6 TDI 105 BlueMotion SE 5dr',
 'year': 2012}
2025-12-05 06:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27255681%27 HTTP/1.1" 200 None
2025-12-05 06:02:53 [manheim.gb] INFO: Saving data for 255681: {'auction_closing_time': 1765270800.0, 'created_time': 1764792586.063159, 'last_price_update_time': 1764914573.146928}
2025-12-05 06:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='255681') HTTP/1.1" 204 0
2025-12-05 06:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa7fb15c8-a7e1-47df-a85f-4818aedca603_9.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a7fb15c8-a7e1-47df-a85f-4818aedca603_9.jpg not downloaded yet
2025-12-05 06:02:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:02:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23426d8590>
2025-12-05 06:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:02:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7b96404-71f7-50df-b780-712ffa99f849/c7b96404-71f7-50df-b780-712ffa99f849_image_19.jpg HTTP/1.1" 201 0
2025-12-05 06:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2414514-4007819-1005.jpg') HTTP/1.1" 204 0
2025-12-05 06:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2414514-4007819-1005.jpg saved to cache
2025-12-05 06:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item c7b96404-71f7-50df-b780-712ffa99f849
2025-12-05 06:02:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:02:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234244f210>
2025-12-05 06:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:02:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7b96404-71f7-50df-b780-712ffa99f849/c7b96404-71f7-50df-b780-712ffa99f849_image_18.jpg HTTP/1.1" 201 0
2025-12-05 06:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2414514-4007819-1004.jpg') HTTP/1.1" 204 0
2025-12-05 06:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2414514-4007819-1004.jpg saved to cache
2025-12-05 06:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item c7b96404-71f7-50df-b780-712ffa99f849
2025-12-05 06:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a7fb15c8-a7e1-47df-a85f-4818aedca603_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002550798-01506735-004.pdf)
2025-12-05 06:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a7fb15c8-a7e1-47df-a85f-4818aedca603_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002550798-01506735-004.pdf)
2025-12-05 06:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a7fb15c8-a7e1-47df-a85f-4818aedca603_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002550798-01506735-004.pdf)
2025-12-05 06:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa7fb15c8-a7e1-47df-a85f-4818aedca603_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a7fb15c8-a7e1-47df-a85f-4818aedca603_ext_2.jpg not downloaded yet
2025-12-05 06:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa7fb15c8-a7e1-47df-a85f-4818aedca603_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a7fb15c8-a7e1-47df-a85f-4818aedca603_ext_5.jpg not downloaded yet
2025-12-05 06:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa7fb15c8-a7e1-47df-a85f-4818aedca603_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a7fb15c8-a7e1-47df-a85f-4818aedca603_ext_3.jpg not downloaded yet
2025-12-05 06:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa7fb15c8-a7e1-47df-a85f-4818aedca603_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a7fb15c8-a7e1-47df-a85f-4818aedca603_ext_4.jpg not downloaded yet
2025-12-05 06:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2550798-3435552-13.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2550798-3435552-13.jpg not downloaded yet
2025-12-05 06:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2550798-3435552-1000.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2550798-3435552-1000.jpg not downloaded yet
2025-12-05 06:02:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:02:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23426ffb50>
2025-12-05 06:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:02:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_622888c0-24ad-5e73-9f41-e6c802ed4b38/622888c0-24ad-5e73-9f41-e6c802ed4b38_image_1.jpg HTTP/1.1" 201 0
2025-12-05 06:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa7fb15c8-a7e1-47df-a85f-4818aedca603_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 06:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a7fb15c8-a7e1-47df-a85f-4818aedca603_ext_7.jpg saved to cache
2025-12-05 06:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 622888c0-24ad-5e73-9f41-e6c802ed4b38
2025-12-05 06:02:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:02:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2343e31290>
2025-12-05 06:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:02:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_622888c0-24ad-5e73-9f41-e6c802ed4b38/622888c0-24ad-5e73-9f41-e6c802ed4b38_image_2.jpg HTTP/1.1" 201 0
2025-12-05 06:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa7fb15c8-a7e1-47df-a85f-4818aedca603_ext_6.jpg') HTTP/1.1" 204 0
2025-12-05 06:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a7fb15c8-a7e1-47df-a85f-4818aedca603_ext_6.jpg saved to cache
2025-12-05 06:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 622888c0-24ad-5e73-9f41-e6c802ed4b38
2025-12-05 06:02:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:02:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23426e5b10>
2025-12-05 06:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:02:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_622888c0-24ad-5e73-9f41-e6c802ed4b38/622888c0-24ad-5e73-9f41-e6c802ed4b38_image_3.jpg HTTP/1.1" 201 0
2025-12-05 06:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa7fb15c8-a7e1-47df-a85f-4818aedca603_ext_1.jpg') HTTP/1.1" 204 0
2025-12-05 06:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a7fb15c8-a7e1-47df-a85f-4818aedca603_ext_1.jpg saved to cache
2025-12-05 06:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 622888c0-24ad-5e73-9f41-e6c802ed4b38
2025-12-05 06:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2550798-3435552-1001.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2550798-3435552-1001.jpg not downloaded yet
2025-12-05 06:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/GL?id=2561807&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232561807&indx=110> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2550798-3435552-1002.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2550798-3435552-1002.jpg not downloaded yet
2025-12-05 06:02:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/RENAULT/CAPTUR?id=2577653&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232577653&indx=112> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:02:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a7fb15c8-a7e1-47df-a85f-4818aedca603_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002550798-01506735-004.pdf)
2025-12-05 06:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a7fb15c8-a7e1-47df-a85f-4818aedca603_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002550798-01506735-004.pdf)
2025-12-05 06:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a7fb15c8-a7e1-47df-a85f-4818aedca603_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002550798-01506735-004.pdf)
2025-12-05 06:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2550798-3435552-1003.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2550798-3435552-1003.jpg not downloaded yet
2025-12-05 06:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2550798-3435552-1004.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2550798-3435552-1004.jpg not downloaded yet
2025-12-05 06:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2550798-3435552-1005.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2550798-3435552-1005.jpg not downloaded yet
2025-12-05 06:02:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: faefb4f3-f024-5658-b9a4-12ebc9e3eefe with identifier: 2561807
2025-12-05 06:02:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item faefb4f3-f024-5658-b9a4-12ebc9e3eefe with scrape type 2
2025-12-05 06:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item faefb4f3-f024-5658-b9a4-12ebc9e3eefe with scrape type 2
2025-12-05 06:02:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: faefb4f3-f024-5658-b9a4-12ebc9e3eefe, identifier: 2561807
2025-12-05 06:02:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: faefb4f3-f024-5658-b9a4-12ebc9e3eefe with identifier: 2561807
2025-12-05 06:02:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: faefb4f3-f024-5658-b9a4-12ebc9e3eefe with identifier: 2561807
2025-12-05 06:02:55 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: faefb4f3-f024-5658-b9a4-12ebc9e3eefe with identifier: 2561807 to the API
2025-12-05 06:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 06:02:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-05 06:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27faefb4f3-f024-5658-b9a4-12ebc9e3eefe%27 HTTP/1.1" 200 None
2025-12-05 06:02:55 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id faefb4f3-f024-5658-b9a4-12ebc9e3eefe: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Fri, 05 Dec 2025 06:02:54 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-05 06:02:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/GL?id=2561807&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232561807&indx=110>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002561807-01987223-001.pdf',
 'color': 'BLUE',
 'currency': 'GBP',
 'engine': '2.2L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'faefb4f3-f024-5658-b9a4-12ebc9e3eefe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'OY68LPK',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/GL?id=2561807',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'MERCEDES-BENZ',
 'model': 'GL',
 'odometer': 50367,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-30',
 'seller_name': 'Big Motoring World Ltd',
 'title': 'MERCEDES-BENZ GL GLA 220d 4Matic AMG Line Premium 5dr Auto',
 'transmission': 'automatic',
 'trim': 'GLA 220d 4Matic AMG Line Premium 5dr Auto',
 'year': 2018}
2025-12-05 06:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272561807%27 HTTP/1.1" 200 None
2025-12-05 06:02:55 [manheim.gb] INFO: Saving data for 2561807: {'auction_closing_time': 1765270800.0, 'created_time': 1764583831.302993, 'last_price_update_time': 1764914575.605507}
2025-12-05 06:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2561807') HTTP/1.1" 204 0
2025-12-05 06:02:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31c0caf2-0773-541d-b1c7-db18adc292da with identifier: 2577653
2025-12-05 06:02:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31c0caf2-0773-541d-b1c7-db18adc292da with scrape type 2
2025-12-05 06:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 31c0caf2-0773-541d-b1c7-db18adc292da with scrape type 2
2025-12-05 06:02:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 31c0caf2-0773-541d-b1c7-db18adc292da, identifier: 2577653
2025-12-05 06:02:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:02:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23424e71d0>
2025-12-05 06:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:02:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_622888c0-24ad-5e73-9f41-e6c802ed4b38/622888c0-24ad-5e73-9f41-e6c802ed4b38_image_6.jpg HTTP/1.1" 201 0
2025-12-05 06:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa7fb15c8-a7e1-47df-a85f-4818aedca603_11.jpg') HTTP/1.1" 204 0
2025-12-05 06:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a7fb15c8-a7e1-47df-a85f-4818aedca603_11.jpg saved to cache
2025-12-05 06:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 622888c0-24ad-5e73-9f41-e6c802ed4b38
2025-12-05 06:02:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:02:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234264f6d0>
2025-12-05 06:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:02:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_622888c0-24ad-5e73-9f41-e6c802ed4b38/622888c0-24ad-5e73-9f41-e6c802ed4b38_image_7.jpg HTTP/1.1" 201 0
2025-12-05 06:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa7fb15c8-a7e1-47df-a85f-4818aedca603_10.jpg') HTTP/1.1" 204 0
2025-12-05 06:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a7fb15c8-a7e1-47df-a85f-4818aedca603_10.jpg saved to cache
2025-12-05 06:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 622888c0-24ad-5e73-9f41-e6c802ed4b38
2025-12-05 06:02:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:02:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23426f6390>
2025-12-05 06:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:02:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_622888c0-24ad-5e73-9f41-e6c802ed4b38/622888c0-24ad-5e73-9f41-e6c802ed4b38_image_8.jpg HTTP/1.1" 201 0
2025-12-05 06:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa7fb15c8-a7e1-47df-a85f-4818aedca603_9.jpg') HTTP/1.1" 204 0
2025-12-05 06:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a7fb15c8-a7e1-47df-a85f-4818aedca603_9.jpg saved to cache
2025-12-05 06:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 622888c0-24ad-5e73-9f41-e6c802ed4b38
2025-12-05 06:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2550798-3435552-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002550798-01506735-004.pdf)
2025-12-05 06:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a7fb15c8-a7e1-47df-a85f-4818aedca603_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002550798-01506735-004.pdf)
2025-12-05 06:02:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 31c0caf2-0773-541d-b1c7-db18adc292da with identifier: 2577653
2025-12-05 06:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 06:02:56 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=RED+AND+BLACK HTTP/1.1" 200 None
2025-12-05 06:02:56 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 06:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 06:02:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 31c0caf2-0773-541d-b1c7-db18adc292da with identifier: 2577653
2025-12-05 06:02:56 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 31c0caf2-0773-541d-b1c7-db18adc292da with identifier: 2577653 to the API
2025-12-05 06:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 06:02:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 06:02:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/RENAULT/CAPTUR?id=2577653&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232577653&indx=112>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002577653-01989447-002.pdf',
 'color': 'RED AND BLACK',
 'currency': 'GBP',
 'engine': '1.5L',
 'expiration_date': '2025-12-10T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '31c0caf2-0773-541d-b1c7-db18adc292da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'HV20EKL',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/RENAULT/CAPTUR?id=2577653',
 'listing': 'auction',
 'location': 'Birmingham',
 'make': 'RENAULT',
 'model': 'CAPTUR',
 'odometer': 60347,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-09',
 'seller_name': 'Hilton Garage Ltd',
 'title': 'RENAULT CAPTUR 1.5 dCi 95 S Edition 5dr',
 'transmission': 'manual',
 'trim': '1.5 dCi 95 S Edition 5dr',
 'year': 2020}
2025-12-05 06:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272577653%27 HTTP/1.1" 200 None
2025-12-05 06:02:57 [manheim.gb] INFO: Saving data for 2577653: {'auction_closing_time': 1765357200.0, 'created_time': 1764669753.284253, 'last_price_update_time': 1764914577.07076}
2025-12-05 06:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2577653') HTTP/1.1" 204 0
2025-12-05 06:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2550798-3435552-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002550798-01506735-004.pdf)
2025-12-05 06:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2550798-3435552-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002550798-01506735-004.pdf)
2025-12-05 06:02:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:02:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23426d8290>
2025-12-05 06:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:02:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 06:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_622888c0-24ad-5e73-9f41-e6c802ed4b38/622888c0-24ad-5e73-9f41-e6c802ed4b38_image_16.jpg HTTP/1.1" 201 0
2025-12-05 06:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2550798-3435552-1002.jpg') HTTP/1.1" 204 0
2025-12-05 06:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2550798-3435552-1002.jpg saved to cache
2025-12-05 06:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 622888c0-24ad-5e73-9f41-e6c802ed4b38
2025-12-05 06:02:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:02:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23415e9810>
2025-12-05 06:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:02:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_622888c0-24ad-5e73-9f41-e6c802ed4b38/622888c0-24ad-5e73-9f41-e6c802ed4b38_image_12.jpg HTTP/1.1" 201 0
2025-12-05 06:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa7fb15c8-a7e1-47df-a85f-4818aedca603_ext_4.jpg') HTTP/1.1" 204 0
2025-12-05 06:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a7fb15c8-a7e1-47df-a85f-4818aedca603_ext_4.jpg saved to cache
2025-12-05 06:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 622888c0-24ad-5e73-9f41-e6c802ed4b38
2025-12-05 06:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2550798-3435552-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002550798-01506735-004.pdf)
2025-12-05 06:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2550798-3435552-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002550798-01506735-004.pdf)
2025-12-05 06:02:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:02:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341edcd50>
2025-12-05 06:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:02:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 06:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_622888c0-24ad-5e73-9f41-e6c802ed4b38/622888c0-24ad-5e73-9f41-e6c802ed4b38_image_14.jpg HTTP/1.1" 201 0
2025-12-05 06:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2550798-3435552-1000.jpg') HTTP/1.1" 204 0
2025-12-05 06:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2550798-3435552-1000.jpg saved to cache
2025-12-05 06:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 622888c0-24ad-5e73-9f41-e6c802ed4b38
2025-12-05 06:02:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:02:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23424e7210>
2025-12-05 06:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:02:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 06:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_622888c0-24ad-5e73-9f41-e6c802ed4b38/622888c0-24ad-5e73-9f41-e6c802ed4b38_image_13.jpg HTTP/1.1" 201 0
2025-12-05 06:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2550798-3435552-13.jpg') HTTP/1.1" 204 0
2025-12-05 06:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2550798-3435552-13.jpg saved to cache
2025-12-05 06:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 622888c0-24ad-5e73-9f41-e6c802ed4b38
2025-12-05 06:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2550798-3435552-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002550798-01506735-004.pdf)
2025-12-05 06:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2550798-3435552-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002550798-01506735-004.pdf)
2025-12-05 06:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a7fb15c8-a7e1-47df-a85f-4818aedca603_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002550798-01506735-004.pdf)
2025-12-05 06:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a7fb15c8-a7e1-47df-a85f-4818aedca603_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002550798-01506735-004.pdf)
2025-12-05 06:02:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:02:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341ebadd0>
2025-12-05 06:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:02:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 06:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_622888c0-24ad-5e73-9f41-e6c802ed4b38/622888c0-24ad-5e73-9f41-e6c802ed4b38_image_15.jpg HTTP/1.1" 201 0
2025-12-05 06:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2550798-3435552-1001.jpg') HTTP/1.1" 204 0
2025-12-05 06:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2550798-3435552-1001.jpg saved to cache
2025-12-05 06:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 622888c0-24ad-5e73-9f41-e6c802ed4b38
2025-12-05 06:02:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:02:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23423a1a10>
2025-12-05 06:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:02:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 06:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_622888c0-24ad-5e73-9f41-e6c802ed4b38/622888c0-24ad-5e73-9f41-e6c802ed4b38_image_19.jpg HTTP/1.1" 201 0
2025-12-05 06:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2550798-3435552-1005.jpg') HTTP/1.1" 204 0
2025-12-05 06:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2550798-3435552-1005.jpg saved to cache
2025-12-05 06:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 622888c0-24ad-5e73-9f41-e6c802ed4b38
2025-12-05 06:02:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:02:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342669850>
2025-12-05 06:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:02:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_622888c0-24ad-5e73-9f41-e6c802ed4b38/622888c0-24ad-5e73-9f41-e6c802ed4b38_image_17.jpg HTTP/1.1" 201 0
2025-12-05 06:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2550798-3435552-1003.jpg') HTTP/1.1" 204 0
2025-12-05 06:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2550798-3435552-1003.jpg saved to cache
2025-12-05 06:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 622888c0-24ad-5e73-9f41-e6c802ed4b38
2025-12-05 06:02:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:02:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23427b2710>
2025-12-05 06:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:02:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_622888c0-24ad-5e73-9f41-e6c802ed4b38/622888c0-24ad-5e73-9f41-e6c802ed4b38_image_18.jpg HTTP/1.1" 201 0
2025-12-05 06:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2550798-3435552-1004.jpg') HTTP/1.1" 204 0
2025-12-05 06:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2550798-3435552-1004.jpg saved to cache
2025-12-05 06:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 622888c0-24ad-5e73-9f41-e6c802ed4b38
2025-12-05 06:02:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:02:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425680d0>
2025-12-05 06:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:02:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_622888c0-24ad-5e73-9f41-e6c802ed4b38/622888c0-24ad-5e73-9f41-e6c802ed4b38_image_10.jpg HTTP/1.1" 201 0
2025-12-05 06:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa7fb15c8-a7e1-47df-a85f-4818aedca603_ext_5.jpg') HTTP/1.1" 204 0
2025-12-05 06:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a7fb15c8-a7e1-47df-a85f-4818aedca603_ext_5.jpg saved to cache
2025-12-05 06:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 622888c0-24ad-5e73-9f41-e6c802ed4b38
2025-12-05 06:02:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:02:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425f10d0>
2025-12-05 06:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:02:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_622888c0-24ad-5e73-9f41-e6c802ed4b38/622888c0-24ad-5e73-9f41-e6c802ed4b38_image_11.jpg HTTP/1.1" 201 0
2025-12-05 06:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa7fb15c8-a7e1-47df-a85f-4818aedca603_ext_3.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a7fb15c8-a7e1-47df-a85f-4818aedca603_ext_3.jpg saved to cache
2025-12-05 06:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 622888c0-24ad-5e73-9f41-e6c802ed4b38
2025-12-05 06:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a7fb15c8-a7e1-47df-a85f-4818aedca603_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002550798-01506735-004.pdf)
2025-12-05 06:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VAUXHALL/CORSA?id=2782744&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232782744&indx=133> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:03:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a7fb15c8-a7e1-47df-a85f-4818aedca603_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002550798-01506735-004.pdf)
2025-12-05 06:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a7fb15c8-a7e1-47df-a85f-4818aedca603_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002550798-01506735-004.pdf)
2025-12-05 06:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a7fb15c8-a7e1-47df-a85f-4818aedca603_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002550798-01506735-004.pdf)
2025-12-05 06:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2414514-4007819-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002414514-01986790-002.pdf)
2025-12-05 06:03:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341ee4310>
2025-12-05 06:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_622888c0-24ad-5e73-9f41-e6c802ed4b38/622888c0-24ad-5e73-9f41-e6c802ed4b38_image_5.jpg HTTP/1.1" 201 0
2025-12-05 06:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa7fb15c8-a7e1-47df-a85f-4818aedca603_4.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a7fb15c8-a7e1-47df-a85f-4818aedca603_4.jpg saved to cache
2025-12-05 06:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 622888c0-24ad-5e73-9f41-e6c802ed4b38
2025-12-05 06:03:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c743f0df-abb5-55f2-a453-27adeb5870e3 with identifier: 2782744
2025-12-05 06:03:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c743f0df-abb5-55f2-a453-27adeb5870e3 with scrape type 2
2025-12-05 06:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c743f0df-abb5-55f2-a453-27adeb5870e3 with scrape type 2
2025-12-05 06:03:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: c743f0df-abb5-55f2-a453-27adeb5870e3, identifier: 2782744
2025-12-05 06:03:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341eb8d10>
2025-12-05 06:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_622888c0-24ad-5e73-9f41-e6c802ed4b38/622888c0-24ad-5e73-9f41-e6c802ed4b38_image_4.jpg HTTP/1.1" 201 0
2025-12-05 06:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa7fb15c8-a7e1-47df-a85f-4818aedca603_5.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a7fb15c8-a7e1-47df-a85f-4818aedca603_5.jpg saved to cache
2025-12-05 06:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 622888c0-24ad-5e73-9f41-e6c802ed4b38
2025-12-05 06:03:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234278c150>
2025-12-05 06:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_622888c0-24ad-5e73-9f41-e6c802ed4b38/622888c0-24ad-5e73-9f41-e6c802ed4b38_image_9.jpg HTTP/1.1" 201 0
2025-12-05 06:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa7fb15c8-a7e1-47df-a85f-4818aedca603_ext_2.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a7fb15c8-a7e1-47df-a85f-4818aedca603_ext_2.jpg saved to cache
2025-12-05 06:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 622888c0-24ad-5e73-9f41-e6c802ed4b38
2025-12-05 06:03:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425d5910>
2025-12-05 06:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_622888c0-24ad-5e73-9f41-e6c802ed4b38/622888c0-24ad-5e73-9f41-e6c802ed4b38_image_0.jpg HTTP/1.1" 201 0
2025-12-05 06:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa7fb15c8-a7e1-47df-a85f-4818aedca603_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a7fb15c8-a7e1-47df-a85f-4818aedca603_ext_7.jpg saved to cache
2025-12-05 06:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 622888c0-24ad-5e73-9f41-e6c802ed4b38
2025-12-05 06:03:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 622888c0-24ad-5e73-9f41-e6c802ed4b38, skipping ID generation
2025-12-05 06:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 622888c0-24ad-5e73-9f41-e6c802ed4b38 from tracking dictionaries
2025-12-05 06:03:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 622888c0-24ad-5e73-9f41-e6c802ed4b38 sending to next pipeline
2025-12-05 06:03:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 622888c0-24ad-5e73-9f41-e6c802ed4b38, identifier: 2550798
2025-12-05 06:03:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341566d10>
2025-12-05 06:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7b96404-71f7-50df-b780-712ffa99f849/c7b96404-71f7-50df-b780-712ffa99f849_image_17.jpg HTTP/1.1" 201 0
2025-12-05 06:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2414514-4007819-1003.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2414514-4007819-1003.jpg saved to cache
2025-12-05 06:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item c7b96404-71f7-50df-b780-712ffa99f849
2025-12-05 06:03:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: c743f0df-abb5-55f2-a453-27adeb5870e3 with identifier: 2782744
2025-12-05 06:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 06:03:01 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=GREY HTTP/1.1" 200 None
2025-12-05 06:03:02 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 06:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 06:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 06:03:02 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Electric HTTP/1.1" 200 None
2025-12-05 06:03:02 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 06:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 06:03:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: c743f0df-abb5-55f2-a453-27adeb5870e3 with identifier: 2782744
2025-12-05 06:03:02 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 0, 'seller_name': 'vauxhall motors limited', 'price_includes_vat': False, 'title': 'vauxhall corsa 100kw elite nav 50kwh 5dr auto [7.4kwch]', 'price': 0, 'currency': 'gbp', 'make': 'vauxhall', 'model': 'corsa', 'transmission': 'automatic', 'engine': '0.0l', 'fuel_type': 'electric', 'odometer': 51881, 'odometer_reading_unit': 'mi', 'registration_date': '2020-09-30', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/vauxhall/corsa?id=2782744', 'location': 'colchester', 'origin_country_code': 'gb', 'trim': '100kw elite nav 50kwh 5dr auto [7.4kwch]', 'license_plate': 'yp70ooh', 'year': 2020, 'listing': 'auction', 'c_o_2_emission_value': 0, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002782744-01975741-004.pdf', 'expiration_date': '2025-12-09t09:00:00z', 'is_vat_deductible': True, 'is_vat_included': False, 'id': 'c743f0df-abb5-55f2-a453-27adeb5870e3', 'current_year_diff': 5, 'age_in_months': 62, 'make_model': 'vauxhall corsa', 'sanitized_make': 'vauxhall', 'odometer_in_km': 83494} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 62,
     'auction_title': '',
     'c_o_2_emission_value': 0,
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002782744-01975741-004.pdf',
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 5,
     'engine': '0.0l',
     'expiration_date': '2025-12-09t09:00:00z',
     'fuel_type': 'electric',
     'id': 'c743f0df-abb5-55f2-a453-27adeb5870e3',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'yp70ooh',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/vauxhall/corsa?id=2782744',
     'listing': 'auction',
     'location': 'colchester',
     'make': 'vauxhall',
     'make_model': 'vauxhall corsa',
     'model': 'corsa',
     'odometer': 51881,
     'odometer_in_km': 83494,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2020-09-30',
     'sanitized_make': 'vauxhall',
     'seller_name': 'vauxhall motors limited',
     'title': 'vauxhall corsa 100kw elite nav 50kwh 5dr auto [7.4kwch]',
     'transmission': 'automatic',
     'trim': '100kw elite nav 50kwh 5dr auto [7.4kwch]',
     'year': 2020}
2025-12-05 06:03:02 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: c743f0df-abb5-55f2-a453-27adeb5870e3 spider: manheim.gb
2025-12-05 06:03:02 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: c743f0df-abb5-55f2-a453-27adeb5870e3 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 0, 'seller_name': 'vauxhall motors limited', 'price_includes_vat': False, 'title': 'vauxhall corsa 100kw elite nav 50kwh 5dr auto [7.4kwch]', 'price': 0, 'currency': 'gbp', 'make': 'vauxhall', 'model': 'corsa', 'transmission': 'automatic', 'engine': '0.0l', 'fuel_type': 'electric', 'odometer': 51881, 'odometer_reading_unit': 'mi', 'registration_date': '2020-09-30', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/vauxhall/corsa?id=2782744', 'location': 'colchester', 'origin_country_code': 'gb', 'trim': '100kw elite nav 50kwh 5dr auto [7.4kwch]', 'license_plate': 'yp70ooh', 'year': 2020, 'listing': 'auction', 'c_o_2_emission_value': 0, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002782744-01975741-004.pdf', 'expiration_date': '2025-12-09t09:00:00z', 'is_vat_deductible': True, 'is_vat_included': False, 'id': 'c743f0df-abb5-55f2-a453-27adeb5870e3', 'current_year_diff': 5, 'age_in_months': 62, 'make_model': 'vauxhall corsa', 'sanitized_make': 'vauxhall', 'odometer_in_km': 83494} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 62,
     'auction_title': '',
     'c_o_2_emission_value': 0,
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002782744-01975741-004.pdf',
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 5,
     'engine': '0.0l',
     'expiration_date': '2025-12-09t09:00:00z',
     'fuel_type': 'electric',
     'id': 'c743f0df-abb5-55f2-a453-27adeb5870e3',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'yp70ooh',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/vauxhall/corsa?id=2782744',
     'listing': 'auction',
     'location': 'colchester',
     'make': 'vauxhall',
     'make_model': 'vauxhall corsa',
     'model': 'corsa',
     'odometer': 51881,
     'odometer_in_km': 83494,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2020-09-30',
     'sanitized_make': 'vauxhall',
     'seller_name': 'vauxhall motors limited',
     'title': 'vauxhall corsa 100kw elite nav 50kwh 5dr auto [7.4kwch]',
     'transmission': 'automatic',
     'trim': '100kw elite nav 50kwh 5dr auto [7.4kwch]',
     'year': 2020}
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002782744-01975741-004.pdf',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '0.0L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Electric',
 'id': 'c743f0df-abb5-55f2-a453-27adeb5870e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'YP70OOH',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VAUXHALL/CORSA?id=2782744',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'VAUXHALL',
 'model': 'CORSA',
 'odometer': 51881,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-30',
 'seller_name': 'Vauxhall Motors Limited',
 'title': 'VAUXHALL CORSA 100kW Elite Nav 50kWh 5dr Auto [7.4kWCh]',
 'transmission': 'automatic',
 'trim': '100kW Elite Nav 50kWh 5dr Auto [7.4kWCh]',
 'year': 2020}
2025-12-05 06:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272782744%27 HTTP/1.1" 200 None
2025-12-05 06:03:02 [manheim.gb] INFO: Saving data for 2782744: {'auction_closing_time': 1765270800.0, 'created_time': 1764792527.570538, 'last_price_update_time': 1764914582.413177}
2025-12-05 06:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2782744') HTTP/1.1" 204 0
2025-12-05 06:03:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 622888c0-24ad-5e73-9f41-e6c802ed4b38 with identifier: 2550798
2025-12-05 06:03:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 622888c0-24ad-5e73-9f41-e6c802ed4b38 with identifier: 2550798
2025-12-05 06:03:02 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 10 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    10
2025-12-05 06:03:02 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: 622888c0-24ad-5e73-9f41-e6c802ed4b38 spider: manheim.gb
2025-12-05 06:03:02 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 622888c0-24ad-5e73-9f41-e6c802ed4b38 due to rule: registration_date_old.json, error: 10 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    10
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_622888c0-24ad-5e73-9f41-e6c802ed4b38/622888c0-24ad-5e73-9f41-e6c802ed4b38_expert_report_file_2f9a426b-b0fe-45bf-8322-9edee9daa6b9.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002550798-01506735-004.pdf',
 'color': 'SILVER',
 'currency': 'GBP',
 'engine': '3.0L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '622888c0-24ad-5e73-9f41-e6c802ed4b38',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'SB15KCU',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/S%20CLASS?id=2550798',
 'listing': 'auction',
 'location': 'Bristol',
 'make': 'MERCEDES-BENZ',
 'model': 'S CLASS',
 'odometer': 999,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 25,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_622888c0-24ad-5e73-9f41-e6c802ed4b38/622888c0-24ad-5e73-9f41-e6c802ed4b38_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 207206,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a7fb15c8-a7e1-47df-a85f-4818aedca603_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_622888c0-24ad-5e73-9f41-e6c802ed4b38/622888c0-24ad-5e73-9f41-e6c802ed4b38_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 207206,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a7fb15c8-a7e1-47df-a85f-4818aedca603_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_622888c0-24ad-5e73-9f41-e6c802ed4b38/622888c0-24ad-5e73-9f41-e6c802ed4b38_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 236670,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a7fb15c8-a7e1-47df-a85f-4818aedca603_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_622888c0-24ad-5e73-9f41-e6c802ed4b38/622888c0-24ad-5e73-9f41-e6c802ed4b38_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 210617,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a7fb15c8-a7e1-47df-a85f-4818aedca603_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_622888c0-24ad-5e73-9f41-e6c802ed4b38/622888c0-24ad-5e73-9f41-e6c802ed4b38_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 214272,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a7fb15c8-a7e1-47df-a85f-4818aedca603_5.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_622888c0-24ad-5e73-9f41-e6c802ed4b38/622888c0-24ad-5e73-9f41-e6c802ed4b38_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 200139,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a7fb15c8-a7e1-47df-a85f-4818aedca603_4.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_622888c0-24ad-5e73-9f41-e6c802ed4b38/622888c0-24ad-5e73-9f41-e6c802ed4b38_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 201431,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a7fb15c8-a7e1-47df-a85f-4818aedca603_11.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_622888c0-24ad-5e73-9f41-e6c802ed4b38/622888c0-24ad-5e73-9f41-e6c802ed4b38_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 198404,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a7fb15c8-a7e1-47df-a85f-4818aedca603_10.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_622888c0-24ad-5e73-9f41-e6c802ed4b38/622888c0-24ad-5e73-9f41-e6c802ed4b38_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 205797,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a7fb15c8-a7e1-47df-a85f-4818aedca603_9.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_622888c0-24ad-5e73-9f41-e6c802ed4b38/622888c0-24ad-5e73-9f41-e6c802ed4b38_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 240531,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a7fb15c8-a7e1-47df-a85f-4818aedca603_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_622888c0-24ad-5e73-9f41-e6c802ed4b38/622888c0-24ad-5e73-9f41-e6c802ed4b38_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 215824,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a7fb15c8-a7e1-47df-a85f-4818aedca603_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_622888c0-24ad-5e73-9f41-e6c802ed4b38/622888c0-24ad-5e73-9f41-e6c802ed4b38_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 213935,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a7fb15c8-a7e1-47df-a85f-4818aedca603_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_622888c0-24ad-5e73-9f41-e6c802ed4b38/622888c0-24ad-5e73-9f41-e6c802ed4b38_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 215448,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a7fb15c8-a7e1-47df-a85f-4818aedca603_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_622888c0-24ad-5e73-9f41-e6c802ed4b38/622888c0-24ad-5e73-9f41-e6c802ed4b38_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 410003,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2550798-3435552-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_622888c0-24ad-5e73-9f41-e6c802ed4b38/622888c0-24ad-5e73-9f41-e6c802ed4b38_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 321056,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2550798-3435552-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_622888c0-24ad-5e73-9f41-e6c802ed4b38/622888c0-24ad-5e73-9f41-e6c802ed4b38_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 528345,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2550798-3435552-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_622888c0-24ad-5e73-9f41-e6c802ed4b38/622888c0-24ad-5e73-9f41-e6c802ed4b38_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 238009,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2550798-3435552-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_622888c0-24ad-5e73-9f41-e6c802ed4b38/622888c0-24ad-5e73-9f41-e6c802ed4b38_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 286035,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2550798-3435552-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_622888c0-24ad-5e73-9f41-e6c802ed4b38/622888c0-24ad-5e73-9f41-e6c802ed4b38_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 384224,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2550798-3435552-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_622888c0-24ad-5e73-9f41-e6c802ed4b38/622888c0-24ad-5e73-9f41-e6c802ed4b38_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 249410,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2550798-3435552-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-28',
 'seller_name': 'MotoNovo Finance',
 'title': 'MERCEDES-BENZ S CLASS S350 BlueTEC AMG Line 4dr Auto',
 'transmission': 'automatic',
 'trim': 'S350 BlueTEC AMG Line 4dr Auto',
 'year': 2015}
2025-12-05 06:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272550798%27 HTTP/1.1" 200 None
2025-12-05 06:03:02 [manheim.gb] INFO: Saving data for 2550798: {'created_time': 1764914582.703564, 'last_price_update_time': 1764914582.703577, 'auction_closing_time': 1765270800.0}
2025-12-05 06:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2550798') HTTP/1.1" 204 0
2025-12-05 06:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2414514-4007819-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002414514-01986790-002.pdf)
2025-12-05 06:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2414514-4007819-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002414514-01986790-002.pdf)
2025-12-05 06:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/GOLF?id=3352809&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233352809&indx=199> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2414514-4007819-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002414514-01986790-002.pdf)
2025-12-05 06:03:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/621dbea7-ff44-4a68-8943-006ce584aa7e_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002414514-01986790-002.pdf)
2025-12-05 06:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2414514-4007819-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002414514-01986790-002.pdf)
2025-12-05 06:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/621dbea7-ff44-4a68-8943-006ce584aa7e_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002414514-01986790-002.pdf)
2025-12-05 06:03:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341f23410>
2025-12-05 06:03:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7b96404-71f7-50df-b780-712ffa99f849/c7b96404-71f7-50df-b780-712ffa99f849_image_15.jpg HTTP/1.1" 201 0
2025-12-05 06:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2414514-4007819-1001.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2414514-4007819-1001.jpg saved to cache
2025-12-05 06:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item c7b96404-71f7-50df-b780-712ffa99f849
2025-12-05 06:03:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234243de50>
2025-12-05 06:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7b96404-71f7-50df-b780-712ffa99f849/c7b96404-71f7-50df-b780-712ffa99f849_image_16.jpg HTTP/1.1" 201 0
2025-12-05 06:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2414514-4007819-1002.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2414514-4007819-1002.jpg saved to cache
2025-12-05 06:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item c7b96404-71f7-50df-b780-712ffa99f849
2025-12-05 06:03:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef9360e8-6e2c-53eb-a409-a33f5917abcf with identifier: 3352809
2025-12-05 06:03:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef9360e8-6e2c-53eb-a409-a33f5917abcf with scrape type 2
2025-12-05 06:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef9360e8-6e2c-53eb-a409-a33f5917abcf with scrape type 2
2025-12-05 06:03:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: ef9360e8-6e2c-53eb-a409-a33f5917abcf, identifier: 3352809
2025-12-05 06:03:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341f23910>
2025-12-05 06:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7b96404-71f7-50df-b780-712ffa99f849/c7b96404-71f7-50df-b780-712ffa99f849_image_14.jpg HTTP/1.1" 201 0
2025-12-05 06:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2414514-4007819-1000.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2414514-4007819-1000.jpg saved to cache
2025-12-05 06:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item c7b96404-71f7-50df-b780-712ffa99f849
2025-12-05 06:03:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23426afa10>
2025-12-05 06:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7b96404-71f7-50df-b780-712ffa99f849/c7b96404-71f7-50df-b780-712ffa99f849_image_12.jpg HTTP/1.1" 201 0
2025-12-05 06:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F621dbea7-ff44-4a68-8943-006ce584aa7e_ext_4.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/621dbea7-ff44-4a68-8943-006ce584aa7e_ext_4.jpg saved to cache
2025-12-05 06:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item c7b96404-71f7-50df-b780-712ffa99f849
2025-12-05 06:03:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342398590>
2025-12-05 06:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7b96404-71f7-50df-b780-712ffa99f849/c7b96404-71f7-50df-b780-712ffa99f849_image_13.jpg HTTP/1.1" 201 0
2025-12-05 06:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2414514-4007819-13.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2414514-4007819-13.jpg saved to cache
2025-12-05 06:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item c7b96404-71f7-50df-b780-712ffa99f849
2025-12-05 06:03:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23428fec50>
2025-12-05 06:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7b96404-71f7-50df-b780-712ffa99f849/c7b96404-71f7-50df-b780-712ffa99f849_image_11.jpg HTTP/1.1" 201 0
2025-12-05 06:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F621dbea7-ff44-4a68-8943-006ce584aa7e_ext_3.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/621dbea7-ff44-4a68-8943-006ce584aa7e_ext_3.jpg saved to cache
2025-12-05 06:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item c7b96404-71f7-50df-b780-712ffa99f849
2025-12-05 06:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/621dbea7-ff44-4a68-8943-006ce584aa7e_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002414514-01986790-002.pdf)
2025-12-05 06:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/621dbea7-ff44-4a68-8943-006ce584aa7e_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002414514-01986790-002.pdf)
2025-12-05 06:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/621dbea7-ff44-4a68-8943-006ce584aa7e_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002414514-01986790-002.pdf)
2025-12-05 06:03:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: ef9360e8-6e2c-53eb-a409-a33f5917abcf with identifier: 3352809
2025-12-05 06:03:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: ef9360e8-6e2c-53eb-a409-a33f5917abcf with identifier: 3352809
2025-12-05 06:03:05 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: ef9360e8-6e2c-53eb-a409-a33f5917abcf with identifier: 3352809 to the API
2025-12-05 06:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 06:03:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 06:03:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/GOLF?id=3352809&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233352809&indx=199>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003352809-01948041-004.pdf',
 'color': 'SILVER',
 'currency': 'GBP',
 'engine': '1.5L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'ef9360e8-6e2c-53eb-a409-a33f5917abcf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'GD21MLN',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/GOLF?id=3352809',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF',
 'odometer': 62429,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-24',
 'seller_name': 'Startline Motor Finance',
 'title': 'VOLKSWAGEN GOLF 1.5 TSI Life 5dr',
 'transmission': 'manual',
 'trim': '1.5 TSI Life 5dr',
 'year': 2021}
2025-12-05 06:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273352809%27 HTTP/1.1" 200 None
2025-12-05 06:03:05 [manheim.gb] INFO: Saving data for 3352809: {'auction_closing_time': 1765270800.0, 'created_time': 1764792277.785587, 'last_price_update_time': 1764914585.843026}
2025-12-05 06:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3352809') HTTP/1.1" 204 0
2025-12-05 06:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/621dbea7-ff44-4a68-8943-006ce584aa7e_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002414514-01986790-002.pdf)
2025-12-05 06:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/621dbea7-ff44-4a68-8943-006ce584aa7e_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002414514-01986790-002.pdf)
2025-12-05 06:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/621dbea7-ff44-4a68-8943-006ce584aa7e_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002414514-01986790-002.pdf)
2025-12-05 06:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/621dbea7-ff44-4a68-8943-006ce584aa7e_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002414514-01986790-002.pdf)
2025-12-05 06:03:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23423a8dd0>
2025-12-05 06:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7b96404-71f7-50df-b780-712ffa99f849/c7b96404-71f7-50df-b780-712ffa99f849_image_6.jpg HTTP/1.1" 201 0
2025-12-05 06:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F621dbea7-ff44-4a68-8943-006ce584aa7e_11.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/621dbea7-ff44-4a68-8943-006ce584aa7e_11.jpg saved to cache
2025-12-05 06:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c7b96404-71f7-50df-b780-712ffa99f849
2025-12-05 06:03:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23423a3c50>
2025-12-05 06:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7b96404-71f7-50df-b780-712ffa99f849/c7b96404-71f7-50df-b780-712ffa99f849_image_8.jpg HTTP/1.1" 201 0
2025-12-05 06:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F621dbea7-ff44-4a68-8943-006ce584aa7e_9.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/621dbea7-ff44-4a68-8943-006ce584aa7e_9.jpg saved to cache
2025-12-05 06:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c7b96404-71f7-50df-b780-712ffa99f849
2025-12-05 06:03:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234237cfd0>
2025-12-05 06:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 06:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7b96404-71f7-50df-b780-712ffa99f849/c7b96404-71f7-50df-b780-712ffa99f849_image_4.jpg HTTP/1.1" 201 0
2025-12-05 06:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F621dbea7-ff44-4a68-8943-006ce584aa7e_5.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/621dbea7-ff44-4a68-8943-006ce584aa7e_5.jpg saved to cache
2025-12-05 06:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c7b96404-71f7-50df-b780-712ffa99f849
2025-12-05 06:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/621dbea7-ff44-4a68-8943-006ce584aa7e_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002414514-01986790-002.pdf)
2025-12-05 06:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/621dbea7-ff44-4a68-8943-006ce584aa7e_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002414514-01986790-002.pdf)
2025-12-05 06:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/621dbea7-ff44-4a68-8943-006ce584aa7e_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002414514-01986790-002.pdf)
2025-12-05 06:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2408993-4008436-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002408993-01992203-003.pdf)
2025-12-05 06:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2408993-4008436-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002408993-01992203-003.pdf)
2025-12-05 06:03:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342660d10>
2025-12-05 06:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7b96404-71f7-50df-b780-712ffa99f849/c7b96404-71f7-50df-b780-712ffa99f849_image_7.jpg HTTP/1.1" 201 0
2025-12-05 06:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F621dbea7-ff44-4a68-8943-006ce584aa7e_10.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/621dbea7-ff44-4a68-8943-006ce584aa7e_10.jpg saved to cache
2025-12-05 06:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c7b96404-71f7-50df-b780-712ffa99f849
2025-12-05 06:03:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23424c4d90>
2025-12-05 06:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7b96404-71f7-50df-b780-712ffa99f849/c7b96404-71f7-50df-b780-712ffa99f849_image_9.jpg HTTP/1.1" 201 0
2025-12-05 06:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F621dbea7-ff44-4a68-8943-006ce584aa7e_ext_2.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/621dbea7-ff44-4a68-8943-006ce584aa7e_ext_2.jpg saved to cache
2025-12-05 06:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c7b96404-71f7-50df-b780-712ffa99f849
2025-12-05 06:03:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342672450>
2025-12-05 06:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7b96404-71f7-50df-b780-712ffa99f849/c7b96404-71f7-50df-b780-712ffa99f849_image_10.jpg HTTP/1.1" 201 0
2025-12-05 06:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F621dbea7-ff44-4a68-8943-006ce584aa7e_ext_5.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/621dbea7-ff44-4a68-8943-006ce584aa7e_ext_5.jpg saved to cache
2025-12-05 06:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item c7b96404-71f7-50df-b780-712ffa99f849
2025-12-05 06:03:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23426f4850>
2025-12-05 06:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7b96404-71f7-50df-b780-712ffa99f849/c7b96404-71f7-50df-b780-712ffa99f849_image_5.jpg HTTP/1.1" 201 0
2025-12-05 06:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F621dbea7-ff44-4a68-8943-006ce584aa7e_4.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/621dbea7-ff44-4a68-8943-006ce584aa7e_4.jpg saved to cache
2025-12-05 06:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c7b96404-71f7-50df-b780-712ffa99f849
2025-12-05 06:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/621dbea7-ff44-4a68-8943-006ce584aa7e_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002414514-01986790-002.pdf)
2025-12-05 06:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2408993-4008436-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002408993-01992203-003.pdf)
2025-12-05 06:03:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425c78d0>
2025-12-05 06:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7b96404-71f7-50df-b780-712ffa99f849/c7b96404-71f7-50df-b780-712ffa99f849_image_3.jpg HTTP/1.1" 201 0
2025-12-05 06:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F621dbea7-ff44-4a68-8943-006ce584aa7e_ext_1.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/621dbea7-ff44-4a68-8943-006ce584aa7e_ext_1.jpg saved to cache
2025-12-05 06:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c7b96404-71f7-50df-b780-712ffa99f849
2025-12-05 06:03:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23426e8690>
2025-12-05 06:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7b96404-71f7-50df-b780-712ffa99f849/c7b96404-71f7-50df-b780-712ffa99f849_image_0.jpg HTTP/1.1" 201 0
2025-12-05 06:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F621dbea7-ff44-4a68-8943-006ce584aa7e_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/621dbea7-ff44-4a68-8943-006ce584aa7e_ext_7.jpg saved to cache
2025-12-05 06:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c7b96404-71f7-50df-b780-712ffa99f849
2025-12-05 06:03:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341ecb6d0>
2025-12-05 06:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 06:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7b96404-71f7-50df-b780-712ffa99f849/c7b96404-71f7-50df-b780-712ffa99f849_image_1.jpg HTTP/1.1" 201 0
2025-12-05 06:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F621dbea7-ff44-4a68-8943-006ce584aa7e_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/621dbea7-ff44-4a68-8943-006ce584aa7e_ext_7.jpg saved to cache
2025-12-05 06:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c7b96404-71f7-50df-b780-712ffa99f849
2025-12-05 06:03:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23423b1250>
2025-12-05 06:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827/5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827_image_15.jpg HTTP/1.1" 201 0
2025-12-05 06:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2408993-4008436-1001.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2408993-4008436-1001.jpg saved to cache
2025-12-05 06:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827
2025-12-05 06:03:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341ee6fd0>
2025-12-05 06:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827/5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827_image_16.jpg HTTP/1.1" 201 0
2025-12-05 06:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2408993-4008436-1002.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2408993-4008436-1002.jpg saved to cache
2025-12-05 06:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827
2025-12-05 06:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8f3caae0-90d7-4ece-971c-baf294ce6d68_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002408993-01992203-003.pdf)
2025-12-05 06:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8f3caae0-90d7-4ece-971c-baf294ce6d68_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002408993-01992203-003.pdf)
2025-12-05 06:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8f3caae0-90d7-4ece-971c-baf294ce6d68_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002408993-01992203-003.pdf)
2025-12-05 06:03:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342742fd0>
2025-12-05 06:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7b96404-71f7-50df-b780-712ffa99f849/c7b96404-71f7-50df-b780-712ffa99f849_image_2.jpg HTTP/1.1" 201 0
2025-12-05 06:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F621dbea7-ff44-4a68-8943-006ce584aa7e_ext_6.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/621dbea7-ff44-4a68-8943-006ce584aa7e_ext_6.jpg saved to cache
2025-12-05 06:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c7b96404-71f7-50df-b780-712ffa99f849
2025-12-05 06:03:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c7b96404-71f7-50df-b780-712ffa99f849, skipping ID generation
2025-12-05 06:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Removing item c7b96404-71f7-50df-b780-712ffa99f849 from tracking dictionaries
2025-12-05 06:03:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c7b96404-71f7-50df-b780-712ffa99f849 sending to next pipeline
2025-12-05 06:03:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: c7b96404-71f7-50df-b780-712ffa99f849, identifier: 2414514
2025-12-05 06:03:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234238b150>
2025-12-05 06:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827/5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827_image_14.jpg HTTP/1.1" 201 0
2025-12-05 06:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2408993-4008436-1000.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2408993-4008436-1000.jpg saved to cache
2025-12-05 06:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827
2025-12-05 06:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2408993-4008436-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002408993-01992203-003.pdf)
2025-12-05 06:03:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: c7b96404-71f7-50df-b780-712ffa99f849 with identifier: 2414514
2025-12-05 06:03:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: c7b96404-71f7-50df-b780-712ffa99f849 with identifier: 2414514
2025-12-05 06:03:10 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 180500 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    180500
2025-12-05 06:03:10 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: c7b96404-71f7-50df-b780-712ffa99f849 spider: manheim.gb
2025-12-05 06:03:10 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: c7b96404-71f7-50df-b780-712ffa99f849 due to rule: high_mileage_for_country.json, error: 180500 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    180500
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b96404-71f7-50df-b780-712ffa99f849/c7b96404-71f7-50df-b780-712ffa99f849_expert_report_file_c6605ba4-6448-4018-bdf4-09c367f134ef.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002414514-01986790-002.pdf',
 'color': 'Red',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': '2025-12-11T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'c7b96404-71f7-50df-b780-712ffa99f849',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'VO12LFA',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=2414514',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 112158,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 46,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b96404-71f7-50df-b780-712ffa99f849/c7b96404-71f7-50df-b780-712ffa99f849_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 172197,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/621dbea7-ff44-4a68-8943-006ce584aa7e_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b96404-71f7-50df-b780-712ffa99f849/c7b96404-71f7-50df-b780-712ffa99f849_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 172197,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/621dbea7-ff44-4a68-8943-006ce584aa7e_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b96404-71f7-50df-b780-712ffa99f849/c7b96404-71f7-50df-b780-712ffa99f849_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 265478,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/621dbea7-ff44-4a68-8943-006ce584aa7e_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b96404-71f7-50df-b780-712ffa99f849/c7b96404-71f7-50df-b780-712ffa99f849_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 147493,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/621dbea7-ff44-4a68-8943-006ce584aa7e_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b96404-71f7-50df-b780-712ffa99f849/c7b96404-71f7-50df-b780-712ffa99f849_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 163071,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/621dbea7-ff44-4a68-8943-006ce584aa7e_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b96404-71f7-50df-b780-712ffa99f849/c7b96404-71f7-50df-b780-712ffa99f849_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 160959,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/621dbea7-ff44-4a68-8943-006ce584aa7e_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b96404-71f7-50df-b780-712ffa99f849/c7b96404-71f7-50df-b780-712ffa99f849_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 168817,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/621dbea7-ff44-4a68-8943-006ce584aa7e_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b96404-71f7-50df-b780-712ffa99f849/c7b96404-71f7-50df-b780-712ffa99f849_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 162412,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/621dbea7-ff44-4a68-8943-006ce584aa7e_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b96404-71f7-50df-b780-712ffa99f849/c7b96404-71f7-50df-b780-712ffa99f849_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 169399,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/621dbea7-ff44-4a68-8943-006ce584aa7e_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b96404-71f7-50df-b780-712ffa99f849/c7b96404-71f7-50df-b780-712ffa99f849_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 269141,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/621dbea7-ff44-4a68-8943-006ce584aa7e_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b96404-71f7-50df-b780-712ffa99f849/c7b96404-71f7-50df-b780-712ffa99f849_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 282624,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/621dbea7-ff44-4a68-8943-006ce584aa7e_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b96404-71f7-50df-b780-712ffa99f849/c7b96404-71f7-50df-b780-712ffa99f849_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 336744,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/621dbea7-ff44-4a68-8943-006ce584aa7e_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b96404-71f7-50df-b780-712ffa99f849/c7b96404-71f7-50df-b780-712ffa99f849_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 282739,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/621dbea7-ff44-4a68-8943-006ce584aa7e_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b96404-71f7-50df-b780-712ffa99f849/c7b96404-71f7-50df-b780-712ffa99f849_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 412146,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2414514-4007819-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b96404-71f7-50df-b780-712ffa99f849/c7b96404-71f7-50df-b780-712ffa99f849_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 208669,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2414514-4007819-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b96404-71f7-50df-b780-712ffa99f849/c7b96404-71f7-50df-b780-712ffa99f849_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 162725,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2414514-4007819-1001.jpg',
             'Width': 749},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b96404-71f7-50df-b780-712ffa99f849/c7b96404-71f7-50df-b780-712ffa99f849_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 181825,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2414514-4007819-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b96404-71f7-50df-b780-712ffa99f849/c7b96404-71f7-50df-b780-712ffa99f849_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 196788,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2414514-4007819-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b96404-71f7-50df-b780-712ffa99f849/c7b96404-71f7-50df-b780-712ffa99f849_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 403307,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2414514-4007819-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b96404-71f7-50df-b780-712ffa99f849/c7b96404-71f7-50df-b780-712ffa99f849_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 370976,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2414514-4007819-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-03',
 'seller_name': 'Lookers',
 'title': 'NISSAN QASHQAI 1.6 [117] N-Tec+ 5dr',
 'transmission': 'manual',
 'trim': '1.6 [117] N-Tec+ 5dr',
 'year': 2012}
2025-12-05 06:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272414514%27 HTTP/1.1" 200 None
2025-12-05 06:03:10 [manheim.gb] INFO: Saving data for 2414514: {'created_time': 1764914590.646073, 'last_price_update_time': 1764914590.646084, 'auction_closing_time': 1765443600.0}
2025-12-05 06:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2414514') HTTP/1.1" 204 0
2025-12-05 06:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=3348750&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233348750&indx=198> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:03:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342662f90>
2025-12-05 06:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827/5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827_image_12.jpg HTTP/1.1" 201 0
2025-12-05 06:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8f3caae0-90d7-4ece-971c-baf294ce6d68_ext_4.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8f3caae0-90d7-4ece-971c-baf294ce6d68_ext_4.jpg saved to cache
2025-12-05 06:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827
2025-12-05 06:03:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23426f6e10>
2025-12-05 06:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827/5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827_image_11.jpg HTTP/1.1" 201 0
2025-12-05 06:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8f3caae0-90d7-4ece-971c-baf294ce6d68_ext_3.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8f3caae0-90d7-4ece-971c-baf294ce6d68_ext_3.jpg saved to cache
2025-12-05 06:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827
2025-12-05 06:03:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342673e10>
2025-12-05 06:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827/5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827_image_10.jpg HTTP/1.1" 201 0
2025-12-05 06:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8f3caae0-90d7-4ece-971c-baf294ce6d68_ext_5.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8f3caae0-90d7-4ece-971c-baf294ce6d68_ext_5.jpg saved to cache
2025-12-05 06:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827
2025-12-05 06:03:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23424c6e50>
2025-12-05 06:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827/5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827_image_13.jpg HTTP/1.1" 201 0
2025-12-05 06:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2408993-4008436-13.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2408993-4008436-13.jpg saved to cache
2025-12-05 06:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827
2025-12-05 06:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8f3caae0-90d7-4ece-971c-baf294ce6d68_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002408993-01992203-003.pdf)
2025-12-05 06:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8f3caae0-90d7-4ece-971c-baf294ce6d68_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002408993-01992203-003.pdf)
2025-12-05 06:03:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:03:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a1e9cd4-da87-5efc-9341-2262da8a894b with identifier: 3348750
2025-12-05 06:03:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a1e9cd4-da87-5efc-9341-2262da8a894b with scrape type 2
2025-12-05 06:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a1e9cd4-da87-5efc-9341-2262da8a894b with scrape type 2
2025-12-05 06:03:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 0a1e9cd4-da87-5efc-9341-2262da8a894b, identifier: 3348750
2025-12-05 06:03:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 0a1e9cd4-da87-5efc-9341-2262da8a894b with identifier: 3348750
2025-12-05 06:03:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 0a1e9cd4-da87-5efc-9341-2262da8a894b with identifier: 3348750
2025-12-05 06:03:12 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 0a1e9cd4-da87-5efc-9341-2262da8a894b with identifier: 3348750 to the API
2025-12-05 06:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 06:03:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 06:03:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=3348750&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233348750&indx=198>
{'auction_title': '',
 'c_o_2_emission_value': 145,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003348750-01988701-002.pdf',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '1.3L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '0a1e9cd4-da87-5efc-9341-2262da8a894b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'FN70OZW',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=3348750',
 'listing': 'auction',
 'location': 'Leeds',
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 11895,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-30',
 'seller_name': 'Mobilize Financial Services',
 'title': 'NISSAN QASHQAI 1.3 DiG-T N-Connecta 5dr [Glass Roof Pack]',
 'transmission': 'manual',
 'trim': '1.3 DiG-T N-Connecta 5dr [Glass Roof Pack]',
 'year': 2020}
2025-12-05 06:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273348750%27 HTTP/1.1" 200 None
2025-12-05 06:03:12 [manheim.gb] INFO: Saving data for 3348750: {'auction_closing_time': 1765184400.0, 'created_time': 1764792300.379537, 'last_price_update_time': 1764914592.393716}
2025-12-05 06:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3348750') HTTP/1.1" 204 0
2025-12-05 06:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8f3caae0-90d7-4ece-971c-baf294ce6d68_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002408993-01992203-003.pdf)
2025-12-05 06:03:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342777a10>
2025-12-05 06:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827/5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827_image_9.jpg HTTP/1.1" 201 0
2025-12-05 06:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8f3caae0-90d7-4ece-971c-baf294ce6d68_ext_2.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8f3caae0-90d7-4ece-971c-baf294ce6d68_ext_2.jpg saved to cache
2025-12-05 06:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827
2025-12-05 06:03:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234266ae90>
2025-12-05 06:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827/5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827_image_8.jpg HTTP/1.1" 201 0
2025-12-05 06:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8f3caae0-90d7-4ece-971c-baf294ce6d68_9.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8f3caae0-90d7-4ece-971c-baf294ce6d68_9.jpg saved to cache
2025-12-05 06:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827
2025-12-05 06:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8f3caae0-90d7-4ece-971c-baf294ce6d68_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002408993-01992203-003.pdf)
2025-12-05 06:03:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341edbcd0>
2025-12-05 06:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827/5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827_image_7.jpg HTTP/1.1" 201 0
2025-12-05 06:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8f3caae0-90d7-4ece-971c-baf294ce6d68_10.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8f3caae0-90d7-4ece-971c-baf294ce6d68_10.jpg saved to cache
2025-12-05 06:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827
2025-12-05 06:03:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234253fc50>
2025-12-05 06:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827/5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827_image_6.jpg HTTP/1.1" 201 0
2025-12-05 06:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8f3caae0-90d7-4ece-971c-baf294ce6d68_11.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8f3caae0-90d7-4ece-971c-baf294ce6d68_11.jpg saved to cache
2025-12-05 06:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827
2025-12-05 06:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8f3caae0-90d7-4ece-971c-baf294ce6d68_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002408993-01992203-003.pdf)
2025-12-05 06:03:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341ed97d0>
2025-12-05 06:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827/5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827_image_5.jpg HTTP/1.1" 201 0
2025-12-05 06:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8f3caae0-90d7-4ece-971c-baf294ce6d68_4.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8f3caae0-90d7-4ece-971c-baf294ce6d68_4.jpg saved to cache
2025-12-05 06:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827
2025-12-05 06:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8f3caae0-90d7-4ece-971c-baf294ce6d68_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002408993-01992203-003.pdf)
2025-12-05 06:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/CLA?id=3346181&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233346181&indx=197> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:03:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:03:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341ec3e50>
2025-12-05 06:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827/5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827_image_4.jpg HTTP/1.1" 201 0
2025-12-05 06:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8f3caae0-90d7-4ece-971c-baf294ce6d68_5.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8f3caae0-90d7-4ece-971c-baf294ce6d68_5.jpg saved to cache
2025-12-05 06:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827
2025-12-05 06:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8f3caae0-90d7-4ece-971c-baf294ce6d68_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002408993-01992203-003.pdf)
2025-12-05 06:03:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74045680-8653-589c-9531-45230465fc45 with identifier: 3346181
2025-12-05 06:03:14 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 74045680-8653-589c-9531-45230465fc45
2025-12-05 06:03:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425f1c50>
2025-12-05 06:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827/5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827_image_3.jpg HTTP/1.1" 201 0
2025-12-05 06:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8f3caae0-90d7-4ece-971c-baf294ce6d68_ext_1.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8f3caae0-90d7-4ece-971c-baf294ce6d68_ext_1.jpg saved to cache
2025-12-05 06:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827
2025-12-05 06:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/refine> (referer: https://www.manheim.co.uk/search) ['zyte-api']
2025-12-05 06:03:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:03:17 [manheim.gb] INFO: Found listing with ID: 3784865
2025-12-05 06:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273784865%27 HTTP/1.1" 200 None
2025-12-05 06:03:17 [manheim.gb] INFO: Scrape type for 3784865: 1
2025-12-05 06:03:17 [manheim.gb] INFO: Found listing with ID: 3786170
2025-12-05 06:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273786170%27 HTTP/1.1" 200 None
2025-12-05 06:03:17 [manheim.gb] INFO: Scrape type for 3786170: 1
2025-12-05 06:03:17 [manheim.gb] INFO: Found listing with ID: 3787547
2025-12-05 06:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273787547%27 HTTP/1.1" 200 None
2025-12-05 06:03:17 [manheim.gb] INFO: Scrape type for 3787547: 1
2025-12-05 06:03:17 [manheim.gb] INFO: Found listing with ID: 3787909
2025-12-05 06:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273787909%27 HTTP/1.1" 200 None
2025-12-05 06:03:17 [manheim.gb] INFO: Scrape type for 3787909: 1
2025-12-05 06:03:17 [manheim.gb] INFO: Found listing with ID: 3790913
2025-12-05 06:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273790913%27 HTTP/1.1" 200 None
2025-12-05 06:03:17 [manheim.gb] INFO: Scrape type for 3790913: 1
2025-12-05 06:03:17 [manheim.gb] INFO: Found listing with ID: 3791288
2025-12-05 06:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273791288%27 HTTP/1.1" 200 None
2025-12-05 06:03:17 [manheim.gb] INFO: Scrape type for 3791288: 1
2025-12-05 06:03:17 [manheim.gb] INFO: Found listing with ID: 3794180
2025-12-05 06:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273794180%27 HTTP/1.1" 200 None
2025-12-05 06:03:17 [manheim.gb] INFO: Scrape type for 3794180: 1
2025-12-05 06:03:17 [manheim.gb] INFO: Found listing with ID: 3795778
2025-12-05 06:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273795778%27 HTTP/1.1" 200 None
2025-12-05 06:03:17 [manheim.gb] INFO: Scrape type for 3795778: 1
2025-12-05 06:03:17 [manheim.gb] INFO: Found listing with ID: 3805780
2025-12-05 06:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273805780%27 HTTP/1.1" 200 None
2025-12-05 06:03:17 [manheim.gb] INFO: Scrape type for 3805780: 1
2025-12-05 06:03:17 [manheim.gb] INFO: Found listing with ID: 3805781
2025-12-05 06:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273805781%27 HTTP/1.1" 200 None
2025-12-05 06:03:17 [manheim.gb] INFO: Scrape type for 3805781: 1
2025-12-05 06:03:17 [manheim.gb] INFO: Found listing with ID: 3805802
2025-12-05 06:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273805802%27 HTTP/1.1" 200 None
2025-12-05 06:03:17 [manheim.gb] INFO: Scrape type for 3805802: 1
2025-12-05 06:03:17 [manheim.gb] INFO: Found listing with ID: 3809067
2025-12-05 06:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273809067%27 HTTP/1.1" 200 None
2025-12-05 06:03:17 [manheim.gb] INFO: Scrape type for 3809067: 1
2025-12-05 06:03:17 [manheim.gb] INFO: Found listing with ID: 3813190
2025-12-05 06:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273813190%27 HTTP/1.1" 200 None
2025-12-05 06:03:17 [manheim.gb] INFO: Scrape type for 3813190: 1
2025-12-05 06:03:17 [manheim.gb] INFO: Found listing with ID: 3817425
2025-12-05 06:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273817425%27 HTTP/1.1" 200 None
2025-12-05 06:03:17 [manheim.gb] INFO: Scrape type for 3817425: 1
2025-12-05 06:03:17 [manheim.gb] INFO: Found listing with ID: 3823600
2025-12-05 06:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273823600%27 HTTP/1.1" 200 None
2025-12-05 06:03:17 [manheim.gb] INFO: Scrape type for 3823600: 1
2025-12-05 06:03:17 [manheim.gb] INFO: Found listing with ID: 3823672
2025-12-05 06:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273823672%27 HTTP/1.1" 200 None
2025-12-05 06:03:17 [manheim.gb] INFO: Scrape type for 3823672: 1
2025-12-05 06:03:17 [manheim.gb] INFO: Found listing with ID: 3824213
2025-12-05 06:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273824213%27 HTTP/1.1" 200 None
2025-12-05 06:03:17 [manheim.gb] INFO: Scrape type for 3824213: 1
2025-12-05 06:03:17 [manheim.gb] INFO: Found listing with ID: 3826448
2025-12-05 06:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273826448%27 HTTP/1.1" 200 None
2025-12-05 06:03:17 [manheim.gb] INFO: Scrape type for 3826448: 1
2025-12-05 06:03:17 [manheim.gb] INFO: Found listing with ID: 3829362
2025-12-05 06:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273829362%27 HTTP/1.1" 200 None
2025-12-05 06:03:17 [manheim.gb] INFO: Scrape type for 3829362: 1
2025-12-05 06:03:17 [manheim.gb] INFO: Found listing with ID: 3831881
2025-12-05 06:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273831881%27 HTTP/1.1" 200 None
2025-12-05 06:03:17 [manheim.gb] INFO: Scrape type for 3831881: 1
2025-12-05 06:03:17 [manheim.gb] INFO: Found listing with ID: 3834095
2025-12-05 06:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273834095%27 HTTP/1.1" 200 None
2025-12-05 06:03:17 [manheim.gb] INFO: Scrape type for 3834095: 1
2025-12-05 06:03:17 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field odometer is not nullable
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/manheim.py", line 201, in parse_listings
    scraped_item = self._extract_listing_item(item, expiration_date)
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/manheim.py", line 281, in _extract_listing_item
    item["odometer"] = odometer
    ~~~~^^^^^^^^^^^^
  File "/usr/src/app/crawlers/items.py", line 116, in __setitem__
    raise ValueError(f"Field {key} is not nullable")
ValueError: Field odometer is not nullable
2025-12-05 06:03:17 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field odometer is not nullable
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/manheim.py", line 201, in parse_listings
    scraped_item = self._extract_listing_item(item, expiration_date)
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/manheim.py", line 281, in _extract_listing_item
    item["odometer"] = odometer
    ~~~~^^^^^^^^^^^^
  File "/usr/src/app/crawlers/items.py", line 116, in __setitem__
    raise ValueError(f"Field {key} is not nullable")
ValueError: Field odometer is not nullable
2025-12-05 06:03:17 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field odometer is not nullable
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/manheim.py", line 201, in parse_listings
    scraped_item = self._extract_listing_item(item, expiration_date)
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/manheim.py", line 281, in _extract_listing_item
    item["odometer"] = odometer
    ~~~~^^^^^^^^^^^^
  File "/usr/src/app/crawlers/items.py", line 116, in __setitem__
    raise ValueError(f"Field {key} is not nullable")
ValueError: Field odometer is not nullable
2025-12-05 06:03:18 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field odometer is not nullable
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/manheim.py", line 201, in parse_listings
    scraped_item = self._extract_listing_item(item, expiration_date)
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/manheim.py", line 281, in _extract_listing_item
    item["odometer"] = odometer
    ~~~~^^^^^^^^^^^^
  File "/usr/src/app/crawlers/items.py", line 116, in __setitem__
    raise ValueError(f"Field {key} is not nullable")
ValueError: Field odometer is not nullable
2025-12-05 06:03:18 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field odometer is not nullable
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/manheim.py", line 201, in parse_listings
    scraped_item = self._extract_listing_item(item, expiration_date)
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/manheim.py", line 281, in _extract_listing_item
    item["odometer"] = odometer
    ~~~~^^^^^^^^^^^^
  File "/usr/src/app/crawlers/items.py", line 116, in __setitem__
    raise ValueError(f"Field {key} is not nullable")
ValueError: Field odometer is not nullable
2025-12-05 06:03:18 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field odometer is not nullable
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/manheim.py", line 201, in parse_listings
    scraped_item = self._extract_listing_item(item, expiration_date)
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/manheim.py", line 281, in _extract_listing_item
    item["odometer"] = odometer
    ~~~~^^^^^^^^^^^^
  File "/usr/src/app/crawlers/items.py", line 116, in __setitem__
    raise ValueError(f"Field {key} is not nullable")
ValueError: Field odometer is not nullable
2025-12-05 06:03:18 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field odometer is not nullable
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/manheim.py", line 201, in parse_listings
    scraped_item = self._extract_listing_item(item, expiration_date)
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/manheim.py", line 281, in _extract_listing_item
    item["odometer"] = odometer
    ~~~~^^^^^^^^^^^^
  File "/usr/src/app/crawlers/items.py", line 116, in __setitem__
    raise ValueError(f"Field {key} is not nullable")
ValueError: Field odometer is not nullable
2025-12-05 06:03:18 [scrapy.core.scraper] ERROR: Spider error processing <POST https://www.manheim.co.uk/search/refine> (referer: https://www.manheim.co.uk/search)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 295, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 374, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 355, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 374, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 355, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy_zyte_api/_middlewares.py", line 206, in process_spider_output_async
    async for item_or_request in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/manheim.py", line 201, in parse_listings
    scraped_item = self._extract_listing_item(item, expiration_date)
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/manheim.py", line 281, in _extract_listing_item
    item["odometer"] = odometer
    ~~~~^^^^^^^^^^^^
  File "/usr/src/app/crawlers/items.py", line 116, in __setitem__
    raise ValueError(f"Field {key} is not nullable")
ValueError: Field odometer is not nullable
2025-12-05 06:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003346181-01993177-003.pdf> (referer: None)
2025-12-05 06:03:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23426e93d0>
2025-12-05 06:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74045680-8653-589c-9531-45230465fc45/74045680-8653-589c-9531-45230465fc45_expert_report_file_8a07702d-4858-425c-bed9-146778077a74.pdf HTTP/1.1" 201 0
2025-12-05 06:03:18 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 74045680-8653-589c-9531-45230465fc45
2025-12-05 06:03:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 74045680-8653-589c-9531-45230465fc45, skipping ID generation
2025-12-05 06:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 74045680-8653-589c-9531-45230465fc45
2025-12-05 06:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F26525e2c-38f0-4f17-9548-24ab6d0cb9c5_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/26525e2c-38f0-4f17-9548-24ab6d0cb9c5_ext_7.jpg not downloaded yet
2025-12-05 06:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F26525e2c-38f0-4f17-9548-24ab6d0cb9c5_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/26525e2c-38f0-4f17-9548-24ab6d0cb9c5_ext_7.jpg not downloaded yet
2025-12-05 06:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F26525e2c-38f0-4f17-9548-24ab6d0cb9c5_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/26525e2c-38f0-4f17-9548-24ab6d0cb9c5_ext_6.jpg not downloaded yet
2025-12-05 06:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F26525e2c-38f0-4f17-9548-24ab6d0cb9c5_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/26525e2c-38f0-4f17-9548-24ab6d0cb9c5_ext_1.jpg not downloaded yet
2025-12-05 06:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F26525e2c-38f0-4f17-9548-24ab6d0cb9c5_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/26525e2c-38f0-4f17-9548-24ab6d0cb9c5_5.jpg not downloaded yet
2025-12-05 06:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=3356576&returnUrl=%2Fsearch%3FPage%3D3%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233356576&indx=200> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F26525e2c-38f0-4f17-9548-24ab6d0cb9c5_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/26525e2c-38f0-4f17-9548-24ab6d0cb9c5_4.jpg not downloaded yet
2025-12-05 06:03:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F26525e2c-38f0-4f17-9548-24ab6d0cb9c5_11.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/26525e2c-38f0-4f17-9548-24ab6d0cb9c5_11.jpg not downloaded yet
2025-12-05 06:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F26525e2c-38f0-4f17-9548-24ab6d0cb9c5_10.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/26525e2c-38f0-4f17-9548-24ab6d0cb9c5_10.jpg not downloaded yet
2025-12-05 06:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F26525e2c-38f0-4f17-9548-24ab6d0cb9c5_9.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/26525e2c-38f0-4f17-9548-24ab6d0cb9c5_9.jpg not downloaded yet
2025-12-05 06:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F26525e2c-38f0-4f17-9548-24ab6d0cb9c5_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/26525e2c-38f0-4f17-9548-24ab6d0cb9c5_ext_2.jpg not downloaded yet
2025-12-05 06:03:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 456b1f4d-eaa4-5acd-8d0e-bce3c1e9a907 with identifier: 3356576
2025-12-05 06:03:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 456b1f4d-eaa4-5acd-8d0e-bce3c1e9a907 with scrape type 2
2025-12-05 06:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 456b1f4d-eaa4-5acd-8d0e-bce3c1e9a907 with scrape type 2
2025-12-05 06:03:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 456b1f4d-eaa4-5acd-8d0e-bce3c1e9a907, identifier: 3356576
2025-12-05 06:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F26525e2c-38f0-4f17-9548-24ab6d0cb9c5_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/26525e2c-38f0-4f17-9548-24ab6d0cb9c5_ext_5.jpg not downloaded yet
2025-12-05 06:03:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 456b1f4d-eaa4-5acd-8d0e-bce3c1e9a907 with identifier: 3356576
2025-12-05 06:03:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 456b1f4d-eaa4-5acd-8d0e-bce3c1e9a907 with identifier: 3356576
2025-12-05 06:03:19 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 456b1f4d-eaa4-5acd-8d0e-bce3c1e9a907 with identifier: 3356576 to the API
2025-12-05 06:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 06:03:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 06:03:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=3356576&returnUrl=%2Fsearch%3FPage%3D3%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233356576&indx=200>
{'auction_title': '',
 'c_o_2_emission_value': 155,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003356576-01991836-002.pdf',
 'color': 'RED',
 'currency': 'GBP',
 'engine': '1.3L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '456b1f4d-eaa4-5acd-8d0e-bce3c1e9a907',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'YF70VZG',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=3356576',
 'listing': 'auction',
 'location': 'Leeds - In Transit',
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 25457,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-31',
 'seller_name': 'Mobilize Financial Services',
 'title': 'NISSAN QASHQAI 1.3 DiG-T N-Connecta 5dr',
 'transmission': 'manual',
 'trim': '1.3 DiG-T N-Connecta 5dr',
 'year': 2020}
2025-12-05 06:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273356576%27 HTTP/1.1" 200 None
2025-12-05 06:03:19 [manheim.gb] INFO: Saving data for 3356576: {'auction_closing_time': 1765184400.0, 'created_time': 1764792305.314642, 'last_price_update_time': 1764914599.768199}
2025-12-05 06:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3356576') HTTP/1.1" 204 0
2025-12-05 06:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F26525e2c-38f0-4f17-9548-24ab6d0cb9c5_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/26525e2c-38f0-4f17-9548-24ab6d0cb9c5_ext_3.jpg not downloaded yet
2025-12-05 06:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F26525e2c-38f0-4f17-9548-24ab6d0cb9c5_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/26525e2c-38f0-4f17-9548-24ab6d0cb9c5_ext_4.jpg not downloaded yet
2025-12-05 06:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/26525e2c-38f0-4f17-9548-24ab6d0cb9c5_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003346181-01993177-003.pdf)
2025-12-05 06:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3346181-4008609-13.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3346181-4008609-13.jpg not downloaded yet
2025-12-05 06:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3346181-4008609-1000.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3346181-4008609-1000.jpg not downloaded yet
2025-12-05 06:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3346181-4008609-1001.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3346181-4008609-1001.jpg not downloaded yet
2025-12-05 06:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3346181-4008609-1002.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3346181-4008609-1002.jpg not downloaded yet
2025-12-05 06:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3346181-4008609-1003.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3346181-4008609-1003.jpg not downloaded yet
2025-12-05 06:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/FORD/FOCUS?id=334453&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%23334453&indx=196> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3346181-4008609-1004.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3346181-4008609-1004.jpg not downloaded yet
2025-12-05 06:03:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:03:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23426ab450>
2025-12-05 06:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74045680-8653-589c-9531-45230465fc45/74045680-8653-589c-9531-45230465fc45_image_4.jpg HTTP/1.1" 201 0
2025-12-05 06:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F26525e2c-38f0-4f17-9548-24ab6d0cb9c5_5.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/26525e2c-38f0-4f17-9548-24ab6d0cb9c5_5.jpg saved to cache
2025-12-05 06:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 74045680-8653-589c-9531-45230465fc45
2025-12-05 06:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3346181-4008609-1005.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3346181-4008609-1005.jpg not downloaded yet
2025-12-05 06:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/26525e2c-38f0-4f17-9548-24ab6d0cb9c5_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003346181-01993177-003.pdf)
2025-12-05 06:03:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 068a719b-8a55-578f-a1b3-a311587d72d1 with identifier: 334453
2025-12-05 06:03:20 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 068a719b-8a55-578f-a1b3-a311587d72d1
2025-12-05 06:03:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342642bd0>
2025-12-05 06:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74045680-8653-589c-9531-45230465fc45/74045680-8653-589c-9531-45230465fc45_image_12.jpg HTTP/1.1" 201 0
2025-12-05 06:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F26525e2c-38f0-4f17-9548-24ab6d0cb9c5_ext_4.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/26525e2c-38f0-4f17-9548-24ab6d0cb9c5_ext_4.jpg saved to cache
2025-12-05 06:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 74045680-8653-589c-9531-45230465fc45
2025-12-05 06:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3346181-4008609-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003346181-01993177-003.pdf)
2025-12-05 06:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3346181-4008609-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003346181-01993177-003.pdf)
2025-12-05 06:03:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23415be450>
2025-12-05 06:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74045680-8653-589c-9531-45230465fc45/74045680-8653-589c-9531-45230465fc45_image_17.jpg HTTP/1.1" 201 0
2025-12-05 06:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3346181-4008609-1003.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3346181-4008609-1003.jpg saved to cache
2025-12-05 06:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 74045680-8653-589c-9531-45230465fc45
2025-12-05 06:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/AUDI/ETRON?id=3375071&returnUrl=%2Fsearch%3FPage%3D3%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233375071&indx=206> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:03:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:03:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23426a9810>
2025-12-05 06:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74045680-8653-589c-9531-45230465fc45/74045680-8653-589c-9531-45230465fc45_image_19.jpg HTTP/1.1" 201 0
2025-12-05 06:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3346181-4008609-1005.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3346181-4008609-1005.jpg saved to cache
2025-12-05 06:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 74045680-8653-589c-9531-45230465fc45
2025-12-05 06:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3346181-4008609-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003346181-01993177-003.pdf)
2025-12-05 06:03:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09 with identifier: 3375071
2025-12-05 06:03:21 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09
2025-12-05 06:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0000334453-01992785-002.pdf> (referer: None)
2025-12-05 06:03:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234253df90>
2025-12-05 06:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74045680-8653-589c-9531-45230465fc45/74045680-8653-589c-9531-45230465fc45_image_18.jpg HTTP/1.1" 201 0
2025-12-05 06:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3346181-4008609-1004.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3346181-4008609-1004.jpg saved to cache
2025-12-05 06:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 74045680-8653-589c-9531-45230465fc45
2025-12-05 06:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3346181-4008609-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003346181-01993177-003.pdf)
2025-12-05 06:03:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425f3090>
2025-12-05 06:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 06:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_068a719b-8a55-578f-a1b3-a311587d72d1/068a719b-8a55-578f-a1b3-a311587d72d1_expert_report_file_08f0b5f7-1b5e-4e6b-8639-80795e757b94.pdf HTTP/1.1" 201 0
2025-12-05 06:03:22 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 068a719b-8a55-578f-a1b3-a311587d72d1
2025-12-05 06:03:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 068a719b-8a55-578f-a1b3-a311587d72d1, skipping ID generation
2025-12-05 06:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 068a719b-8a55-578f-a1b3-a311587d72d1
2025-12-05 06:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_ext_7.jpg not downloaded yet
2025-12-05 06:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3346181-4008609-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003346181-01993177-003.pdf)
2025-12-05 06:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_ext_7.jpg not downloaded yet
2025-12-05 06:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_ext_6.jpg not downloaded yet
2025-12-05 06:03:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234239b6d0>
2025-12-05 06:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 06:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74045680-8653-589c-9531-45230465fc45/74045680-8653-589c-9531-45230465fc45_image_16.jpg HTTP/1.1" 201 0
2025-12-05 06:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3346181-4008609-1002.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3346181-4008609-1002.jpg saved to cache
2025-12-05 06:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 74045680-8653-589c-9531-45230465fc45
2025-12-05 06:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_ext_1.jpg not downloaded yet
2025-12-05 06:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_5.jpg not downloaded yet
2025-12-05 06:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_4.jpg not downloaded yet
2025-12-05 06:03:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23423992d0>
2025-12-05 06:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74045680-8653-589c-9531-45230465fc45/74045680-8653-589c-9531-45230465fc45_image_15.jpg HTTP/1.1" 201 0
2025-12-05 06:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3346181-4008609-1001.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3346181-4008609-1001.jpg saved to cache
2025-12-05 06:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 74045680-8653-589c-9531-45230465fc45
2025-12-05 06:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_11.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_11.jpg not downloaded yet
2025-12-05 06:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/BCLASS?id=3358545&returnUrl=%2Fsearch%3FPage%3D3%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233358545&indx=201> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_10.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_10.jpg not downloaded yet
2025-12-05 06:03:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_9.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_9.jpg not downloaded yet
2025-12-05 06:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_ext_2.jpg not downloaded yet
2025-12-05 06:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_ext_5.jpg not downloaded yet
2025-12-05 06:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_ext_3.jpg not downloaded yet
2025-12-05 06:03:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fecd7855-d02a-5751-a30f-27d91d18e565 with identifier: 3358545
2025-12-05 06:03:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fecd7855-d02a-5751-a30f-27d91d18e565 with scrape type 2
2025-12-05 06:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fecd7855-d02a-5751-a30f-27d91d18e565 with scrape type 2
2025-12-05 06:03:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: fecd7855-d02a-5751-a30f-27d91d18e565, identifier: 3358545
2025-12-05 06:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_ext_4.jpg not downloaded yet
2025-12-05 06:03:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: fecd7855-d02a-5751-a30f-27d91d18e565 with identifier: 3358545
2025-12-05 06:03:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: fecd7855-d02a-5751-a30f-27d91d18e565 with identifier: 3358545
2025-12-05 06:03:23 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': 'available car', 'price_includes_vat': False, 'title': 'mercedes-benz b class b200 cdi blueefficiency se 5dr', 'price': 0, 'currency': 'gbp', 'make': 'mercedes-benz', 'model': 'b class', 'transmission': 'manual', 'engine': '1.8l', 'fuel_type': 'diesel', 'odometer': 170395, 'odometer_reading_unit': 'mi', 'registration_date': '2014-01-29', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/mercedes-benz/b%20class?id=3358545', 'location': 'washington', 'origin_country_code': 'gb', 'trim': 'b200 cdi blueefficiency se 5dr', 'license_plate': 'co13yen', 'year': 2014, 'listing': 'auction', 'c_o_2_emission_value': 114, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0003358545-01962369-003.pdf', 'expiration_date': '2025-12-05t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': 'fecd7855-d02a-5751-a30f-27d91d18e565', 'current_year_diff': 11, 'age_in_months': 142, 'make_model': 'mercedes-benz b class', 'sanitized_make': 'mercedesbenz', 'odometer_in_km': 274223}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 142,
     'auction_title': '',
     'c_o_2_emission_value': 114,
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0003358545-01962369-003.pdf',
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 11,
     'engine': '1.8l',
     'expiration_date': '2025-12-05t09:00:00z',
     'fuel_type': 'diesel',
     'id': 'fecd7855-d02a-5751-a30f-27d91d18e565',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'co13yen',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/mercedes-benz/b%20class?id=3358545',
     'listing': 'auction',
     'location': 'washington',
     'make': 'mercedes-benz',
     'make_model': 'mercedes-benz b class',
     'model': 'b class',
     'odometer': 170395,
     'odometer_in_km': 274223,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2014-01-29',
     'sanitized_make': 'mercedesbenz',
     'seller_name': 'available car',
     'title': 'mercedes-benz b class b200 cdi blueefficiency se 5dr',
     'transmission': 'manual',
     'trim': 'b200 cdi blueefficiency se 5dr',
     'year': 2014}
2025-12-05 06:03:23 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: fecd7855-d02a-5751-a30f-27d91d18e565 spider: manheim.gb
2025-12-05 06:03:23 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: fecd7855-d02a-5751-a30f-27d91d18e565 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': 'available car', 'price_includes_vat': False, 'title': 'mercedes-benz b class b200 cdi blueefficiency se 5dr', 'price': 0, 'currency': 'gbp', 'make': 'mercedes-benz', 'model': 'b class', 'transmission': 'manual', 'engine': '1.8l', 'fuel_type': 'diesel', 'odometer': 170395, 'odometer_reading_unit': 'mi', 'registration_date': '2014-01-29', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/mercedes-benz/b%20class?id=3358545', 'location': 'washington', 'origin_country_code': 'gb', 'trim': 'b200 cdi blueefficiency se 5dr', 'license_plate': 'co13yen', 'year': 2014, 'listing': 'auction', 'c_o_2_emission_value': 114, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0003358545-01962369-003.pdf', 'expiration_date': '2025-12-05t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': 'fecd7855-d02a-5751-a30f-27d91d18e565', 'current_year_diff': 11, 'age_in_months': 142, 'make_model': 'mercedes-benz b class', 'sanitized_make': 'mercedesbenz', 'odometer_in_km': 274223}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 142,
     'auction_title': '',
     'c_o_2_emission_value': 114,
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0003358545-01962369-003.pdf',
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 11,
     'engine': '1.8l',
     'expiration_date': '2025-12-05t09:00:00z',
     'fuel_type': 'diesel',
     'id': 'fecd7855-d02a-5751-a30f-27d91d18e565',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'co13yen',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/mercedes-benz/b%20class?id=3358545',
     'listing': 'auction',
     'location': 'washington',
     'make': 'mercedes-benz',
     'make_model': 'mercedes-benz b class',
     'model': 'b class',
     'odometer': 170395,
     'odometer_in_km': 274223,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2014-01-29',
     'sanitized_make': 'mercedesbenz',
     'seller_name': 'available car',
     'title': 'mercedes-benz b class b200 cdi blueefficiency se 5dr',
     'transmission': 'manual',
     'trim': 'b200 cdi blueefficiency se 5dr',
     'year': 2014}
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003358545-01962369-003.pdf',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.8L',
 'expiration_date': '2025-12-05T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'fecd7855-d02a-5751-a30f-27d91d18e565',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'CO13YEN',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/B%20CLASS?id=3358545',
 'listing': 'auction',
 'location': 'Washington',
 'make': 'MERCEDES-BENZ',
 'model': 'B CLASS',
 'odometer': 170395,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-29',
 'seller_name': 'Available Car',
 'title': 'MERCEDES-BENZ B CLASS B200 CDI BlueEFFICIENCY SE 5dr',
 'transmission': 'manual',
 'trim': 'B200 CDI BlueEFFICIENCY SE 5dr',
 'year': 2014}
2025-12-05 06:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273358545%27 HTTP/1.1" 200 None
2025-12-05 06:03:23 [manheim.gb] INFO: Saving data for 3358545: {'auction_closing_time': 1764925200.0, 'created_time': 1764792285.362319, 'last_price_update_time': 1764914603.898296}
2025-12-05 06:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3358545') HTTP/1.1" 204 0
2025-12-05 06:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-334453-4008535-13.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-334453-4008535-13.jpg not downloaded yet
2025-12-05 06:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-334453-4008535-1000.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-334453-4008535-1000.jpg not downloaded yet
2025-12-05 06:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-334453-4008535-1001.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-334453-4008535-1001.jpg not downloaded yet
2025-12-05 06:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-334453-4008535-1002.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-334453-4008535-1002.jpg not downloaded yet
2025-12-05 06:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-334453-4008535-1003.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-334453-4008535-1003.jpg not downloaded yet
2025-12-05 06:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-334453-4008535-1004.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-334453-4008535-1004.jpg not downloaded yet
2025-12-05 06:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-334453-4008535-1005.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-334453-4008535-1005.jpg not downloaded yet
2025-12-05 06:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-334453-4008535-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000334453-01992785-002.pdf)
2025-12-05 06:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-334453-4008535-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000334453-01992785-002.pdf)
2025-12-05 06:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-334453-4008535-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000334453-01992785-002.pdf)
2025-12-05 06:03:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23415b4a10>
2025-12-05 06:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_068a719b-8a55-578f-a1b3-a311587d72d1/068a719b-8a55-578f-a1b3-a311587d72d1_image_19.jpg HTTP/1.1" 201 0
2025-12-05 06:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-334453-4008535-1005.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-334453-4008535-1005.jpg saved to cache
2025-12-05 06:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 068a719b-8a55-578f-a1b3-a311587d72d1
2025-12-05 06:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-334453-4008535-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000334453-01992785-002.pdf)
2025-12-05 06:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-334453-4008535-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000334453-01992785-002.pdf)
2025-12-05 06:03:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23426a8ed0>
2025-12-05 06:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 06:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_068a719b-8a55-578f-a1b3-a311587d72d1/068a719b-8a55-578f-a1b3-a311587d72d1_image_18.jpg HTTP/1.1" 201 0
2025-12-05 06:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-334453-4008535-1004.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-334453-4008535-1004.jpg saved to cache
2025-12-05 06:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 068a719b-8a55-578f-a1b3-a311587d72d1
2025-12-05 06:03:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23415c5ed0>
2025-12-05 06:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_068a719b-8a55-578f-a1b3-a311587d72d1/068a719b-8a55-578f-a1b3-a311587d72d1_image_17.jpg HTTP/1.1" 201 0
2025-12-05 06:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-334453-4008535-1003.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-334453-4008535-1003.jpg saved to cache
2025-12-05 06:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 068a719b-8a55-578f-a1b3-a311587d72d1
2025-12-05 06:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-334453-4008535-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000334453-01992785-002.pdf)
2025-12-05 06:03:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234274c950>
2025-12-05 06:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_068a719b-8a55-578f-a1b3-a311587d72d1/068a719b-8a55-578f-a1b3-a311587d72d1_image_15.jpg HTTP/1.1" 201 0
2025-12-05 06:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-334453-4008535-1001.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-334453-4008535-1001.jpg saved to cache
2025-12-05 06:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 068a719b-8a55-578f-a1b3-a311587d72d1
2025-12-05 06:03:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342343050>
2025-12-05 06:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_068a719b-8a55-578f-a1b3-a311587d72d1/068a719b-8a55-578f-a1b3-a311587d72d1_image_14.jpg HTTP/1.1" 201 0
2025-12-05 06:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-334453-4008535-1000.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-334453-4008535-1000.jpg saved to cache
2025-12-05 06:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 068a719b-8a55-578f-a1b3-a311587d72d1
2025-12-05 06:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-334453-4008535-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000334453-01992785-002.pdf)
2025-12-05 06:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000334453-01992785-002.pdf)
2025-12-05 06:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000334453-01992785-002.pdf)
2025-12-05 06:03:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425f9690>
2025-12-05 06:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_068a719b-8a55-578f-a1b3-a311587d72d1/068a719b-8a55-578f-a1b3-a311587d72d1_image_16.jpg HTTP/1.1" 201 0
2025-12-05 06:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-334453-4008535-1002.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-334453-4008535-1002.jpg saved to cache
2025-12-05 06:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 068a719b-8a55-578f-a1b3-a311587d72d1
2025-12-05 06:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000334453-01992785-002.pdf)
2025-12-05 06:03:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234279d190>
2025-12-05 06:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_068a719b-8a55-578f-a1b3-a311587d72d1/068a719b-8a55-578f-a1b3-a311587d72d1_image_13.jpg HTTP/1.1" 201 0
2025-12-05 06:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-334453-4008535-13.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-334453-4008535-13.jpg saved to cache
2025-12-05 06:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 068a719b-8a55-578f-a1b3-a311587d72d1
2025-12-05 06:03:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342740390>
2025-12-05 06:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_068a719b-8a55-578f-a1b3-a311587d72d1/068a719b-8a55-578f-a1b3-a311587d72d1_image_11.jpg HTTP/1.1" 201 0
2025-12-05 06:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_ext_3.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_ext_3.jpg saved to cache
2025-12-05 06:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 068a719b-8a55-578f-a1b3-a311587d72d1
2025-12-05 06:03:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234264c750>
2025-12-05 06:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_068a719b-8a55-578f-a1b3-a311587d72d1/068a719b-8a55-578f-a1b3-a311587d72d1_image_10.jpg HTTP/1.1" 201 0
2025-12-05 06:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_ext_5.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_ext_5.jpg saved to cache
2025-12-05 06:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 068a719b-8a55-578f-a1b3-a311587d72d1
2025-12-05 06:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000334453-01992785-002.pdf)
2025-12-05 06:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000334453-01992785-002.pdf)
2025-12-05 06:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000334453-01992785-002.pdf)
2025-12-05 06:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000334453-01992785-002.pdf)
2025-12-05 06:03:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342708e10>
2025-12-05 06:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 06:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_068a719b-8a55-578f-a1b3-a311587d72d1/068a719b-8a55-578f-a1b3-a311587d72d1_image_12.jpg HTTP/1.1" 201 0
2025-12-05 06:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_ext_4.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_ext_4.jpg saved to cache
2025-12-05 06:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 068a719b-8a55-578f-a1b3-a311587d72d1
2025-12-05 06:03:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425e1490>
2025-12-05 06:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_068a719b-8a55-578f-a1b3-a311587d72d1/068a719b-8a55-578f-a1b3-a311587d72d1_image_8.jpg HTTP/1.1" 201 0
2025-12-05 06:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_9.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_9.jpg saved to cache
2025-12-05 06:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 068a719b-8a55-578f-a1b3-a311587d72d1
2025-12-05 06:03:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342631a90>
2025-12-05 06:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 06:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_068a719b-8a55-578f-a1b3-a311587d72d1/068a719b-8a55-578f-a1b3-a311587d72d1_image_6.jpg HTTP/1.1" 201 0
2025-12-05 06:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_11.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_11.jpg saved to cache
2025-12-05 06:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 068a719b-8a55-578f-a1b3-a311587d72d1
2025-12-05 06:03:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23423b82d0>
2025-12-05 06:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_068a719b-8a55-578f-a1b3-a311587d72d1/068a719b-8a55-578f-a1b3-a311587d72d1_image_7.jpg HTTP/1.1" 201 0
2025-12-05 06:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_10.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_10.jpg saved to cache
2025-12-05 06:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 068a719b-8a55-578f-a1b3-a311587d72d1
2025-12-05 06:03:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341f21510>
2025-12-05 06:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_068a719b-8a55-578f-a1b3-a311587d72d1/068a719b-8a55-578f-a1b3-a311587d72d1_image_9.jpg HTTP/1.1" 201 0
2025-12-05 06:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_ext_2.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_ext_2.jpg saved to cache
2025-12-05 06:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 068a719b-8a55-578f-a1b3-a311587d72d1
2025-12-05 06:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000334453-01992785-002.pdf)
2025-12-05 06:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000334453-01992785-002.pdf)
2025-12-05 06:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000334453-01992785-002.pdf)
2025-12-05 06:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000334453-01992785-002.pdf)
2025-12-05 06:03:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425e3890>
2025-12-05 06:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_068a719b-8a55-578f-a1b3-a311587d72d1/068a719b-8a55-578f-a1b3-a311587d72d1_image_5.jpg HTTP/1.1" 201 0
2025-12-05 06:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_4.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_4.jpg saved to cache
2025-12-05 06:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 068a719b-8a55-578f-a1b3-a311587d72d1
2025-12-05 06:03:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23427b00d0>
2025-12-05 06:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_068a719b-8a55-578f-a1b3-a311587d72d1/068a719b-8a55-578f-a1b3-a311587d72d1_image_4.jpg HTTP/1.1" 201 0
2025-12-05 06:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_5.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_5.jpg saved to cache
2025-12-05 06:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 068a719b-8a55-578f-a1b3-a311587d72d1
2025-12-05 06:03:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342813890>
2025-12-05 06:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 06:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_068a719b-8a55-578f-a1b3-a311587d72d1/068a719b-8a55-578f-a1b3-a311587d72d1_image_2.jpg HTTP/1.1" 201 0
2025-12-05 06:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_ext_6.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_ext_6.jpg saved to cache
2025-12-05 06:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 068a719b-8a55-578f-a1b3-a311587d72d1
2025-12-05 06:03:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234264e590>
2025-12-05 06:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_068a719b-8a55-578f-a1b3-a311587d72d1/068a719b-8a55-578f-a1b3-a311587d72d1_image_3.jpg HTTP/1.1" 201 0
2025-12-05 06:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_ext_1.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_ext_1.jpg saved to cache
2025-12-05 06:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 068a719b-8a55-578f-a1b3-a311587d72d1
2025-12-05 06:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000334453-01992785-002.pdf)
2025-12-05 06:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000334453-01992785-002.pdf)
2025-12-05 06:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3346181-4008609-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003346181-01993177-003.pdf)
2025-12-05 06:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003375071-01987334-005.pdf> (referer: None)
2025-12-05 06:03:29 [scrapy.extensions.logstats] INFO: Crawled 53 pages (at 28 pages/min), scraped 11 items (at 6 items/min)
2025-12-05 06:03:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342617090>
2025-12-05 06:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_068a719b-8a55-578f-a1b3-a311587d72d1/068a719b-8a55-578f-a1b3-a311587d72d1_image_1.jpg HTTP/1.1" 201 0
2025-12-05 06:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_ext_7.jpg saved to cache
2025-12-05 06:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 068a719b-8a55-578f-a1b3-a311587d72d1
2025-12-05 06:03:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23423a8350>
2025-12-05 06:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_068a719b-8a55-578f-a1b3-a311587d72d1/068a719b-8a55-578f-a1b3-a311587d72d1_image_0.jpg HTTP/1.1" 201 0
2025-12-05 06:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_ext_7.jpg saved to cache
2025-12-05 06:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 068a719b-8a55-578f-a1b3-a311587d72d1
2025-12-05 06:03:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 068a719b-8a55-578f-a1b3-a311587d72d1, skipping ID generation
2025-12-05 06:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 068a719b-8a55-578f-a1b3-a311587d72d1 from tracking dictionaries
2025-12-05 06:03:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 068a719b-8a55-578f-a1b3-a311587d72d1 sending to next pipeline
2025-12-05 06:03:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 068a719b-8a55-578f-a1b3-a311587d72d1, identifier: 334453
2025-12-05 06:03:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 068a719b-8a55-578f-a1b3-a311587d72d1 with identifier: 334453
2025-12-05 06:03:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 068a719b-8a55-578f-a1b3-a311587d72d1 with identifier: 334453
2025-12-05 06:03:30 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 154668 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    154668
2025-12-05 06:03:30 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 068a719b-8a55-578f-a1b3-a311587d72d1 spider: manheim.gb
2025-12-05 06:03:30 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 068a719b-8a55-578f-a1b3-a311587d72d1 due to rule: high_mileage_for_country.json, error: 154668 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    154668
{'auction_title': '',
 'c_o_2_emission_value': 224,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_068a719b-8a55-578f-a1b3-a311587d72d1/068a719b-8a55-578f-a1b3-a311587d72d1_expert_report_file_08f0b5f7-1b5e-4e6b-8639-80795e757b94.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0000334453-01992785-002.pdf',
 'color': 'RED',
 'currency': 'GBP',
 'engine': '2.5L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '068a719b-8a55-578f-a1b3-a311587d72d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'FA07YOY',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FORD/FOCUS?id=334453',
 'listing': 'auction',
 'location': 'Manchester',
 'make': 'FORD',
 'model': 'FOCUS',
 'odometer': 96107,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 67,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_068a719b-8a55-578f-a1b3-a311587d72d1/068a719b-8a55-578f-a1b3-a311587d72d1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 177394,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_068a719b-8a55-578f-a1b3-a311587d72d1/068a719b-8a55-578f-a1b3-a311587d72d1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 177394,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_068a719b-8a55-578f-a1b3-a311587d72d1/068a719b-8a55-578f-a1b3-a311587d72d1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 218327,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_068a719b-8a55-578f-a1b3-a311587d72d1/068a719b-8a55-578f-a1b3-a311587d72d1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 191235,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_068a719b-8a55-578f-a1b3-a311587d72d1/068a719b-8a55-578f-a1b3-a311587d72d1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 178155,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_5.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_068a719b-8a55-578f-a1b3-a311587d72d1/068a719b-8a55-578f-a1b3-a311587d72d1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 180716,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_4.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_068a719b-8a55-578f-a1b3-a311587d72d1/068a719b-8a55-578f-a1b3-a311587d72d1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 181324,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_11.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_068a719b-8a55-578f-a1b3-a311587d72d1/068a719b-8a55-578f-a1b3-a311587d72d1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 180204,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_10.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_068a719b-8a55-578f-a1b3-a311587d72d1/068a719b-8a55-578f-a1b3-a311587d72d1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 179926,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_9.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_068a719b-8a55-578f-a1b3-a311587d72d1/068a719b-8a55-578f-a1b3-a311587d72d1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 248965,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_068a719b-8a55-578f-a1b3-a311587d72d1/068a719b-8a55-578f-a1b3-a311587d72d1_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 138360,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_068a719b-8a55-578f-a1b3-a311587d72d1/068a719b-8a55-578f-a1b3-a311587d72d1_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111678,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_068a719b-8a55-578f-a1b3-a311587d72d1/068a719b-8a55-578f-a1b3-a311587d72d1_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 276913,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e3f0e1f3-8ce6-4d25-9d4f-72ae2c290d47_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_068a719b-8a55-578f-a1b3-a311587d72d1/068a719b-8a55-578f-a1b3-a311587d72d1_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 503347,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-334453-4008535-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_068a719b-8a55-578f-a1b3-a311587d72d1/068a719b-8a55-578f-a1b3-a311587d72d1_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 180498,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-334453-4008535-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_068a719b-8a55-578f-a1b3-a311587d72d1/068a719b-8a55-578f-a1b3-a311587d72d1_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 192821,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-334453-4008535-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_068a719b-8a55-578f-a1b3-a311587d72d1/068a719b-8a55-578f-a1b3-a311587d72d1_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 378468,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-334453-4008535-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_068a719b-8a55-578f-a1b3-a311587d72d1/068a719b-8a55-578f-a1b3-a311587d72d1_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 274203,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-334453-4008535-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_068a719b-8a55-578f-a1b3-a311587d72d1/068a719b-8a55-578f-a1b3-a311587d72d1_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 346486,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-334453-4008535-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_068a719b-8a55-578f-a1b3-a311587d72d1/068a719b-8a55-578f-a1b3-a311587d72d1_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104171,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-334453-4008535-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-06-29',
 'seller_name': 'Swansway Garages',
 'title': 'FORD FOCUS 2.5 ST-3 3dr',
 'transmission': 'manual',
 'trim': '2.5 ST-3 3dr',
 'year': 2007}
2025-12-05 06:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27334453%27 HTTP/1.1" 200 None
2025-12-05 06:03:30 [manheim.gb] INFO: Saving data for 334453: {'created_time': 1764914610.87429, 'last_price_update_time': 1764914610.874303, 'auction_closing_time': 1765270800.0}
2025-12-05 06:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='334453') HTTP/1.1" 204 0
2025-12-05 06:03:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342669010>
2025-12-05 06:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74045680-8653-589c-9531-45230465fc45/74045680-8653-589c-9531-45230465fc45_image_14.jpg HTTP/1.1" 201 0
2025-12-05 06:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3346181-4008609-1000.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3346181-4008609-1000.jpg saved to cache
2025-12-05 06:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 74045680-8653-589c-9531-45230465fc45
2025-12-05 06:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/26525e2c-38f0-4f17-9548-24ab6d0cb9c5_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003346181-01993177-003.pdf)
2025-12-05 06:03:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234278cfd0>
2025-12-05 06:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_expert_report_file_50fa52b2-28ea-4812-b65a-255ac3c26947.pdf HTTP/1.1" 201 0
2025-12-05 06:03:31 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09
2025-12-05 06:03:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09, skipping ID generation
2025-12-05 06:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09
2025-12-05 06:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe81cff0c-e3be-4aff-8693-49cb9e90522f_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_ext_7.jpg not downloaded yet
2025-12-05 06:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/26525e2c-38f0-4f17-9548-24ab6d0cb9c5_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003346181-01993177-003.pdf)
2025-12-05 06:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/26525e2c-38f0-4f17-9548-24ab6d0cb9c5_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003346181-01993177-003.pdf)
2025-12-05 06:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe81cff0c-e3be-4aff-8693-49cb9e90522f_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_ext_7.jpg not downloaded yet
2025-12-05 06:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3346181-4008609-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003346181-01993177-003.pdf)
2025-12-05 06:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe81cff0c-e3be-4aff-8693-49cb9e90522f_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_ext_6.jpg not downloaded yet
2025-12-05 06:03:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234243e490>
2025-12-05 06:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74045680-8653-589c-9531-45230465fc45/74045680-8653-589c-9531-45230465fc45_image_10.jpg HTTP/1.1" 201 0
2025-12-05 06:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F26525e2c-38f0-4f17-9548-24ab6d0cb9c5_ext_5.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/26525e2c-38f0-4f17-9548-24ab6d0cb9c5_ext_5.jpg saved to cache
2025-12-05 06:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 74045680-8653-589c-9531-45230465fc45
2025-12-05 06:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe81cff0c-e3be-4aff-8693-49cb9e90522f_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_ext_1.jpg not downloaded yet
2025-12-05 06:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe81cff0c-e3be-4aff-8693-49cb9e90522f_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_5.jpg not downloaded yet
2025-12-05 06:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/PEUGEOT/2008?id=3368334&returnUrl=%2Fsearch%3FPage%3D3%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233368334&indx=205> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:03:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe81cff0c-e3be-4aff-8693-49cb9e90522f_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_4.jpg not downloaded yet
2025-12-05 06:03:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23426e6b50>
2025-12-05 06:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74045680-8653-589c-9531-45230465fc45/74045680-8653-589c-9531-45230465fc45_image_9.jpg HTTP/1.1" 201 0
2025-12-05 06:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F26525e2c-38f0-4f17-9548-24ab6d0cb9c5_ext_2.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/26525e2c-38f0-4f17-9548-24ab6d0cb9c5_ext_2.jpg saved to cache
2025-12-05 06:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 74045680-8653-589c-9531-45230465fc45
2025-12-05 06:03:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341f22850>
2025-12-05 06:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74045680-8653-589c-9531-45230465fc45/74045680-8653-589c-9531-45230465fc45_image_11.jpg HTTP/1.1" 201 0
2025-12-05 06:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F26525e2c-38f0-4f17-9548-24ab6d0cb9c5_ext_3.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/26525e2c-38f0-4f17-9548-24ab6d0cb9c5_ext_3.jpg saved to cache
2025-12-05 06:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 74045680-8653-589c-9531-45230465fc45
2025-12-05 06:03:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341ec99d0>
2025-12-05 06:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74045680-8653-589c-9531-45230465fc45/74045680-8653-589c-9531-45230465fc45_image_13.jpg HTTP/1.1" 201 0
2025-12-05 06:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3346181-4008609-13.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3346181-4008609-13.jpg saved to cache
2025-12-05 06:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 74045680-8653-589c-9531-45230465fc45
2025-12-05 06:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe81cff0c-e3be-4aff-8693-49cb9e90522f_11.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_11.jpg not downloaded yet
2025-12-05 06:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003375071-01987334-005.pdf)
2025-12-05 06:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003375071-01987334-005.pdf)
2025-12-05 06:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe81cff0c-e3be-4aff-8693-49cb9e90522f_10.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_10.jpg not downloaded yet
2025-12-05 06:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/26525e2c-38f0-4f17-9548-24ab6d0cb9c5_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003346181-01993177-003.pdf)
2025-12-05 06:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/26525e2c-38f0-4f17-9548-24ab6d0cb9c5_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003346181-01993177-003.pdf)
2025-12-05 06:03:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fbbcdf3e-5f4c-5ffb-8c18-0a88e6e7506a with identifier: 3368334
2025-12-05 06:03:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbbcdf3e-5f4c-5ffb-8c18-0a88e6e7506a with scrape type 2
2025-12-05 06:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fbbcdf3e-5f4c-5ffb-8c18-0a88e6e7506a with scrape type 2
2025-12-05 06:03:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: fbbcdf3e-5f4c-5ffb-8c18-0a88e6e7506a, identifier: 3368334
2025-12-05 06:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe81cff0c-e3be-4aff-8693-49cb9e90522f_9.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_9.jpg not downloaded yet
2025-12-05 06:03:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: fbbcdf3e-5f4c-5ffb-8c18-0a88e6e7506a with identifier: 3368334
2025-12-05 06:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 06:03:33 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=ORANGE HTTP/1.1" 200 None
2025-12-05 06:03:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 06:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 06:03:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: fbbcdf3e-5f4c-5ffb-8c18-0a88e6e7506a with identifier: 3368334
2025-12-05 06:03:33 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: fbbcdf3e-5f4c-5ffb-8c18-0a88e6e7506a with identifier: 3368334 to the API
2025-12-05 06:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 06:03:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 06:03:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/PEUGEOT/2008?id=3368334&returnUrl=%2Fsearch%3FPage%3D3%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233368334&indx=205>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003368334-01974566-001.pdf',
 'color': 'ORANGE',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'fbbcdf3e-5f4c-5ffb-8c18-0a88e6e7506a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'MJ71SXD',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/PEUGEOT/2008?id=3368334',
 'listing': 'auction',
 'location': 'Leeds',
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 37823,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-10',
 'seller_name': 'Leasys',
 'title': 'PEUGEOT 2008 1.2 PureTech 130 GT 5dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech 130 GT 5dr',
 'year': 2021}
2025-12-05 06:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273368334%27 HTTP/1.1" 200 None
2025-12-05 06:03:33 [manheim.gb] INFO: Saving data for 3368334: {'auction_closing_time': 1765184400.0, 'created_time': 1764792293.33295, 'last_price_update_time': 1764914613.559411}
2025-12-05 06:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3368334') HTTP/1.1" 204 0
2025-12-05 06:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe81cff0c-e3be-4aff-8693-49cb9e90522f_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_ext_2.jpg not downloaded yet
2025-12-05 06:03:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425e8b10>
2025-12-05 06:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_0.jpg HTTP/1.1" 201 0
2025-12-05 06:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe81cff0c-e3be-4aff-8693-49cb9e90522f_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_ext_7.jpg saved to cache
2025-12-05 06:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09
2025-12-05 06:03:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425e9f90>
2025-12-05 06:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_1.jpg HTTP/1.1" 201 0
2025-12-05 06:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe81cff0c-e3be-4aff-8693-49cb9e90522f_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_ext_7.jpg saved to cache
2025-12-05 06:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09
2025-12-05 06:03:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342757f90>
2025-12-05 06:03:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74045680-8653-589c-9531-45230465fc45/74045680-8653-589c-9531-45230465fc45_image_7.jpg HTTP/1.1" 201 0
2025-12-05 06:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F26525e2c-38f0-4f17-9548-24ab6d0cb9c5_10.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/26525e2c-38f0-4f17-9548-24ab6d0cb9c5_10.jpg saved to cache
2025-12-05 06:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 74045680-8653-589c-9531-45230465fc45
2025-12-05 06:03:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342524750>
2025-12-05 06:03:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74045680-8653-589c-9531-45230465fc45/74045680-8653-589c-9531-45230465fc45_image_8.jpg HTTP/1.1" 201 0
2025-12-05 06:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F26525e2c-38f0-4f17-9548-24ab6d0cb9c5_9.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/26525e2c-38f0-4f17-9548-24ab6d0cb9c5_9.jpg saved to cache
2025-12-05 06:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 74045680-8653-589c-9531-45230465fc45
2025-12-05 06:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003375071-01987334-005.pdf)
2025-12-05 06:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003375071-01987334-005.pdf)
2025-12-05 06:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003375071-01987334-005.pdf)
2025-12-05 06:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003375071-01987334-005.pdf)
2025-12-05 06:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe81cff0c-e3be-4aff-8693-49cb9e90522f_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_ext_5.jpg not downloaded yet
2025-12-05 06:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/TOYOTA/RAV4?id=3366127&returnUrl=%2Fsearch%3FPage%3D3%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233366127&indx=202> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003375071-01987334-005.pdf)
2025-12-05 06:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe81cff0c-e3be-4aff-8693-49cb9e90522f_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_ext_3.jpg not downloaded yet
2025-12-05 06:03:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe81cff0c-e3be-4aff-8693-49cb9e90522f_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_ext_4.jpg not downloaded yet
2025-12-05 06:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3375071-4002399-13.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3375071-4002399-13.jpg not downloaded yet
2025-12-05 06:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3375071-4002399-1000.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3375071-4002399-1000.jpg not downloaded yet
2025-12-05 06:03:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341ec8250>
2025-12-05 06:03:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_4.jpg HTTP/1.1" 201 0
2025-12-05 06:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe81cff0c-e3be-4aff-8693-49cb9e90522f_5.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_5.jpg saved to cache
2025-12-05 06:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09
2025-12-05 06:03:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342630a90>
2025-12-05 06:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_3.jpg HTTP/1.1" 201 0
2025-12-05 06:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe81cff0c-e3be-4aff-8693-49cb9e90522f_ext_1.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_ext_1.jpg saved to cache
2025-12-05 06:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09
2025-12-05 06:03:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425c6890>
2025-12-05 06:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_5.jpg HTTP/1.1" 201 0
2025-12-05 06:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe81cff0c-e3be-4aff-8693-49cb9e90522f_4.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_4.jpg saved to cache
2025-12-05 06:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09
2025-12-05 06:03:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341f20a50>
2025-12-05 06:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_6.jpg HTTP/1.1" 201 0
2025-12-05 06:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe81cff0c-e3be-4aff-8693-49cb9e90522f_11.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_11.jpg saved to cache
2025-12-05 06:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09
2025-12-05 06:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3375071-4002399-1001.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3375071-4002399-1001.jpg not downloaded yet
2025-12-05 06:03:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5989927c-e329-5764-be48-299f3ac6aeb1 with identifier: 3366127
2025-12-05 06:03:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5989927c-e329-5764-be48-299f3ac6aeb1 with scrape type 2
2025-12-05 06:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5989927c-e329-5764-be48-299f3ac6aeb1 with scrape type 2
2025-12-05 06:03:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 5989927c-e329-5764-be48-299f3ac6aeb1, identifier: 3366127
2025-12-05 06:03:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425a21d0>
2025-12-05 06:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_2.jpg HTTP/1.1" 201 0
2025-12-05 06:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe81cff0c-e3be-4aff-8693-49cb9e90522f_ext_6.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_ext_6.jpg saved to cache
2025-12-05 06:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09
2025-12-05 06:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003375071-01987334-005.pdf)
2025-12-05 06:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003375071-01987334-005.pdf)
2025-12-05 06:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3375071-4002399-1002.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3375071-4002399-1002.jpg not downloaded yet
2025-12-05 06:03:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 5989927c-e329-5764-be48-299f3ac6aeb1 with identifier: 3366127
2025-12-05 06:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 06:03:36 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Petrol%2FHybrid HTTP/1.1" 200 None
2025-12-05 06:03:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 06:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 06:03:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 5989927c-e329-5764-be48-299f3ac6aeb1 with identifier: 3366127
2025-12-05 06:03:36 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 5989927c-e329-5764-be48-299f3ac6aeb1 with identifier: 3366127 to the API
2025-12-05 06:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 06:03:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 06:03:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/TOYOTA/RAV4?id=3366127&returnUrl=%2Fsearch%3FPage%3D3%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233366127&indx=202>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003366127-01982090-002.pdf',
 'color': 'BLUE',
 'currency': 'GBP',
 'engine': '2.5L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Petrol/Hybrid',
 'id': '5989927c-e329-5764-be48-299f3ac6aeb1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'VK70VFP',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/TOYOTA/RAV4?id=3366127',
 'listing': 'auction',
 'location': 'Leeds',
 'make': 'TOYOTA',
 'model': 'RAV4',
 'odometer': 36256,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-19',
 'seller_name': 'Novuna Vehicle Solutions',
 'title': 'TOYOTA RAV4 2.5 VVT-i Hybrid Icon 5dr CVT 2WD',
 'transmission': 'automatic',
 'trim': '2.5 VVT-i Hybrid Icon 5dr CVT 2WD',
 'year': 2020}
2025-12-05 06:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273366127%27 HTTP/1.1" 200 None
2025-12-05 06:03:37 [manheim.gb] INFO: Saving data for 3366127: {'auction_closing_time': 1765184400.0, 'created_time': 1764792305.707353, 'last_price_update_time': 1764914617.114405}
2025-12-05 06:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3366127') HTTP/1.1" 204 0
2025-12-05 06:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/26525e2c-38f0-4f17-9548-24ab6d0cb9c5_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003346181-01993177-003.pdf)
2025-12-05 06:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003375071-01987334-005.pdf)
2025-12-05 06:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/26525e2c-38f0-4f17-9548-24ab6d0cb9c5_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003346181-01993177-003.pdf)
2025-12-05 06:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003375071-01987334-005.pdf)
2025-12-05 06:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3375071-4002399-1003.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3375071-4002399-1003.jpg not downloaded yet
2025-12-05 06:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3375071-4002399-1004.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3375071-4002399-1004.jpg not downloaded yet
2025-12-05 06:03:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425fbf90>
2025-12-05 06:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_8.jpg HTTP/1.1" 201 0
2025-12-05 06:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe81cff0c-e3be-4aff-8693-49cb9e90522f_9.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_9.jpg saved to cache
2025-12-05 06:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09
2025-12-05 06:03:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23415bedd0>
2025-12-05 06:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 06:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_7.jpg HTTP/1.1" 201 0
2025-12-05 06:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe81cff0c-e3be-4aff-8693-49cb9e90522f_10.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_10.jpg saved to cache
2025-12-05 06:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09
2025-12-05 06:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3375071-4002399-1005.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3375071-4002399-1005.jpg not downloaded yet
2025-12-05 06:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003375071-01987334-005.pdf)
2025-12-05 06:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3375071-4002399-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003375071-01987334-005.pdf)
2025-12-05 06:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003375071-01987334-005.pdf)
2025-12-05 06:03:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234238af10>
2025-12-05 06:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74045680-8653-589c-9531-45230465fc45/74045680-8653-589c-9531-45230465fc45_image_6.jpg HTTP/1.1" 201 0
2025-12-05 06:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F26525e2c-38f0-4f17-9548-24ab6d0cb9c5_11.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/26525e2c-38f0-4f17-9548-24ab6d0cb9c5_11.jpg saved to cache
2025-12-05 06:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 74045680-8653-589c-9531-45230465fc45
2025-12-05 06:03:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23424adc10>
2025-12-05 06:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_10.jpg HTTP/1.1" 201 0
2025-12-05 06:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe81cff0c-e3be-4aff-8693-49cb9e90522f_ext_5.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_ext_5.jpg saved to cache
2025-12-05 06:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09
2025-12-05 06:03:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23424df510>
2025-12-05 06:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74045680-8653-589c-9531-45230465fc45/74045680-8653-589c-9531-45230465fc45_image_5.jpg HTTP/1.1" 201 0
2025-12-05 06:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F26525e2c-38f0-4f17-9548-24ab6d0cb9c5_4.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/26525e2c-38f0-4f17-9548-24ab6d0cb9c5_4.jpg saved to cache
2025-12-05 06:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 74045680-8653-589c-9531-45230465fc45
2025-12-05 06:03:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23423411d0>
2025-12-05 06:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_9.jpg HTTP/1.1" 201 0
2025-12-05 06:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe81cff0c-e3be-4aff-8693-49cb9e90522f_ext_2.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_ext_2.jpg saved to cache
2025-12-05 06:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09
2025-12-05 06:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3375071-4002399-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003375071-01987334-005.pdf)
2025-12-05 06:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3375071-4002399-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003375071-01987334-005.pdf)
2025-12-05 06:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3375071-4002399-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003375071-01987334-005.pdf)
2025-12-05 06:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/PEUGEOT/208?id=3503375&returnUrl=%2Fsearch%3FPage%3D3%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233503375&indx=219> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:03:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:03:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234266a290>
2025-12-05 06:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_12.jpg HTTP/1.1" 201 0
2025-12-05 06:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe81cff0c-e3be-4aff-8693-49cb9e90522f_ext_4.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_ext_4.jpg saved to cache
2025-12-05 06:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09
2025-12-05 06:03:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23424e4290>
2025-12-05 06:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_16.jpg HTTP/1.1" 201 0
2025-12-05 06:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3375071-4002399-1002.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3375071-4002399-1002.jpg saved to cache
2025-12-05 06:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09
2025-12-05 06:03:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23424a1410>
2025-12-05 06:03:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_11.jpg HTTP/1.1" 201 0
2025-12-05 06:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe81cff0c-e3be-4aff-8693-49cb9e90522f_ext_3.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_ext_3.jpg saved to cache
2025-12-05 06:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09
2025-12-05 06:03:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3375071-4002399-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003375071-01987334-005.pdf)
2025-12-05 06:03:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/26525e2c-38f0-4f17-9548-24ab6d0cb9c5_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003346181-01993177-003.pdf)
2025-12-05 06:03:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/26525e2c-38f0-4f17-9548-24ab6d0cb9c5_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003346181-01993177-003.pdf)
2025-12-05 06:03:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/26525e2c-38f0-4f17-9548-24ab6d0cb9c5_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003346181-01993177-003.pdf)
2025-12-05 06:03:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425f8e90>
2025-12-05 06:03:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_15.jpg HTTP/1.1" 201 0
2025-12-05 06:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3375071-4002399-1001.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3375071-4002399-1001.jpg saved to cache
2025-12-05 06:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09
2025-12-05 06:03:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23426c44d0>
2025-12-05 06:03:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_14.jpg HTTP/1.1" 201 0
2025-12-05 06:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3375071-4002399-1000.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3375071-4002399-1000.jpg saved to cache
2025-12-05 06:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09
2025-12-05 06:03:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342501dd0>
2025-12-05 06:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_13.jpg HTTP/1.1" 201 0
2025-12-05 06:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3375071-4002399-13.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3375071-4002399-13.jpg saved to cache
2025-12-05 06:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09
2025-12-05 06:03:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82b277c2-1593-59af-b2dc-3c987cf84e54 with identifier: 3503375
2025-12-05 06:03:41 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 82b277c2-1593-59af-b2dc-3c987cf84e54
2025-12-05 06:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3375071-4002399-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003375071-01987334-005.pdf)
2025-12-05 06:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3375071-4002399-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003375071-01987334-005.pdf)
2025-12-05 06:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/26525e2c-38f0-4f17-9548-24ab6d0cb9c5_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003346181-01993177-003.pdf)
2025-12-05 06:03:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234264f990>
2025-12-05 06:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_18.jpg HTTP/1.1" 201 0
2025-12-05 06:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3375071-4002399-1004.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3375071-4002399-1004.jpg saved to cache
2025-12-05 06:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09
2025-12-05 06:03:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342343d90>
2025-12-05 06:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74045680-8653-589c-9531-45230465fc45/74045680-8653-589c-9531-45230465fc45_image_3.jpg HTTP/1.1" 201 0
2025-12-05 06:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F26525e2c-38f0-4f17-9548-24ab6d0cb9c5_ext_1.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/26525e2c-38f0-4f17-9548-24ab6d0cb9c5_ext_1.jpg saved to cache
2025-12-05 06:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 74045680-8653-589c-9531-45230465fc45
2025-12-05 06:03:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23426aa190>
2025-12-05 06:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74045680-8653-589c-9531-45230465fc45/74045680-8653-589c-9531-45230465fc45_image_1.jpg HTTP/1.1" 201 0
2025-12-05 06:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F26525e2c-38f0-4f17-9548-24ab6d0cb9c5_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/26525e2c-38f0-4f17-9548-24ab6d0cb9c5_ext_7.jpg saved to cache
2025-12-05 06:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 74045680-8653-589c-9531-45230465fc45
2025-12-05 06:03:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342755150>
2025-12-05 06:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74045680-8653-589c-9531-45230465fc45/74045680-8653-589c-9531-45230465fc45_image_2.jpg HTTP/1.1" 201 0
2025-12-05 06:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F26525e2c-38f0-4f17-9548-24ab6d0cb9c5_ext_6.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/26525e2c-38f0-4f17-9548-24ab6d0cb9c5_ext_6.jpg saved to cache
2025-12-05 06:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 74045680-8653-589c-9531-45230465fc45
2025-12-05 06:03:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2343e30f10>
2025-12-05 06:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_19.jpg HTTP/1.1" 201 0
2025-12-05 06:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3375071-4002399-1005.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3375071-4002399-1005.jpg saved to cache
2025-12-05 06:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09
2025-12-05 06:03:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425a1190>
2025-12-05 06:03:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_17.jpg HTTP/1.1" 201 0
2025-12-05 06:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3375071-4002399-1003.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3375071-4002399-1003.jpg saved to cache
2025-12-05 06:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09
2025-12-05 06:03:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09, skipping ID generation
2025-12-05 06:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09 from tracking dictionaries
2025-12-05 06:03:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09 sending to next pipeline
2025-12-05 06:03:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09, identifier: 3375071
2025-12-05 06:03:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425d4b90>
2025-12-05 06:03:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74045680-8653-589c-9531-45230465fc45/74045680-8653-589c-9531-45230465fc45_image_0.jpg HTTP/1.1" 201 0
2025-12-05 06:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F26525e2c-38f0-4f17-9548-24ab6d0cb9c5_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/26525e2c-38f0-4f17-9548-24ab6d0cb9c5_ext_7.jpg saved to cache
2025-12-05 06:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 74045680-8653-589c-9531-45230465fc45
2025-12-05 06:03:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 74045680-8653-589c-9531-45230465fc45, skipping ID generation
2025-12-05 06:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 74045680-8653-589c-9531-45230465fc45 from tracking dictionaries
2025-12-05 06:03:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 74045680-8653-589c-9531-45230465fc45 sending to next pipeline
2025-12-05 06:03:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 74045680-8653-589c-9531-45230465fc45, identifier: 3346181
2025-12-05 06:03:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09 with identifier: 3375071
2025-12-05 06:03:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09 with identifier: 3375071
2025-12-05 06:03:44 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 21, 'seller_name': 'big motoring world ltd', 'price_includes_vat': False, 'title': 'audi e-tron 300kw 55 quattro 95kwh s line 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'audi', 'model': 'e-tron', 'transmission': 'automatic', 'engine': '0.0l', 'fuel_type': 'electric', 'odometer': 78035, 'odometer_reading_unit': 'mi', 'registration_date': '2020-11-30', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/audi/e-tron?id=3375071', 'location': 'colchester', 'origin_country_code': 'gb', 'trim': '300kw 55 quattro 95kwh s line 5dr auto', 'license_plate': 'nd70fug', 'year': 2020, 'listing': 'auction', 'c_o_2_emission_value': 0, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0003375071-01987334-005.pdf', 'expiration_date': '2025-12-09t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': '4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09', 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_expert_report_file_50fa52b2-28ea-4812-b65a-255ac3c26947.pdf', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_0.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_ext_7.jpg', 'Width': 1499, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 182141}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_1.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_ext_7.jpg', 'Width': 1499, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 182141}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_2.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_ext_6.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 269398}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_3.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_ext_1.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 169768}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_4.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_5.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 184117}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_5.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_4.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 169870}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_6.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_11.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 170177}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_7.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_10.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 162988}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_8.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_9.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 175979}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_9.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_ext_2.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 298000}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_10.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_ext_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 254448}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_11.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_ext_3.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 227274}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_12.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_ext_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 236446}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_13.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3375071-4002399-13.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 375852}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_14.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3375071-4002399-1000.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 359279}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_15.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3375071-4002399-1001.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 284729}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_16.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3375071-4002399-1002.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 203217}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_17.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3375071-4002399-1003.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 436201}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_18.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3375071-4002399-1004.jpg', 'Width': 749, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 147572}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_19.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3375071-4002399-1005.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 305000}], 'current_year_diff': 5, 'age_in_months': 60, 'make_model': 'audi e-tron', 'sanitized_make': 'audi', 'odometer_in_km': 125584} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 60,
     'auction_title': '',
     'c_o_2_emission_value': 0,
     'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_expert_report_file_50fa52b2-28ea-4812-b65a-255ac3c26947.pdf',
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0003375071-01987334-005.pdf',
     'color': 'white',
     'currency': 'gbp',
     'current_year_diff': 5,
     'engine': '0.0l',
     'expiration_date': '2025-12-09t09:00:00z',
     'fuel_type': 'electric',
     'id': '4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'nd70fug',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/audi/e-tron?id=3375071',
     'listing': 'auction',
     'location': 'colchester',
     'make': 'audi',
     'make_model': 'audi e-tron',
     'model': 'e-tron',
     'odometer': 78035,
     'odometer_in_km': 125584,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 21,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 182141,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_ext_7.jpg',
                 'Width': 1499},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 182141,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_ext_7.jpg',
                 'Width': 1499},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 269398,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_ext_6.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 169768,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_ext_1.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 184117,
                 'Height': 999,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_5.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 169870,
                 'Height': 999,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_4.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 170177,
                 'Height': 999,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_11.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 162988,
                 'Height': 999,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_10.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 175979,
                 'Height': 999,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_9.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 298000,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_ext_2.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 254448,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_ext_5.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 227274,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_ext_3.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 236446,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_ext_4.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 375852,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3375071-4002399-13.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 359279,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3375071-4002399-1000.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_15.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 284729,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3375071-4002399-1001.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_16.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 203217,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3375071-4002399-1002.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_17.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 436201,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3375071-4002399-1003.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_18.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 147572,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3375071-4002399-1004.jpg',
                 'Width': 749},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_19.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 305000,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3375071-4002399-1005.jpg',
                 'Width': 1333}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2020-11-30',
     'sanitized_make': 'audi',
     'seller_name': 'big motoring world ltd',
     'title': 'audi e-tron 300kw 55 quattro 95kwh s line 5dr auto',
     'transmission': 'automatic',
     'trim': '300kw 55 quattro 95kwh s line 5dr auto',
     'year': 2020}
2025-12-05 06:03:44 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09 spider: manheim.gb
2025-12-05 06:03:44 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 21, 'seller_name': 'big motoring world ltd', 'price_includes_vat': False, 'title': 'audi e-tron 300kw 55 quattro 95kwh s line 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'audi', 'model': 'e-tron', 'transmission': 'automatic', 'engine': '0.0l', 'fuel_type': 'electric', 'odometer': 78035, 'odometer_reading_unit': 'mi', 'registration_date': '2020-11-30', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/audi/e-tron?id=3375071', 'location': 'colchester', 'origin_country_code': 'gb', 'trim': '300kw 55 quattro 95kwh s line 5dr auto', 'license_plate': 'nd70fug', 'year': 2020, 'listing': 'auction', 'c_o_2_emission_value': 0, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0003375071-01987334-005.pdf', 'expiration_date': '2025-12-09t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': '4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09', 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_expert_report_file_50fa52b2-28ea-4812-b65a-255ac3c26947.pdf', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_0.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_ext_7.jpg', 'Width': 1499, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 182141}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_1.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_ext_7.jpg', 'Width': 1499, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 182141}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_2.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_ext_6.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 269398}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_3.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_ext_1.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 169768}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_4.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_5.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 184117}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_5.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_4.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 169870}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_6.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_11.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 170177}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_7.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_10.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 162988}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_8.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_9.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 175979}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_9.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_ext_2.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 298000}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_10.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_ext_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 254448}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_11.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_ext_3.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 227274}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_12.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_ext_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 236446}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_13.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3375071-4002399-13.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 375852}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_14.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3375071-4002399-1000.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 359279}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_15.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3375071-4002399-1001.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 284729}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_16.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3375071-4002399-1002.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 203217}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_17.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3375071-4002399-1003.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 436201}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_18.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3375071-4002399-1004.jpg', 'Width': 749, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 147572}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_19.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3375071-4002399-1005.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 305000}], 'current_year_diff': 5, 'age_in_months': 60, 'make_model': 'audi e-tron', 'sanitized_make': 'audi', 'odometer_in_km': 125584} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 60,
     'auction_title': '',
     'c_o_2_emission_value': 0,
     'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_expert_report_file_50fa52b2-28ea-4812-b65a-255ac3c26947.pdf',
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0003375071-01987334-005.pdf',
     'color': 'white',
     'currency': 'gbp',
     'current_year_diff': 5,
     'engine': '0.0l',
     'expiration_date': '2025-12-09t09:00:00z',
     'fuel_type': 'electric',
     'id': '4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'nd70fug',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/audi/e-tron?id=3375071',
     'listing': 'auction',
     'location': 'colchester',
     'make': 'audi',
     'make_model': 'audi e-tron',
     'model': 'e-tron',
     'odometer': 78035,
     'odometer_in_km': 125584,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 21,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 182141,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_ext_7.jpg',
                 'Width': 1499},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 182141,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_ext_7.jpg',
                 'Width': 1499},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 269398,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_ext_6.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 169768,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_ext_1.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 184117,
                 'Height': 999,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_5.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 169870,
                 'Height': 999,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_4.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 170177,
                 'Height': 999,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_11.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 162988,
                 'Height': 999,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_10.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 175979,
                 'Height': 999,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_9.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 298000,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_ext_2.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 254448,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_ext_5.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 227274,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_ext_3.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 236446,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_ext_4.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 375852,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3375071-4002399-13.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 359279,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3375071-4002399-1000.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_15.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 284729,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3375071-4002399-1001.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_16.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 203217,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3375071-4002399-1002.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_17.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 436201,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3375071-4002399-1003.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_18.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 147572,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3375071-4002399-1004.jpg',
                 'Width': 749},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_19.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 305000,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3375071-4002399-1005.jpg',
                 'Width': 1333}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2020-11-30',
     'sanitized_make': 'audi',
     'seller_name': 'big motoring world ltd',
     'title': 'audi e-tron 300kw 55 quattro 95kwh s line 5dr auto',
     'transmission': 'automatic',
     'trim': '300kw 55 quattro 95kwh s line 5dr auto',
     'year': 2020}
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_expert_report_file_50fa52b2-28ea-4812-b65a-255ac3c26947.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003375071-01987334-005.pdf',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '0.0L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Electric',
 'id': '4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'ND70FUG',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/AUDI/E-TRON?id=3375071',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'AUDI',
 'model': 'E-TRON',
 'odometer': 78035,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 182141,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 182141,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 269398,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 169768,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 184117,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_5.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 169870,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_4.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 170177,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_11.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 162988,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_10.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 175979,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_9.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 298000,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 254448,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 227274,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 236446,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e81cff0c-e3be-4aff-8693-49cb9e90522f_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 375852,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3375071-4002399-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 359279,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3375071-4002399-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 284729,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3375071-4002399-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 203217,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3375071-4002399-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 436201,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3375071-4002399-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 147572,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3375071-4002399-1004.jpg',
             'Width': 749},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09/4f6d9821-efd5-5d7d-ae7a-f62f82ffcd09_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 305000,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3375071-4002399-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-30',
 'seller_name': 'Big Motoring World Ltd',
 'title': 'AUDI E-TRON 300kW 55 Quattro 95kWh S Line 5dr Auto',
 'transmission': 'automatic',
 'trim': '300kW 55 Quattro 95kWh S Line 5dr Auto',
 'year': 2020}
2025-12-05 06:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273375071%27 HTTP/1.1" 200 None
2025-12-05 06:03:44 [manheim.gb] INFO: Saving data for 3375071: {'created_time': 1764914624.17958, 'last_price_update_time': 1764914624.179594, 'auction_closing_time': 1765270800.0}
2025-12-05 06:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3375071') HTTP/1.1" 204 0
2025-12-05 06:03:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 74045680-8653-589c-9531-45230465fc45 with identifier: 3346181
2025-12-05 06:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 06:03:44 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Petrol+PHEV HTTP/1.1" 200 None
2025-12-05 06:03:44 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 06:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 06:03:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 74045680-8653-589c-9531-45230465fc45 with identifier: 3346181
2025-12-05 06:03:44 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 74045680-8653-589c-9531-45230465fc45 with identifier: 3346181 to the API
2025-12-05 06:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 06:03:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 06:03:44 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/26525e2c-38f0-4f17-9548-24ab6d0cb9c5_ext_7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 23,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74045680-8653-589c-9531-45230465fc45/74045680-8653-589c-9531-45230465fc45_expert_report_file_8a07702d-4858-425c-bed9-146778077a74.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003346181-01993177-003.pdf',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '1.3L',
 'expiration_date': '2025-12-11T09:00:00Z',
 'fuel_type': 'Petrol PHEV',
 'id': '74045680-8653-589c-9531-45230465fc45',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'WN70VJL',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/CLA?id=3346181',
 'listing': 'auction',
 'location': 'Shotts',
 'make': 'MERCEDES-BENZ',
 'model': 'CLA',
 'odometer': 37474,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 30,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74045680-8653-589c-9531-45230465fc45/74045680-8653-589c-9531-45230465fc45_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 244694,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/26525e2c-38f0-4f17-9548-24ab6d0cb9c5_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74045680-8653-589c-9531-45230465fc45/74045680-8653-589c-9531-45230465fc45_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 244694,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/26525e2c-38f0-4f17-9548-24ab6d0cb9c5_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74045680-8653-589c-9531-45230465fc45/74045680-8653-589c-9531-45230465fc45_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 218929,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/26525e2c-38f0-4f17-9548-24ab6d0cb9c5_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74045680-8653-589c-9531-45230465fc45/74045680-8653-589c-9531-45230465fc45_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 174279,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/26525e2c-38f0-4f17-9548-24ab6d0cb9c5_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74045680-8653-589c-9531-45230465fc45/74045680-8653-589c-9531-45230465fc45_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 251448,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/26525e2c-38f0-4f17-9548-24ab6d0cb9c5_5.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74045680-8653-589c-9531-45230465fc45/74045680-8653-589c-9531-45230465fc45_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 238776,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/26525e2c-38f0-4f17-9548-24ab6d0cb9c5_4.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74045680-8653-589c-9531-45230465fc45/74045680-8653-589c-9531-45230465fc45_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 250261,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/26525e2c-38f0-4f17-9548-24ab6d0cb9c5_11.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74045680-8653-589c-9531-45230465fc45/74045680-8653-589c-9531-45230465fc45_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 232704,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/26525e2c-38f0-4f17-9548-24ab6d0cb9c5_10.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74045680-8653-589c-9531-45230465fc45/74045680-8653-589c-9531-45230465fc45_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 242119,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/26525e2c-38f0-4f17-9548-24ab6d0cb9c5_9.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74045680-8653-589c-9531-45230465fc45/74045680-8653-589c-9531-45230465fc45_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 242523,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/26525e2c-38f0-4f17-9548-24ab6d0cb9c5_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74045680-8653-589c-9531-45230465fc45/74045680-8653-589c-9531-45230465fc45_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 202638,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/26525e2c-38f0-4f17-9548-24ab6d0cb9c5_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74045680-8653-589c-9531-45230465fc45/74045680-8653-589c-9531-45230465fc45_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 223563,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/26525e2c-38f0-4f17-9548-24ab6d0cb9c5_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74045680-8653-589c-9531-45230465fc45/74045680-8653-589c-9531-45230465fc45_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 256601,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/26525e2c-38f0-4f17-9548-24ab6d0cb9c5_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74045680-8653-589c-9531-45230465fc45/74045680-8653-589c-9531-45230465fc45_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 377774,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3346181-4008609-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74045680-8653-589c-9531-45230465fc45/74045680-8653-589c-9531-45230465fc45_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 377152,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3346181-4008609-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74045680-8653-589c-9531-45230465fc45/74045680-8653-589c-9531-45230465fc45_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 294475,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3346181-4008609-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74045680-8653-589c-9531-45230465fc45/74045680-8653-589c-9531-45230465fc45_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 240896,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3346181-4008609-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74045680-8653-589c-9531-45230465fc45/74045680-8653-589c-9531-45230465fc45_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 377026,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3346181-4008609-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74045680-8653-589c-9531-45230465fc45/74045680-8653-589c-9531-45230465fc45_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 310183,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3346181-4008609-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74045680-8653-589c-9531-45230465fc45/74045680-8653-589c-9531-45230465fc45_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 498744,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3346181-4008609-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-30',
 'seller_name': 'FCA Group',
 'title': 'MERCEDES-BENZ CLA CLA 250e AMG Line Premium 4dr Tip Auto',
 'transmission': 'automatic',
 'trim': 'CLA 250e AMG Line Premium 4dr Tip Auto',
 'year': 2020}
2025-12-05 06:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273346181%27 HTTP/1.1" 200 None
2025-12-05 06:03:44 [manheim.gb] INFO: Saving data for 3346181: {'created_time': 1764914624.733867, 'last_price_update_time': 1764914624.73388, 'auction_closing_time': 1765443600.0}
2025-12-05 06:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3346181') HTTP/1.1" 204 0
2025-12-05 06:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VAUXHALL/GRANDLAND?id=3780546&returnUrl=%2Fsearch%3FPage%3D3%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233780546&indx=299> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:03:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003503375-01992995-001.pdf> (referer: None)
2025-12-05 06:03:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc30a7f1-e5c4-5241-bd1d-06f8594e5351 with identifier: 3780546
2025-12-05 06:03:44 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item fc30a7f1-e5c4-5241-bd1d-06f8594e5351
2025-12-05 06:03:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23426e4c10>
2025-12-05 06:03:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82b277c2-1593-59af-b2dc-3c987cf84e54/82b277c2-1593-59af-b2dc-3c987cf84e54_expert_report_file_9135562e-9d63-42e8-86b4-e7fd0dbb7c78.pdf HTTP/1.1" 201 0
2025-12-05 06:03:45 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 82b277c2-1593-59af-b2dc-3c987cf84e54
2025-12-05 06:03:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 82b277c2-1593-59af-b2dc-3c987cf84e54, skipping ID generation
2025-12-05 06:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 82b277c2-1593-59af-b2dc-3c987cf84e54
2025-12-05 06:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_ext_7.jpg not downloaded yet
2025-12-05 06:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_ext_7.jpg not downloaded yet
2025-12-05 06:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_ext_6.jpg not downloaded yet
2025-12-05 06:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_ext_1.jpg not downloaded yet
2025-12-05 06:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_5.jpg not downloaded yet
2025-12-05 06:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_4.jpg not downloaded yet
2025-12-05 06:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_11.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_11.jpg not downloaded yet
2025-12-05 06:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_10.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_10.jpg not downloaded yet
2025-12-05 06:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_9.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_9.jpg not downloaded yet
2025-12-05 06:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_ext_2.jpg not downloaded yet
2025-12-05 06:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_ext_5.jpg not downloaded yet
2025-12-05 06:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_ext_3.jpg not downloaded yet
2025-12-05 06:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_ext_4.jpg not downloaded yet
2025-12-05 06:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3503375-4008869-13.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3503375-4008869-13.jpg not downloaded yet
2025-12-05 06:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003780546-01983656-003.pdf> (referer: None)
2025-12-05 06:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3503375-4008869-1000.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3503375-4008869-1000.jpg not downloaded yet
2025-12-05 06:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3503375-4008869-1001.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3503375-4008869-1001.jpg not downloaded yet
2025-12-05 06:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3503375-4008869-1002.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3503375-4008869-1002.jpg not downloaded yet
2025-12-05 06:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3503375-4008869-1003.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3503375-4008869-1003.jpg not downloaded yet
2025-12-05 06:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3503375-4008869-1004.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3503375-4008869-1004.jpg not downloaded yet
2025-12-05 06:03:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342671a50>
2025-12-05 06:03:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc30a7f1-e5c4-5241-bd1d-06f8594e5351/fc30a7f1-e5c4-5241-bd1d-06f8594e5351_expert_report_file_17f789d4-ea71-4c5f-b300-84afdb81dd98.pdf HTTP/1.1" 201 0
2025-12-05 06:03:46 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item fc30a7f1-e5c4-5241-bd1d-06f8594e5351
2025-12-05 06:03:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fc30a7f1-e5c4-5241-bd1d-06f8594e5351, skipping ID generation
2025-12-05 06:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item fc30a7f1-e5c4-5241-bd1d-06f8594e5351
2025-12-05 06:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa8587282-d24f-4bed-9861-a3b25f5902e2_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a8587282-d24f-4bed-9861-a3b25f5902e2_ext_7.jpg not downloaded yet
2025-12-05 06:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3503375-4008869-1005.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3503375-4008869-1005.jpg not downloaded yet
2025-12-05 06:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa8587282-d24f-4bed-9861-a3b25f5902e2_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a8587282-d24f-4bed-9861-a3b25f5902e2_ext_7.jpg not downloaded yet
2025-12-05 06:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa8587282-d24f-4bed-9861-a3b25f5902e2_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a8587282-d24f-4bed-9861-a3b25f5902e2_ext_6.jpg not downloaded yet
2025-12-05 06:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa8587282-d24f-4bed-9861-a3b25f5902e2_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a8587282-d24f-4bed-9861-a3b25f5902e2_ext_1.jpg not downloaded yet
2025-12-05 06:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa8587282-d24f-4bed-9861-a3b25f5902e2_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a8587282-d24f-4bed-9861-a3b25f5902e2_5.jpg not downloaded yet
2025-12-05 06:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa8587282-d24f-4bed-9861-a3b25f5902e2_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a8587282-d24f-4bed-9861-a3b25f5902e2_4.jpg not downloaded yet
2025-12-05 06:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa8587282-d24f-4bed-9861-a3b25f5902e2_11.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a8587282-d24f-4bed-9861-a3b25f5902e2_11.jpg not downloaded yet
2025-12-05 06:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa8587282-d24f-4bed-9861-a3b25f5902e2_10.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a8587282-d24f-4bed-9861-a3b25f5902e2_10.jpg not downloaded yet
2025-12-05 06:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa8587282-d24f-4bed-9861-a3b25f5902e2_9.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a8587282-d24f-4bed-9861-a3b25f5902e2_9.jpg not downloaded yet
2025-12-05 06:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa8587282-d24f-4bed-9861-a3b25f5902e2_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a8587282-d24f-4bed-9861-a3b25f5902e2_ext_2.jpg not downloaded yet
2025-12-05 06:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa8587282-d24f-4bed-9861-a3b25f5902e2_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a8587282-d24f-4bed-9861-a3b25f5902e2_ext_5.jpg not downloaded yet
2025-12-05 06:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa8587282-d24f-4bed-9861-a3b25f5902e2_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a8587282-d24f-4bed-9861-a3b25f5902e2_ext_3.jpg not downloaded yet
2025-12-05 06:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa8587282-d24f-4bed-9861-a3b25f5902e2_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a8587282-d24f-4bed-9861-a3b25f5902e2_ext_4.jpg not downloaded yet
2025-12-05 06:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3780546-3999371-13.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3780546-3999371-13.jpg not downloaded yet
2025-12-05 06:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3780546-3999371-1000.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3780546-3999371-1000.jpg not downloaded yet
2025-12-05 06:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3780546-3999371-1001.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3780546-3999371-1001.jpg not downloaded yet
2025-12-05 06:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3780546-3999371-1002.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3780546-3999371-1002.jpg not downloaded yet
2025-12-05 06:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a8587282-d24f-4bed-9861-a3b25f5902e2_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003780546-01983656-003.pdf)
2025-12-05 06:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3780546-3999371-1003.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3780546-3999371-1003.jpg not downloaded yet
2025-12-05 06:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3780546-3999371-1004.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3780546-3999371-1004.jpg not downloaded yet
2025-12-05 06:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3780546-3999371-1005.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3780546-3999371-1005.jpg not downloaded yet
2025-12-05 06:03:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234247ba50>
2025-12-05 06:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc30a7f1-e5c4-5241-bd1d-06f8594e5351/fc30a7f1-e5c4-5241-bd1d-06f8594e5351_image_2.jpg HTTP/1.1" 201 0
2025-12-05 06:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa8587282-d24f-4bed-9861-a3b25f5902e2_ext_6.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a8587282-d24f-4bed-9861-a3b25f5902e2_ext_6.jpg saved to cache
2025-12-05 06:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fc30a7f1-e5c4-5241-bd1d-06f8594e5351
2025-12-05 06:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3780546-3999371-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003780546-01983656-003.pdf)
2025-12-05 06:03:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23424ea550>
2025-12-05 06:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc30a7f1-e5c4-5241-bd1d-06f8594e5351/fc30a7f1-e5c4-5241-bd1d-06f8594e5351_image_16.jpg HTTP/1.1" 201 0
2025-12-05 06:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3780546-3999371-1002.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3780546-3999371-1002.jpg saved to cache
2025-12-05 06:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item fc30a7f1-e5c4-5241-bd1d-06f8594e5351
2025-12-05 06:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/CITROEN/C5?id=3779127&returnUrl=%2Fsearch%3FPage%3D3%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233779127&indx=298> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:03:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3780546-3999371-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003780546-01983656-003.pdf)
2025-12-05 06:03:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1efb7f0-a31b-5a6d-a39c-a0009a989668 with identifier: 3779127
2025-12-05 06:03:47 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item e1efb7f0-a31b-5a6d-a39c-a0009a989668
2025-12-05 06:03:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23427a7990>
2025-12-05 06:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc30a7f1-e5c4-5241-bd1d-06f8594e5351/fc30a7f1-e5c4-5241-bd1d-06f8594e5351_image_19.jpg HTTP/1.1" 201 0
2025-12-05 06:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3780546-3999371-1005.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3780546-3999371-1005.jpg saved to cache
2025-12-05 06:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item fc30a7f1-e5c4-5241-bd1d-06f8594e5351
2025-12-05 06:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3780546-3999371-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003780546-01983656-003.pdf)
2025-12-05 06:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3780546-3999371-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003780546-01983656-003.pdf)
2025-12-05 06:03:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23415db090>
2025-12-05 06:03:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 06:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc30a7f1-e5c4-5241-bd1d-06f8594e5351/fc30a7f1-e5c4-5241-bd1d-06f8594e5351_image_17.jpg HTTP/1.1" 201 0
2025-12-05 06:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3780546-3999371-1003.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3780546-3999371-1003.jpg saved to cache
2025-12-05 06:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item fc30a7f1-e5c4-5241-bd1d-06f8594e5351
2025-12-05 06:03:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341ec0390>
2025-12-05 06:03:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc30a7f1-e5c4-5241-bd1d-06f8594e5351/fc30a7f1-e5c4-5241-bd1d-06f8594e5351_image_18.jpg HTTP/1.1" 201 0
2025-12-05 06:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3780546-3999371-1004.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3780546-3999371-1004.jpg saved to cache
2025-12-05 06:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item fc30a7f1-e5c4-5241-bd1d-06f8594e5351
2025-12-05 06:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3780546-3999371-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003780546-01983656-003.pdf)
2025-12-05 06:03:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342496190>
2025-12-05 06:03:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc30a7f1-e5c4-5241-bd1d-06f8594e5351/fc30a7f1-e5c4-5241-bd1d-06f8594e5351_image_15.jpg HTTP/1.1" 201 0
2025-12-05 06:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3780546-3999371-1001.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3780546-3999371-1001.jpg saved to cache
2025-12-05 06:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item fc30a7f1-e5c4-5241-bd1d-06f8594e5351
2025-12-05 06:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3780546-3999371-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003780546-01983656-003.pdf)
2025-12-05 06:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003779127-01955168-004.pdf> (referer: None)
2025-12-05 06:03:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23424a3910>
2025-12-05 06:03:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc30a7f1-e5c4-5241-bd1d-06f8594e5351/fc30a7f1-e5c4-5241-bd1d-06f8594e5351_image_14.jpg HTTP/1.1" 201 0
2025-12-05 06:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3780546-3999371-1000.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3780546-3999371-1000.jpg saved to cache
2025-12-05 06:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item fc30a7f1-e5c4-5241-bd1d-06f8594e5351
2025-12-05 06:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a8587282-d24f-4bed-9861-a3b25f5902e2_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003780546-01983656-003.pdf)
2025-12-05 06:03:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234266ba50>
2025-12-05 06:03:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1efb7f0-a31b-5a6d-a39c-a0009a989668/e1efb7f0-a31b-5a6d-a39c-a0009a989668_expert_report_file_12381eb1-11b0-45e6-8f4a-baa27a638fb8.pdf HTTP/1.1" 201 0
2025-12-05 06:03:50 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item e1efb7f0-a31b-5a6d-a39c-a0009a989668
2025-12-05 06:03:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e1efb7f0-a31b-5a6d-a39c-a0009a989668, skipping ID generation
2025-12-05 06:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item e1efb7f0-a31b-5a6d-a39c-a0009a989668
2025-12-05 06:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F73170474-2804-4601-b51a-3dc0f987b70a_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/73170474-2804-4601-b51a-3dc0f987b70a_ext_7.jpg not downloaded yet
2025-12-05 06:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3780546-3999371-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003780546-01983656-003.pdf)
2025-12-05 06:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F73170474-2804-4601-b51a-3dc0f987b70a_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/73170474-2804-4601-b51a-3dc0f987b70a_ext_7.jpg not downloaded yet
2025-12-05 06:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F73170474-2804-4601-b51a-3dc0f987b70a_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/73170474-2804-4601-b51a-3dc0f987b70a_ext_6.jpg not downloaded yet
2025-12-05 06:03:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234278cad0>
2025-12-05 06:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc30a7f1-e5c4-5241-bd1d-06f8594e5351/fc30a7f1-e5c4-5241-bd1d-06f8594e5351_image_12.jpg HTTP/1.1" 201 0
2025-12-05 06:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa8587282-d24f-4bed-9861-a3b25f5902e2_ext_4.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a8587282-d24f-4bed-9861-a3b25f5902e2_ext_4.jpg saved to cache
2025-12-05 06:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item fc30a7f1-e5c4-5241-bd1d-06f8594e5351
2025-12-05 06:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F73170474-2804-4601-b51a-3dc0f987b70a_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/73170474-2804-4601-b51a-3dc0f987b70a_ext_1.jpg not downloaded yet
2025-12-05 06:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/PEUGEOT/208?id=3759761&returnUrl=%2Fsearch%3FPage%3D3%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233759761&indx=294> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F73170474-2804-4601-b51a-3dc0f987b70a_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/73170474-2804-4601-b51a-3dc0f987b70a_5.jpg not downloaded yet
2025-12-05 06:03:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/PEUGEOT/2008?id=3770420&returnUrl=%2Fsearch%3FPage%3D3%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233770420&indx=297> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a8587282-d24f-4bed-9861-a3b25f5902e2_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003780546-01983656-003.pdf)
2025-12-05 06:03:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/73170474-2804-4601-b51a-3dc0f987b70a_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003779127-01955168-004.pdf)
2025-12-05 06:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F73170474-2804-4601-b51a-3dc0f987b70a_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/73170474-2804-4601-b51a-3dc0f987b70a_4.jpg not downloaded yet
2025-12-05 06:03:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342569190>
2025-12-05 06:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc30a7f1-e5c4-5241-bd1d-06f8594e5351/fc30a7f1-e5c4-5241-bd1d-06f8594e5351_image_13.jpg HTTP/1.1" 201 0
2025-12-05 06:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3780546-3999371-13.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3780546-3999371-13.jpg saved to cache
2025-12-05 06:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item fc30a7f1-e5c4-5241-bd1d-06f8594e5351
2025-12-05 06:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F73170474-2804-4601-b51a-3dc0f987b70a_11.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/73170474-2804-4601-b51a-3dc0f987b70a_11.jpg not downloaded yet
2025-12-05 06:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/73170474-2804-4601-b51a-3dc0f987b70a_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003779127-01955168-004.pdf)
2025-12-05 06:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F73170474-2804-4601-b51a-3dc0f987b70a_10.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/73170474-2804-4601-b51a-3dc0f987b70a_10.jpg not downloaded yet
2025-12-05 06:03:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac879400-02fb-57dd-9deb-b94848e0bc21 with identifier: 3759761
2025-12-05 06:03:51 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item ac879400-02fb-57dd-9deb-b94848e0bc21
2025-12-05 06:03:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 253ed866-e9fc-540c-9698-c26cd5f3cc11 with identifier: 3770420
2025-12-05 06:03:51 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 253ed866-e9fc-540c-9698-c26cd5f3cc11
2025-12-05 06:03:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23428cc4d0>
2025-12-05 06:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc30a7f1-e5c4-5241-bd1d-06f8594e5351/fc30a7f1-e5c4-5241-bd1d-06f8594e5351_image_11.jpg HTTP/1.1" 201 0
2025-12-05 06:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa8587282-d24f-4bed-9861-a3b25f5902e2_ext_3.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a8587282-d24f-4bed-9861-a3b25f5902e2_ext_3.jpg saved to cache
2025-12-05 06:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item fc30a7f1-e5c4-5241-bd1d-06f8594e5351
2025-12-05 06:03:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342374510>
2025-12-05 06:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 06:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1efb7f0-a31b-5a6d-a39c-a0009a989668/e1efb7f0-a31b-5a6d-a39c-a0009a989668_image_0.jpg HTTP/1.1" 201 0
2025-12-05 06:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F73170474-2804-4601-b51a-3dc0f987b70a_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/73170474-2804-4601-b51a-3dc0f987b70a_ext_7.jpg saved to cache
2025-12-05 06:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e1efb7f0-a31b-5a6d-a39c-a0009a989668
2025-12-05 06:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F73170474-2804-4601-b51a-3dc0f987b70a_9.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/73170474-2804-4601-b51a-3dc0f987b70a_9.jpg not downloaded yet
2025-12-05 06:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F73170474-2804-4601-b51a-3dc0f987b70a_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/73170474-2804-4601-b51a-3dc0f987b70a_ext_2.jpg not downloaded yet
2025-12-05 06:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/RENAULT/ZOE?id=3759664&returnUrl=%2Fsearch%3FPage%3D3%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233759664&indx=293> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:03:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/73170474-2804-4601-b51a-3dc0f987b70a_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003779127-01955168-004.pdf)
2025-12-05 06:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/73170474-2804-4601-b51a-3dc0f987b70a_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003779127-01955168-004.pdf)
2025-12-05 06:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/73170474-2804-4601-b51a-3dc0f987b70a_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003779127-01955168-004.pdf)
2025-12-05 06:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/73170474-2804-4601-b51a-3dc0f987b70a_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003779127-01955168-004.pdf)
2025-12-05 06:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F73170474-2804-4601-b51a-3dc0f987b70a_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/73170474-2804-4601-b51a-3dc0f987b70a_ext_5.jpg not downloaded yet
2025-12-05 06:03:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425c6a90>
2025-12-05 06:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1efb7f0-a31b-5a6d-a39c-a0009a989668/e1efb7f0-a31b-5a6d-a39c-a0009a989668_image_3.jpg HTTP/1.1" 201 0
2025-12-05 06:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F73170474-2804-4601-b51a-3dc0f987b70a_ext_1.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/73170474-2804-4601-b51a-3dc0f987b70a_ext_1.jpg saved to cache
2025-12-05 06:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e1efb7f0-a31b-5a6d-a39c-a0009a989668
2025-12-05 06:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F73170474-2804-4601-b51a-3dc0f987b70a_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/73170474-2804-4601-b51a-3dc0f987b70a_ext_3.jpg not downloaded yet
2025-12-05 06:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F73170474-2804-4601-b51a-3dc0f987b70a_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/73170474-2804-4601-b51a-3dc0f987b70a_ext_4.jpg not downloaded yet
2025-12-05 06:03:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32032d8b-0dd2-524b-bd12-e43d2ae3419b with identifier: 3759664
2025-12-05 06:03:51 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 32032d8b-0dd2-524b-bd12-e43d2ae3419b
2025-12-05 06:03:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342776750>
2025-12-05 06:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1efb7f0-a31b-5a6d-a39c-a0009a989668/e1efb7f0-a31b-5a6d-a39c-a0009a989668_image_1.jpg HTTP/1.1" 201 0
2025-12-05 06:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F73170474-2804-4601-b51a-3dc0f987b70a_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/73170474-2804-4601-b51a-3dc0f987b70a_ext_7.jpg saved to cache
2025-12-05 06:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e1efb7f0-a31b-5a6d-a39c-a0009a989668
2025-12-05 06:03:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234269d9d0>
2025-12-05 06:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 06:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1efb7f0-a31b-5a6d-a39c-a0009a989668/e1efb7f0-a31b-5a6d-a39c-a0009a989668_image_4.jpg HTTP/1.1" 201 0
2025-12-05 06:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F73170474-2804-4601-b51a-3dc0f987b70a_5.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/73170474-2804-4601-b51a-3dc0f987b70a_5.jpg saved to cache
2025-12-05 06:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e1efb7f0-a31b-5a6d-a39c-a0009a989668
2025-12-05 06:03:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341ea0590>
2025-12-05 06:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1efb7f0-a31b-5a6d-a39c-a0009a989668/e1efb7f0-a31b-5a6d-a39c-a0009a989668_image_2.jpg HTTP/1.1" 201 0
2025-12-05 06:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F73170474-2804-4601-b51a-3dc0f987b70a_ext_6.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/73170474-2804-4601-b51a-3dc0f987b70a_ext_6.jpg saved to cache
2025-12-05 06:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e1efb7f0-a31b-5a6d-a39c-a0009a989668
2025-12-05 06:03:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342776b50>
2025-12-05 06:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1efb7f0-a31b-5a6d-a39c-a0009a989668/e1efb7f0-a31b-5a6d-a39c-a0009a989668_image_5.jpg HTTP/1.1" 201 0
2025-12-05 06:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F73170474-2804-4601-b51a-3dc0f987b70a_4.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/73170474-2804-4601-b51a-3dc0f987b70a_4.jpg saved to cache
2025-12-05 06:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e1efb7f0-a31b-5a6d-a39c-a0009a989668
2025-12-05 06:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3779127-4000352-13.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3779127-4000352-13.jpg not downloaded yet
2025-12-05 06:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3779127-4000352-1000.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3779127-4000352-1000.jpg not downloaded yet
2025-12-05 06:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/73170474-2804-4601-b51a-3dc0f987b70a_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003779127-01955168-004.pdf)
2025-12-05 06:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/73170474-2804-4601-b51a-3dc0f987b70a_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003779127-01955168-004.pdf)
2025-12-05 06:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/73170474-2804-4601-b51a-3dc0f987b70a_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003779127-01955168-004.pdf)
2025-12-05 06:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3779127-4000352-1001.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3779127-4000352-1001.jpg not downloaded yet
2025-12-05 06:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3779127-4000352-1002.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3779127-4000352-1002.jpg not downloaded yet
2025-12-05 06:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3779127-4000352-1003.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3779127-4000352-1003.jpg not downloaded yet
2025-12-05 06:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3779127-4000352-1004.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3779127-4000352-1004.jpg not downloaded yet
2025-12-05 06:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3779127-4000352-1005.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3779127-4000352-1005.jpg not downloaded yet
2025-12-05 06:03:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341ec0710>
2025-12-05 06:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1efb7f0-a31b-5a6d-a39c-a0009a989668/e1efb7f0-a31b-5a6d-a39c-a0009a989668_image_8.jpg HTTP/1.1" 201 0
2025-12-05 06:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F73170474-2804-4601-b51a-3dc0f987b70a_9.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/73170474-2804-4601-b51a-3dc0f987b70a_9.jpg saved to cache
2025-12-05 06:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e1efb7f0-a31b-5a6d-a39c-a0009a989668
2025-12-05 06:03:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23423bb910>
2025-12-05 06:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1efb7f0-a31b-5a6d-a39c-a0009a989668/e1efb7f0-a31b-5a6d-a39c-a0009a989668_image_7.jpg HTTP/1.1" 201 0
2025-12-05 06:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F73170474-2804-4601-b51a-3dc0f987b70a_10.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/73170474-2804-4601-b51a-3dc0f987b70a_10.jpg saved to cache
2025-12-05 06:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e1efb7f0-a31b-5a6d-a39c-a0009a989668
2025-12-05 06:03:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234245f810>
2025-12-05 06:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1efb7f0-a31b-5a6d-a39c-a0009a989668/e1efb7f0-a31b-5a6d-a39c-a0009a989668_image_9.jpg HTTP/1.1" 201 0
2025-12-05 06:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F73170474-2804-4601-b51a-3dc0f987b70a_ext_2.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/73170474-2804-4601-b51a-3dc0f987b70a_ext_2.jpg saved to cache
2025-12-05 06:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e1efb7f0-a31b-5a6d-a39c-a0009a989668
2025-12-05 06:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3779127-4000352-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003779127-01955168-004.pdf)
2025-12-05 06:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3779127-4000352-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003779127-01955168-004.pdf)
2025-12-05 06:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003759761-01979829-002.pdf> (referer: None)
2025-12-05 06:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003770420-01955701-006.pdf> (referer: None)
2025-12-05 06:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003759664-01766260-020.pdf> (referer: None)
2025-12-05 06:03:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23426c7190>
2025-12-05 06:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1efb7f0-a31b-5a6d-a39c-a0009a989668/e1efb7f0-a31b-5a6d-a39c-a0009a989668_image_14.jpg HTTP/1.1" 201 0
2025-12-05 06:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3779127-4000352-1000.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3779127-4000352-1000.jpg saved to cache
2025-12-05 06:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item e1efb7f0-a31b-5a6d-a39c-a0009a989668
2025-12-05 06:03:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342630c50>
2025-12-05 06:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1efb7f0-a31b-5a6d-a39c-a0009a989668/e1efb7f0-a31b-5a6d-a39c-a0009a989668_image_13.jpg HTTP/1.1" 201 0
2025-12-05 06:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3779127-4000352-13.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3779127-4000352-13.jpg saved to cache
2025-12-05 06:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item e1efb7f0-a31b-5a6d-a39c-a0009a989668
2025-12-05 06:03:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23424e7310>
2025-12-05 06:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac879400-02fb-57dd-9deb-b94848e0bc21/ac879400-02fb-57dd-9deb-b94848e0bc21_expert_report_file_6f25bfda-cdc1-454c-80d8-f8c71035f781.pdf HTTP/1.1" 201 0
2025-12-05 06:03:55 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item ac879400-02fb-57dd-9deb-b94848e0bc21
2025-12-05 06:03:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ac879400-02fb-57dd-9deb-b94848e0bc21, skipping ID generation
2025-12-05 06:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item ac879400-02fb-57dd-9deb-b94848e0bc21
2025-12-05 06:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3759761-9999999-338142912-004.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3759761-9999999-338142912-004.jpg not downloaded yet
2025-12-05 06:03:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342641150>
2025-12-05 06:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 06:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_253ed866-e9fc-540c-9698-c26cd5f3cc11/253ed866-e9fc-540c-9698-c26cd5f3cc11_expert_report_file_51ecbe42-6d4a-4e24-a5b8-3cf31c83aac1.pdf HTTP/1.1" 201 0
2025-12-05 06:03:55 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 253ed866-e9fc-540c-9698-c26cd5f3cc11
2025-12-05 06:03:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 253ed866-e9fc-540c-9698-c26cd5f3cc11, skipping ID generation
2025-12-05 06:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 253ed866-e9fc-540c-9698-c26cd5f3cc11
2025-12-05 06:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0b717633-df64-4a29-a7ae-3e211136ae7b_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0b717633-df64-4a29-a7ae-3e211136ae7b_ext_7.jpg not downloaded yet
2025-12-05 06:03:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23426a9850>
2025-12-05 06:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_expert_report_file_d847497c-286b-4fa8-96c8-c3eebcad5a2f.pdf HTTP/1.1" 201 0
2025-12-05 06:03:55 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 32032d8b-0dd2-524b-bd12-e43d2ae3419b
2025-12-05 06:03:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 32032d8b-0dd2-524b-bd12-e43d2ae3419b, skipping ID generation
2025-12-05 06:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 32032d8b-0dd2-524b-bd12-e43d2ae3419b
2025-12-05 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_7.jpg already downloaded
2025-12-05 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_7.jpg already downloaded
2025-12-05 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_6.jpg already downloaded
2025-12-05 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_1.jpg already downloaded
2025-12-05 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F655c3c5f-cec6-4503-a312-d932fa16bdbc_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_5.jpg already downloaded
2025-12-05 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F655c3c5f-cec6-4503-a312-d932fa16bdbc_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_4.jpg already downloaded
2025-12-05 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F655c3c5f-cec6-4503-a312-d932fa16bdbc_11.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_11.jpg already downloaded
2025-12-05 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F655c3c5f-cec6-4503-a312-d932fa16bdbc_10.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_10.jpg already downloaded
2025-12-05 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F655c3c5f-cec6-4503-a312-d932fa16bdbc_9.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_9.jpg already downloaded
2025-12-05 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_2.jpg already downloaded
2025-12-05 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_5.jpg already downloaded
2025-12-05 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_3.jpg already downloaded
2025-12-05 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_4.jpg already downloaded
2025-12-05 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3759664-3902978-13.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3759664-3902978-13.jpg already downloaded
2025-12-05 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3759664-3902978-1000.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3759664-3902978-1000.jpg already downloaded
2025-12-05 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3759664-3902978-1001.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3759664-3902978-1001.jpg already downloaded
2025-12-05 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3759664-3902978-1002.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3759664-3902978-1002.jpg already downloaded
2025-12-05 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3759664-3902978-1003.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3759664-3902978-1003.jpg already downloaded
2025-12-05 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3759664-3902978-1004.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3759664-3902978-1004.jpg already downloaded
2025-12-05 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3759664-3902978-1005.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3759664-3902978-1005.jpg already downloaded
2025-12-05 06:03:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 32032d8b-0dd2-524b-bd12-e43d2ae3419b, identifier: 3759664
2025-12-05 06:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3779127-4000352-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003779127-01955168-004.pdf)
2025-12-05 06:03:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 32032d8b-0dd2-524b-bd12-e43d2ae3419b with identifier: 3759664
2025-12-05 06:03:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 32032d8b-0dd2-524b-bd12-e43d2ae3419b with identifier: 3759664
2025-12-05 06:03:56 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 26, 'seller_name': 'stellantis financial services', 'price_includes_vat': False, 'title': 'renault zoe 80kw i iconic r110 50kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'renault', 'model': 'zoe', 'transmission': 'automatic', 'engine': '0.0l', 'fuel_type': 'electric', 'odometer': 8053, 'odometer_reading_unit': 'mi', 'registration_date': '2021-01-29', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/renault/zoe?id=3759664', 'location': 'bristol', 'origin_country_code': 'gb', 'trim': '80kw i iconic r110 50kwh 5dr auto', 'license_plate': 'ey70oax', 'year': 2021, 'listing': 'auction', 'c_o_2_emission_value': 0, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0003759664-01766260-020.pdf', 'expiration_date': '2025-12-09t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'photo_urls': ['http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_7.jpg', 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_7.jpg', 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_6.jpg', 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_1.jpg', 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_5.jpg', 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_4.jpg', 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_11.jpg', 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_10.jpg', 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_9.jpg', 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_2.jpg', 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_5.jpg', 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_3.jpg', 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_4.jpg', 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759664-3902978-13.jpg', 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759664-3902978-1000.jpg', 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759664-3902978-1001.jpg', 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759664-3902978-1002.jpg', 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759664-3902978-1003.jpg', 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759664-3902978-1004.jpg', 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759664-3902978-1005.jpg'], 'id': '32032d8b-0dd2-524b-bd12-e43d2ae3419b', 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_expert_report_file_d847497c-286b-4fa8-96c8-c3eebcad5a2f.pdf', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_0.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_7.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 284222}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_0.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_7.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 284222}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_2.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_6.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 240423}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_3.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_1.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 253176}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_4.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 222036}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_5.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 220456}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_6.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_11.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 219827}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_7.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_10.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 203679}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_8.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_9.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 224230}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_9.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_2.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 253176}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_10.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 211799}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_11.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_3.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 257375}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_12.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 269268}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_13.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759664-3902978-13.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 349034}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_14.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759664-3902978-1000.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 373148}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_15.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759664-3902978-1001.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 397584}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_16.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759664-3902978-1002.jpg', 'Width': 1500, 'Height': 937, 'Extension': 'jpg', 'FileSizeInBytes': 299938}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_17.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759664-3902978-1003.jpg', 'Width': 1500, 'Height': 937, 'Extension': 'jpg', 'FileSizeInBytes': 176206}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_18.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759664-3902978-1004.jpg', 'Width': 1500, 'Height': 937, 'Extension': 'jpg', 'FileSizeInBytes': 231295}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_19.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759664-3902978-1005.jpg', 'Width': 1500, 'Height': 937, 'Extension': 'jpg', 'FileSizeInBytes': 307269}], 'current_year_diff': 4, 'age_in_months': 58, 'make_model': 'renault zoe', 'sanitized_make': 'renault', 'odometer_in_km': 12960} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 58,
     'auction_title': '',
     'c_o_2_emission_value': 0,
     'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_expert_report_file_d847497c-286b-4fa8-96c8-c3eebcad5a2f.pdf',
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0003759664-01766260-020.pdf',
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 4,
     'engine': '0.0l',
     'expiration_date': '2025-12-09t09:00:00z',
     'fuel_type': 'electric',
     'id': '32032d8b-0dd2-524b-bd12-e43d2ae3419b',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'ey70oax',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/renault/zoe?id=3759664',
     'listing': 'auction',
     'location': 'bristol',
     'make': 'renault',
     'make_model': 'renault zoe',
     'model': 'zoe',
     'odometer': 8053,
     'odometer_in_km': 12960,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 26,
     'photo_urls': ['http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_7.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_7.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_6.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_1.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_5.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_4.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_11.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_10.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_9.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_2.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_5.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_3.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_4.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759664-3902978-13.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759664-3902978-1000.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759664-3902978-1001.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759664-3902978-1002.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759664-3902978-1003.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759664-3902978-1004.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759664-3902978-1005.jpg'],
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 284222,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_7.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 284222,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_7.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 240423,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_6.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 253176,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_1.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 222036,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_5.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 220456,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_4.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 219827,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_11.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 203679,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_10.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 224230,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_9.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 253176,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_2.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 211799,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_5.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 257375,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_3.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 269268,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_4.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 349034,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759664-3902978-13.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 373148,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759664-3902978-1000.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_15.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 397584,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759664-3902978-1001.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_16.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 299938,
                 'Height': 937,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759664-3902978-1002.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_17.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 176206,
                 'Height': 937,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759664-3902978-1003.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_18.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 231295,
                 'Height': 937,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759664-3902978-1004.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_19.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 307269,
                 'Height': 937,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759664-3902978-1005.jpg',
                 'Width': 1500}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-01-29',
     'sanitized_make': 'renault',
     'seller_name': 'stellantis financial services',
     'title': 'renault zoe 80kw i iconic r110 50kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '80kw i iconic r110 50kwh 5dr auto',
     'year': 2021}
2025-12-05 06:03:56 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 32032d8b-0dd2-524b-bd12-e43d2ae3419b spider: manheim.gb
2025-12-05 06:03:57 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 32032d8b-0dd2-524b-bd12-e43d2ae3419b due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 26, 'seller_name': 'stellantis financial services', 'price_includes_vat': False, 'title': 'renault zoe 80kw i iconic r110 50kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'renault', 'model': 'zoe', 'transmission': 'automatic', 'engine': '0.0l', 'fuel_type': 'electric', 'odometer': 8053, 'odometer_reading_unit': 'mi', 'registration_date': '2021-01-29', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/renault/zoe?id=3759664', 'location': 'bristol', 'origin_country_code': 'gb', 'trim': '80kw i iconic r110 50kwh 5dr auto', 'license_plate': 'ey70oax', 'year': 2021, 'listing': 'auction', 'c_o_2_emission_value': 0, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0003759664-01766260-020.pdf', 'expiration_date': '2025-12-09t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'photo_urls': ['http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_7.jpg', 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_7.jpg', 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_6.jpg', 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_1.jpg', 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_5.jpg', 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_4.jpg', 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_11.jpg', 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_10.jpg', 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_9.jpg', 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_2.jpg', 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_5.jpg', 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_3.jpg', 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_4.jpg', 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759664-3902978-13.jpg', 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759664-3902978-1000.jpg', 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759664-3902978-1001.jpg', 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759664-3902978-1002.jpg', 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759664-3902978-1003.jpg', 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759664-3902978-1004.jpg', 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759664-3902978-1005.jpg'], 'id': '32032d8b-0dd2-524b-bd12-e43d2ae3419b', 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_expert_report_file_d847497c-286b-4fa8-96c8-c3eebcad5a2f.pdf', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_0.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_7.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 284222}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_0.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_7.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 284222}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_2.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_6.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 240423}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_3.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_1.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 253176}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_4.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 222036}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_5.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 220456}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_6.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_11.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 219827}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_7.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_10.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 203679}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_8.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_9.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 224230}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_9.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_2.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 253176}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_10.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 211799}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_11.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_3.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 257375}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_12.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 269268}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_13.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759664-3902978-13.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 349034}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_14.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759664-3902978-1000.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 373148}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_15.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759664-3902978-1001.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 397584}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_16.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759664-3902978-1002.jpg', 'Width': 1500, 'Height': 937, 'Extension': 'jpg', 'FileSizeInBytes': 299938}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_17.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759664-3902978-1003.jpg', 'Width': 1500, 'Height': 937, 'Extension': 'jpg', 'FileSizeInBytes': 176206}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_18.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759664-3902978-1004.jpg', 'Width': 1500, 'Height': 937, 'Extension': 'jpg', 'FileSizeInBytes': 231295}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_19.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759664-3902978-1005.jpg', 'Width': 1500, 'Height': 937, 'Extension': 'jpg', 'FileSizeInBytes': 307269}], 'current_year_diff': 4, 'age_in_months': 58, 'make_model': 'renault zoe', 'sanitized_make': 'renault', 'odometer_in_km': 12960} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 58,
     'auction_title': '',
     'c_o_2_emission_value': 0,
     'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_expert_report_file_d847497c-286b-4fa8-96c8-c3eebcad5a2f.pdf',
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0003759664-01766260-020.pdf',
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 4,
     'engine': '0.0l',
     'expiration_date': '2025-12-09t09:00:00z',
     'fuel_type': 'electric',
     'id': '32032d8b-0dd2-524b-bd12-e43d2ae3419b',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'ey70oax',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/renault/zoe?id=3759664',
     'listing': 'auction',
     'location': 'bristol',
     'make': 'renault',
     'make_model': 'renault zoe',
     'model': 'zoe',
     'odometer': 8053,
     'odometer_in_km': 12960,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 26,
     'photo_urls': ['http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_7.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_7.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_6.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_1.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_5.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_4.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_11.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_10.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_9.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_2.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_5.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_3.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_4.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759664-3902978-13.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759664-3902978-1000.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759664-3902978-1001.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759664-3902978-1002.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759664-3902978-1003.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759664-3902978-1004.jpg',
                    'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759664-3902978-1005.jpg'],
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 284222,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_7.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 284222,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_7.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 240423,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_6.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 253176,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_1.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 222036,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_5.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 220456,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_4.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 219827,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_11.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 203679,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_10.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 224230,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_9.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 253176,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_2.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 211799,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_5.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 257375,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_3.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 269268,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_4.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 349034,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759664-3902978-13.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 373148,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759664-3902978-1000.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_15.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 397584,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759664-3902978-1001.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_16.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 299938,
                 'Height': 937,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759664-3902978-1002.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_17.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 176206,
                 'Height': 937,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759664-3902978-1003.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_18.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 231295,
                 'Height': 937,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759664-3902978-1004.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_19.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 307269,
                 'Height': 937,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759664-3902978-1005.jpg',
                 'Width': 1500}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-01-29',
     'sanitized_make': 'renault',
     'seller_name': 'stellantis financial services',
     'title': 'renault zoe 80kw i iconic r110 50kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '80kw i iconic r110 50kwh 5dr auto',
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_expert_report_file_d847497c-286b-4fa8-96c8-c3eebcad5a2f.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003759664-01766260-020.pdf',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '0.0L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Electric',
 'id': '32032d8b-0dd2-524b-bd12-e43d2ae3419b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'EY70OAX',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/RENAULT/ZOE?id=3759664',
 'listing': 'auction',
 'location': 'Bristol',
 'make': 'RENAULT',
 'model': 'ZOE',
 'odometer': 8053,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 26,
 'photo_urls': ['http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_7.jpg',
                'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_7.jpg',
                'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_6.jpg',
                'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_1.jpg',
                'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_5.jpg',
                'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_4.jpg',
                'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_11.jpg',
                'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_10.jpg',
                'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_9.jpg',
                'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_2.jpg',
                'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_5.jpg',
                'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_3.jpg',
                'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_4.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759664-3902978-13.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759664-3902978-1000.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759664-3902978-1001.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759664-3902978-1002.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759664-3902978-1003.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759664-3902978-1004.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759664-3902978-1005.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 284222,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 284222,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 240423,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 253176,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 222036,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 220456,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 219827,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 203679,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 224230,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 253176,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 211799,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257375,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 269268,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/655c3c5f-cec6-4503-a312-d932fa16bdbc_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 349034,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759664-3902978-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 373148,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759664-3902978-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 397584,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759664-3902978-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 299938,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759664-3902978-1002.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 176206,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759664-3902978-1003.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 231295,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759664-3902978-1004.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32032d8b-0dd2-524b-bd12-e43d2ae3419b/32032d8b-0dd2-524b-bd12-e43d2ae3419b_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 307269,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759664-3902978-1005.jpg',
             'Width': 1500}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-29',
 'seller_name': 'Stellantis Financial Services',
 'title': 'RENAULT ZOE 80kW i Iconic R110 50kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '80kW i Iconic R110 50kWh 5dr Auto',
 'year': 2021}
2025-12-05 06:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273759664%27 HTTP/1.1" 200 None
2025-12-05 06:03:57 [manheim.gb] INFO: Saving data for 3759664: {'created_time': 1764914637.11676, 'last_price_update_time': 1764914637.116774, 'auction_closing_time': 1765270800.0}
2025-12-05 06:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3759664') HTTP/1.1" 204 0
2025-12-05 06:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3779127-4000352-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003779127-01955168-004.pdf)
2025-12-05 06:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3779127-4000352-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003779127-01955168-004.pdf)
2025-12-05 06:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3759761-9999999-338142912-008.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3759761-9999999-338142912-008.jpg not downloaded yet
2025-12-05 06:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0b717633-df64-4a29-a7ae-3e211136ae7b_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0b717633-df64-4a29-a7ae-3e211136ae7b_ext_7.jpg not downloaded yet
2025-12-05 06:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3779127-4000352-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003779127-01955168-004.pdf)
2025-12-05 06:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3759761-9999999-338142912-001.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3759761-9999999-338142912-001.jpg not downloaded yet
2025-12-05 06:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0b717633-df64-4a29-a7ae-3e211136ae7b_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0b717633-df64-4a29-a7ae-3e211136ae7b_ext_6.jpg not downloaded yet
2025-12-05 06:03:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341eba050>
2025-12-05 06:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1efb7f0-a31b-5a6d-a39c-a0009a989668/e1efb7f0-a31b-5a6d-a39c-a0009a989668_image_16.jpg HTTP/1.1" 201 0
2025-12-05 06:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3779127-4000352-1002.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3779127-4000352-1002.jpg saved to cache
2025-12-05 06:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item e1efb7f0-a31b-5a6d-a39c-a0009a989668
2025-12-05 06:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3759761-9999999-338142912-002.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3759761-9999999-338142912-002.jpg not downloaded yet
2025-12-05 06:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0b717633-df64-4a29-a7ae-3e211136ae7b_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0b717633-df64-4a29-a7ae-3e211136ae7b_ext_1.jpg not downloaded yet
2025-12-05 06:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3759761-9999999-338142912-003.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3759761-9999999-338142912-003.jpg not downloaded yet
2025-12-05 06:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0b717633-df64-4a29-a7ae-3e211136ae7b_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0b717633-df64-4a29-a7ae-3e211136ae7b_5.jpg not downloaded yet
2025-12-05 06:03:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23424cfcd0>
2025-12-05 06:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1efb7f0-a31b-5a6d-a39c-a0009a989668/e1efb7f0-a31b-5a6d-a39c-a0009a989668_image_17.jpg HTTP/1.1" 201 0
2025-12-05 06:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3779127-4000352-1003.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3779127-4000352-1003.jpg saved to cache
2025-12-05 06:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item e1efb7f0-a31b-5a6d-a39c-a0009a989668
2025-12-05 06:03:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341f22e50>
2025-12-05 06:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 06:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1efb7f0-a31b-5a6d-a39c-a0009a989668/e1efb7f0-a31b-5a6d-a39c-a0009a989668_image_19.jpg HTTP/1.1" 201 0
2025-12-05 06:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3779127-4000352-1005.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3779127-4000352-1005.jpg saved to cache
2025-12-05 06:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item e1efb7f0-a31b-5a6d-a39c-a0009a989668
2025-12-05 06:03:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23426701d0>
2025-12-05 06:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 06:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1efb7f0-a31b-5a6d-a39c-a0009a989668/e1efb7f0-a31b-5a6d-a39c-a0009a989668_image_18.jpg HTTP/1.1" 201 0
2025-12-05 06:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3779127-4000352-1004.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3779127-4000352-1004.jpg saved to cache
2025-12-05 06:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item e1efb7f0-a31b-5a6d-a39c-a0009a989668
2025-12-05 06:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3759761-9999999-338142912-005.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3759761-9999999-338142912-005.jpg not downloaded yet
2025-12-05 06:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0b717633-df64-4a29-a7ae-3e211136ae7b_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0b717633-df64-4a29-a7ae-3e211136ae7b_4.jpg not downloaded yet
2025-12-05 06:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3759761-9999999-338142912-006.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3759761-9999999-338142912-006.jpg not downloaded yet
2025-12-05 06:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0b717633-df64-4a29-a7ae-3e211136ae7b_11.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0b717633-df64-4a29-a7ae-3e211136ae7b_11.jpg not downloaded yet
2025-12-05 06:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3759761-9999999-338142912-007.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3759761-9999999-338142912-007.jpg not downloaded yet
2025-12-05 06:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0b717633-df64-4a29-a7ae-3e211136ae7b_10.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0b717633-df64-4a29-a7ae-3e211136ae7b_10.jpg not downloaded yet
2025-12-05 06:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3759761-9999999-338142912-009.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3759761-9999999-338142912-009.jpg not downloaded yet
2025-12-05 06:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0b717633-df64-4a29-a7ae-3e211136ae7b_9.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0b717633-df64-4a29-a7ae-3e211136ae7b_9.jpg not downloaded yet
2025-12-05 06:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3759761-9999999-338142912-010.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3759761-9999999-338142912-010.jpg not downloaded yet
2025-12-05 06:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0b717633-df64-4a29-a7ae-3e211136ae7b_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0b717633-df64-4a29-a7ae-3e211136ae7b_ext_2.jpg not downloaded yet
2025-12-05 06:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3759761-9999999-338142912-011.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3759761-9999999-338142912-011.jpg not downloaded yet
2025-12-05 06:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0b717633-df64-4a29-a7ae-3e211136ae7b_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0b717633-df64-4a29-a7ae-3e211136ae7b_ext_5.jpg not downloaded yet
2025-12-05 06:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3759761-9999999-338142912-012.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3759761-9999999-338142912-012.jpg not downloaded yet
2025-12-05 06:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0b717633-df64-4a29-a7ae-3e211136ae7b_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0b717633-df64-4a29-a7ae-3e211136ae7b_ext_3.jpg not downloaded yet
2025-12-05 06:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3759761-4007373-13.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3759761-4007373-13.jpg not downloaded yet
2025-12-05 06:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0b717633-df64-4a29-a7ae-3e211136ae7b_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0b717633-df64-4a29-a7ae-3e211136ae7b_ext_4.jpg not downloaded yet
2025-12-05 06:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3759761-9999999-338142912-001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003759761-01979829-002.pdf)
2025-12-05 06:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3759761-4007373-1000.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3759761-4007373-1000.jpg not downloaded yet
2025-12-05 06:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3770420-3967228-13.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3770420-3967228-13.jpg not downloaded yet
2025-12-05 06:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0b717633-df64-4a29-a7ae-3e211136ae7b_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003770420-01955701-006.pdf)
2025-12-05 06:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3759761-4007373-1001.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3759761-4007373-1001.jpg not downloaded yet
2025-12-05 06:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3770420-3967228-1000.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3770420-3967228-1000.jpg not downloaded yet
2025-12-05 06:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0b717633-df64-4a29-a7ae-3e211136ae7b_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003770420-01955701-006.pdf)
2025-12-05 06:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3759761-4007373-1002.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3759761-4007373-1002.jpg not downloaded yet
2025-12-05 06:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3770420-3967228-1001.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3770420-3967228-1001.jpg not downloaded yet
2025-12-05 06:03:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23415da8d0>
2025-12-05 06:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 06:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac879400-02fb-57dd-9deb-b94848e0bc21/ac879400-02fb-57dd-9deb-b94848e0bc21_image_2.jpg HTTP/1.1" 201 0
2025-12-05 06:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3759761-9999999-338142912-001.jpg') HTTP/1.1" 204 0
2025-12-05 06:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3759761-9999999-338142912-001.jpg saved to cache
2025-12-05 06:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ac879400-02fb-57dd-9deb-b94848e0bc21
2025-12-05 06:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3759761-4007373-1003.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3759761-4007373-1003.jpg not downloaded yet
2025-12-05 06:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3770420-3967228-1002.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3770420-3967228-1002.jpg not downloaded yet
2025-12-05 06:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3759761-9999999-338142912-002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003759761-01979829-002.pdf)
2025-12-05 06:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3759761-4007373-1004.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3759761-4007373-1004.jpg not downloaded yet
2025-12-05 06:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3770420-3967228-1003.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3770420-3967228-1003.jpg not downloaded yet
2025-12-05 06:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0b717633-df64-4a29-a7ae-3e211136ae7b_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003770420-01955701-006.pdf)
2025-12-05 06:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0b717633-df64-4a29-a7ae-3e211136ae7b_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003770420-01955701-006.pdf)
2025-12-05 06:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3759761-4007373-1005.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3759761-4007373-1005.jpg not downloaded yet
2025-12-05 06:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3770420-3967228-1004.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3770420-3967228-1004.jpg not downloaded yet
2025-12-05 06:03:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:03:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342828c90>
2025-12-05 06:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:03:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_253ed866-e9fc-540c-9698-c26cd5f3cc11/253ed866-e9fc-540c-9698-c26cd5f3cc11_image_1.jpg HTTP/1.1" 201 0
2025-12-05 06:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0b717633-df64-4a29-a7ae-3e211136ae7b_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0b717633-df64-4a29-a7ae-3e211136ae7b_ext_7.jpg saved to cache
2025-12-05 06:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 253ed866-e9fc-540c-9698-c26cd5f3cc11
2025-12-05 06:04:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234245f110>
2025-12-05 06:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_253ed866-e9fc-540c-9698-c26cd5f3cc11/253ed866-e9fc-540c-9698-c26cd5f3cc11_image_3.jpg HTTP/1.1" 201 0
2025-12-05 06:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0b717633-df64-4a29-a7ae-3e211136ae7b_ext_1.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0b717633-df64-4a29-a7ae-3e211136ae7b_ext_1.jpg saved to cache
2025-12-05 06:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 253ed866-e9fc-540c-9698-c26cd5f3cc11
2025-12-05 06:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3759761-4007373-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003759761-01979829-002.pdf)
2025-12-05 06:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3759761-4007373-1006.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3759761-4007373-1006.jpg not downloaded yet
2025-12-05 06:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3770420-3967228-1005.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3770420-3967228-1005.jpg not downloaded yet
2025-12-05 06:04:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425fa5d0>
2025-12-05 06:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac879400-02fb-57dd-9deb-b94848e0bc21/ac879400-02fb-57dd-9deb-b94848e0bc21_image_3.jpg HTTP/1.1" 201 0
2025-12-05 06:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3759761-9999999-338142912-002.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3759761-9999999-338142912-002.jpg saved to cache
2025-12-05 06:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ac879400-02fb-57dd-9deb-b94848e0bc21
2025-12-05 06:04:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234253e6d0>
2025-12-05 06:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_253ed866-e9fc-540c-9698-c26cd5f3cc11/253ed866-e9fc-540c-9698-c26cd5f3cc11_image_2.jpg HTTP/1.1" 201 0
2025-12-05 06:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0b717633-df64-4a29-a7ae-3e211136ae7b_ext_6.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0b717633-df64-4a29-a7ae-3e211136ae7b_ext_6.jpg saved to cache
2025-12-05 06:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 253ed866-e9fc-540c-9698-c26cd5f3cc11
2025-12-05 06:04:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341eb3c50>
2025-12-05 06:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_253ed866-e9fc-540c-9698-c26cd5f3cc11/253ed866-e9fc-540c-9698-c26cd5f3cc11_image_12.jpg HTTP/1.1" 201 0
2025-12-05 06:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0b717633-df64-4a29-a7ae-3e211136ae7b_ext_4.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0b717633-df64-4a29-a7ae-3e211136ae7b_ext_4.jpg saved to cache
2025-12-05 06:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 253ed866-e9fc-540c-9698-c26cd5f3cc11
2025-12-05 06:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3770420-3967228-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003770420-01955701-006.pdf)
2025-12-05 06:04:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425f0d50>
2025-12-05 06:04:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac879400-02fb-57dd-9deb-b94848e0bc21/ac879400-02fb-57dd-9deb-b94848e0bc21_image_13.jpg HTTP/1.1" 201 0
2025-12-05 06:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3759761-4007373-1000.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3759761-4007373-1000.jpg saved to cache
2025-12-05 06:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item ac879400-02fb-57dd-9deb-b94848e0bc21
2025-12-05 06:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3770420-3967228-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003770420-01955701-006.pdf)
2025-12-05 06:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3759761-4007373-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003759761-01979829-002.pdf)
2025-12-05 06:04:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23427b08d0>
2025-12-05 06:04:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_253ed866-e9fc-540c-9698-c26cd5f3cc11/253ed866-e9fc-540c-9698-c26cd5f3cc11_image_13.jpg HTTP/1.1" 201 0
2025-12-05 06:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3770420-3967228-13.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3770420-3967228-13.jpg saved to cache
2025-12-05 06:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 253ed866-e9fc-540c-9698-c26cd5f3cc11
2025-12-05 06:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3770420-3967228-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003770420-01955701-006.pdf)
2025-12-05 06:04:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342494d90>
2025-12-05 06:04:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_253ed866-e9fc-540c-9698-c26cd5f3cc11/253ed866-e9fc-540c-9698-c26cd5f3cc11_image_16.jpg HTTP/1.1" 201 0
2025-12-05 06:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3770420-3967228-1002.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3770420-3967228-1002.jpg saved to cache
2025-12-05 06:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 253ed866-e9fc-540c-9698-c26cd5f3cc11
2025-12-05 06:04:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234247aad0>
2025-12-05 06:04:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac879400-02fb-57dd-9deb-b94848e0bc21/ac879400-02fb-57dd-9deb-b94848e0bc21_image_17.jpg HTTP/1.1" 201 0
2025-12-05 06:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3759761-4007373-1004.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3759761-4007373-1004.jpg saved to cache
2025-12-05 06:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item ac879400-02fb-57dd-9deb-b94848e0bc21
2025-12-05 06:04:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342841d50>
2025-12-05 06:04:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_253ed866-e9fc-540c-9698-c26cd5f3cc11/253ed866-e9fc-540c-9698-c26cd5f3cc11_image_17.jpg HTTP/1.1" 201 0
2025-12-05 06:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3770420-3967228-1003.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3770420-3967228-1003.jpg saved to cache
2025-12-05 06:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 253ed866-e9fc-540c-9698-c26cd5f3cc11
2025-12-05 06:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3759761-4007373-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003759761-01979829-002.pdf)
2025-12-05 06:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3759761-4007373-1006.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003759761-01979829-002.pdf)
2025-12-05 06:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/ECLASS?id=3753808&returnUrl=%2Fsearch%3FPage%3D3%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233753808&indx=289> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3770420-3967228-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003770420-01955701-006.pdf)
2025-12-05 06:04:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3770420-3967228-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003770420-01955701-006.pdf)
2025-12-05 06:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3759761-4007373-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003759761-01979829-002.pdf)
2025-12-05 06:04:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341f01f50>
2025-12-05 06:04:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac879400-02fb-57dd-9deb-b94848e0bc21/ac879400-02fb-57dd-9deb-b94848e0bc21_image_18.jpg HTTP/1.1" 201 0
2025-12-05 06:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3759761-4007373-1005.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3759761-4007373-1005.jpg saved to cache
2025-12-05 06:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item ac879400-02fb-57dd-9deb-b94848e0bc21
2025-12-05 06:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/PEUGEOT/208?id=3754570&returnUrl=%2Fsearch%3FPage%3D3%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233754570&indx=292> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:04:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3759761-4007373-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003759761-01979829-002.pdf)
2025-12-05 06:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0b717633-df64-4a29-a7ae-3e211136ae7b_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003770420-01955701-006.pdf)
2025-12-05 06:04:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234238a690>
2025-12-05 06:04:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac879400-02fb-57dd-9deb-b94848e0bc21/ac879400-02fb-57dd-9deb-b94848e0bc21_image_19.jpg HTTP/1.1" 201 0
2025-12-05 06:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3759761-4007373-1006.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3759761-4007373-1006.jpg saved to cache
2025-12-05 06:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item ac879400-02fb-57dd-9deb-b94848e0bc21
2025-12-05 06:04:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d244159-a22a-50b9-8b50-f957d03c08f0 with identifier: 3753808
2025-12-05 06:04:03 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 4d244159-a22a-50b9-8b50-f957d03c08f0
2025-12-05 06:04:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341f305d0>
2025-12-05 06:04:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_253ed866-e9fc-540c-9698-c26cd5f3cc11/253ed866-e9fc-540c-9698-c26cd5f3cc11_image_18.jpg HTTP/1.1" 201 0
2025-12-05 06:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3770420-3967228-1004.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3770420-3967228-1004.jpg saved to cache
2025-12-05 06:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 253ed866-e9fc-540c-9698-c26cd5f3cc11
2025-12-05 06:04:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23424cd2d0>
2025-12-05 06:04:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_253ed866-e9fc-540c-9698-c26cd5f3cc11/253ed866-e9fc-540c-9698-c26cd5f3cc11_image_19.jpg HTTP/1.1" 201 0
2025-12-05 06:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3770420-3967228-1005.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3770420-3967228-1005.jpg saved to cache
2025-12-05 06:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 253ed866-e9fc-540c-9698-c26cd5f3cc11
2025-12-05 06:04:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23427574d0>
2025-12-05 06:04:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac879400-02fb-57dd-9deb-b94848e0bc21/ac879400-02fb-57dd-9deb-b94848e0bc21_image_16.jpg HTTP/1.1" 201 0
2025-12-05 06:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3759761-4007373-1003.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3759761-4007373-1003.jpg saved to cache
2025-12-05 06:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item ac879400-02fb-57dd-9deb-b94848e0bc21
2025-12-05 06:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3759761-4007373-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003759761-01979829-002.pdf)
2025-12-05 06:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3759761-4007373-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003759761-01979829-002.pdf)
2025-12-05 06:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3770420-3967228-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003770420-01955701-006.pdf)
2025-12-05 06:04:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80aeb0e1-7dfe-59c3-981a-2e534f9c8044 with identifier: 3754570
2025-12-05 06:04:05 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 80aeb0e1-7dfe-59c3-981a-2e534f9c8044
2025-12-05 06:04:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234253ead0>
2025-12-05 06:04:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac879400-02fb-57dd-9deb-b94848e0bc21/ac879400-02fb-57dd-9deb-b94848e0bc21_image_15.jpg HTTP/1.1" 201 0
2025-12-05 06:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3759761-4007373-1002.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3759761-4007373-1002.jpg saved to cache
2025-12-05 06:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item ac879400-02fb-57dd-9deb-b94848e0bc21
2025-12-05 06:04:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23426d8f90>
2025-12-05 06:04:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_253ed866-e9fc-540c-9698-c26cd5f3cc11/253ed866-e9fc-540c-9698-c26cd5f3cc11_image_11.jpg HTTP/1.1" 201 0
2025-12-05 06:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0b717633-df64-4a29-a7ae-3e211136ae7b_ext_3.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0b717633-df64-4a29-a7ae-3e211136ae7b_ext_3.jpg saved to cache
2025-12-05 06:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 253ed866-e9fc-540c-9698-c26cd5f3cc11
2025-12-05 06:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3770420-3967228-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003770420-01955701-006.pdf)
2025-12-05 06:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0b717633-df64-4a29-a7ae-3e211136ae7b_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003770420-01955701-006.pdf)
2025-12-05 06:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3759761-9999999-338142912-012.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003759761-01979829-002.pdf)
2025-12-05 06:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3759761-9999999-338142912-011.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003759761-01979829-002.pdf)
2025-12-05 06:04:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23423a3950>
2025-12-05 06:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac879400-02fb-57dd-9deb-b94848e0bc21/ac879400-02fb-57dd-9deb-b94848e0bc21_image_14.jpg HTTP/1.1" 201 0
2025-12-05 06:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3759761-4007373-1001.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3759761-4007373-1001.jpg saved to cache
2025-12-05 06:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item ac879400-02fb-57dd-9deb-b94848e0bc21
2025-12-05 06:04:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23415e86d0>
2025-12-05 06:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac879400-02fb-57dd-9deb-b94848e0bc21/ac879400-02fb-57dd-9deb-b94848e0bc21_image_12.jpg HTTP/1.1" 201 0
2025-12-05 06:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3759761-4007373-13.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3759761-4007373-13.jpg saved to cache
2025-12-05 06:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item ac879400-02fb-57dd-9deb-b94848e0bc21
2025-12-05 06:04:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234274fad0>
2025-12-05 06:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_253ed866-e9fc-540c-9698-c26cd5f3cc11/253ed866-e9fc-540c-9698-c26cd5f3cc11_image_14.jpg HTTP/1.1" 201 0
2025-12-05 06:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3770420-3967228-1000.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3770420-3967228-1000.jpg saved to cache
2025-12-05 06:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 253ed866-e9fc-540c-9698-c26cd5f3cc11
2025-12-05 06:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0b717633-df64-4a29-a7ae-3e211136ae7b_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003770420-01955701-006.pdf)
2025-12-05 06:04:07 [scrapy.core.engine] DEBUG: Crawled (404) <GET https://www.manheim.co.uk/vehicle-detail/LAND%20ROVER/RANGEROVER?id=3747146&returnUrl=%2Fsearch%3FPage%3D3%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233747146&indx=282> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:04:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3759761-9999999-338142912-010.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003759761-01979829-002.pdf)
2025-12-05 06:04:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23415c7c90>
2025-12-05 06:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_253ed866-e9fc-540c-9698-c26cd5f3cc11/253ed866-e9fc-540c-9698-c26cd5f3cc11_image_15.jpg HTTP/1.1" 201 0
2025-12-05 06:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3770420-3967228-1001.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3770420-3967228-1001.jpg saved to cache
2025-12-05 06:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 253ed866-e9fc-540c-9698-c26cd5f3cc11
2025-12-05 06:04:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23424deb10>
2025-12-05 06:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_253ed866-e9fc-540c-9698-c26cd5f3cc11/253ed866-e9fc-540c-9698-c26cd5f3cc11_image_10.jpg HTTP/1.1" 201 0
2025-12-05 06:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0b717633-df64-4a29-a7ae-3e211136ae7b_ext_5.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0b717633-df64-4a29-a7ae-3e211136ae7b_ext_5.jpg saved to cache
2025-12-05 06:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 253ed866-e9fc-540c-9698-c26cd5f3cc11
2025-12-05 06:04:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234247a650>
2025-12-05 06:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac879400-02fb-57dd-9deb-b94848e0bc21/ac879400-02fb-57dd-9deb-b94848e0bc21_image_11.jpg HTTP/1.1" 201 0
2025-12-05 06:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3759761-9999999-338142912-012.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3759761-9999999-338142912-012.jpg saved to cache
2025-12-05 06:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item ac879400-02fb-57dd-9deb-b94848e0bc21
2025-12-05 06:04:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234267f350>
2025-12-05 06:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac879400-02fb-57dd-9deb-b94848e0bc21/ac879400-02fb-57dd-9deb-b94848e0bc21_image_10.jpg HTTP/1.1" 201 0
2025-12-05 06:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3759761-9999999-338142912-011.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3759761-9999999-338142912-011.jpg saved to cache
2025-12-05 06:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item ac879400-02fb-57dd-9deb-b94848e0bc21
2025-12-05 06:04:08 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Ignoring non-200 response
NoneType: None
2025-12-05 06:04:09 [scrapy.core.scraper] ERROR: Spider error processing <GET https://www.manheim.co.uk/vehicle-detail/LAND%20ROVER/RANGEROVER?id=3747146&returnUrl=%2Fsearch%3FPage%3D3%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233747146&indx=282> (referer: https://www.manheim.co.uk/search/refine)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 301, in process_spider_exception
    return self._process_spider_exception(response, spider, _failure)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/httperror.py", line 46, in process_spider_input
    raise HttpError(response, "Ignoring non-200 response")
scrapy.spidermiddlewares.httperror.HttpError: Ignoring non-200 response
2025-12-05 06:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0b717633-df64-4a29-a7ae-3e211136ae7b_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003770420-01955701-006.pdf)
2025-12-05 06:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0b717633-df64-4a29-a7ae-3e211136ae7b_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003770420-01955701-006.pdf)
2025-12-05 06:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3759761-9999999-338142912-009.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003759761-01979829-002.pdf)
2025-12-05 06:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0b717633-df64-4a29-a7ae-3e211136ae7b_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003770420-01955701-006.pdf)
2025-12-05 06:04:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23415d9610>
2025-12-05 06:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 06:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_253ed866-e9fc-540c-9698-c26cd5f3cc11/253ed866-e9fc-540c-9698-c26cd5f3cc11_image_9.jpg HTTP/1.1" 201 0
2025-12-05 06:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0b717633-df64-4a29-a7ae-3e211136ae7b_ext_2.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0b717633-df64-4a29-a7ae-3e211136ae7b_ext_2.jpg saved to cache
2025-12-05 06:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 253ed866-e9fc-540c-9698-c26cd5f3cc11
2025-12-05 06:04:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23423b0110>
2025-12-05 06:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac879400-02fb-57dd-9deb-b94848e0bc21/ac879400-02fb-57dd-9deb-b94848e0bc21_image_9.jpg HTTP/1.1" 201 0
2025-12-05 06:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3759761-9999999-338142912-010.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3759761-9999999-338142912-010.jpg saved to cache
2025-12-05 06:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ac879400-02fb-57dd-9deb-b94848e0bc21
2025-12-05 06:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3759761-9999999-338142912-007.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003759761-01979829-002.pdf)
2025-12-05 06:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3759761-9999999-338142912-006.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003759761-01979829-002.pdf)
2025-12-05 06:04:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234266a510>
2025-12-05 06:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_253ed866-e9fc-540c-9698-c26cd5f3cc11/253ed866-e9fc-540c-9698-c26cd5f3cc11_image_8.jpg HTTP/1.1" 201 0
2025-12-05 06:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0b717633-df64-4a29-a7ae-3e211136ae7b_9.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0b717633-df64-4a29-a7ae-3e211136ae7b_9.jpg saved to cache
2025-12-05 06:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 253ed866-e9fc-540c-9698-c26cd5f3cc11
2025-12-05 06:04:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342495450>
2025-12-05 06:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_253ed866-e9fc-540c-9698-c26cd5f3cc11/253ed866-e9fc-540c-9698-c26cd5f3cc11_image_7.jpg HTTP/1.1" 201 0
2025-12-05 06:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0b717633-df64-4a29-a7ae-3e211136ae7b_10.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0b717633-df64-4a29-a7ae-3e211136ae7b_10.jpg saved to cache
2025-12-05 06:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 253ed866-e9fc-540c-9698-c26cd5f3cc11
2025-12-05 06:04:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234238a010>
2025-12-05 06:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 06:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac879400-02fb-57dd-9deb-b94848e0bc21/ac879400-02fb-57dd-9deb-b94848e0bc21_image_8.jpg HTTP/1.1" 201 0
2025-12-05 06:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3759761-9999999-338142912-009.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3759761-9999999-338142912-009.jpg saved to cache
2025-12-05 06:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ac879400-02fb-57dd-9deb-b94848e0bc21
2025-12-05 06:04:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342935450>
2025-12-05 06:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_253ed866-e9fc-540c-9698-c26cd5f3cc11/253ed866-e9fc-540c-9698-c26cd5f3cc11_image_6.jpg HTTP/1.1" 201 0
2025-12-05 06:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0b717633-df64-4a29-a7ae-3e211136ae7b_11.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0b717633-df64-4a29-a7ae-3e211136ae7b_11.jpg saved to cache
2025-12-05 06:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 253ed866-e9fc-540c-9698-c26cd5f3cc11
2025-12-05 06:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0b717633-df64-4a29-a7ae-3e211136ae7b_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003770420-01955701-006.pdf)
2025-12-05 06:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0b717633-df64-4a29-a7ae-3e211136ae7b_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003770420-01955701-006.pdf)
2025-12-05 06:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0b717633-df64-4a29-a7ae-3e211136ae7b_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003770420-01955701-006.pdf)
2025-12-05 06:04:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342811410>
2025-12-05 06:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac879400-02fb-57dd-9deb-b94848e0bc21/ac879400-02fb-57dd-9deb-b94848e0bc21_image_7.jpg HTTP/1.1" 201 0
2025-12-05 06:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3759761-9999999-338142912-007.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3759761-9999999-338142912-007.jpg saved to cache
2025-12-05 06:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ac879400-02fb-57dd-9deb-b94848e0bc21
2025-12-05 06:04:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23423a2d50>
2025-12-05 06:04:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac879400-02fb-57dd-9deb-b94848e0bc21/ac879400-02fb-57dd-9deb-b94848e0bc21_image_6.jpg HTTP/1.1" 201 0
2025-12-05 06:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3759761-9999999-338142912-006.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3759761-9999999-338142912-006.jpg saved to cache
2025-12-05 06:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ac879400-02fb-57dd-9deb-b94848e0bc21
2025-12-05 06:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3759761-9999999-338142912-005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003759761-01979829-002.pdf)
2025-12-05 06:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3759761-9999999-338142912-003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003759761-01979829-002.pdf)
2025-12-05 06:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3759761-9999999-338142912-008.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003759761-01979829-002.pdf)
2025-12-05 06:04:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23415ebe10>
2025-12-05 06:04:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_253ed866-e9fc-540c-9698-c26cd5f3cc11/253ed866-e9fc-540c-9698-c26cd5f3cc11_image_0.jpg HTTP/1.1" 201 0
2025-12-05 06:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0b717633-df64-4a29-a7ae-3e211136ae7b_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0b717633-df64-4a29-a7ae-3e211136ae7b_ext_7.jpg saved to cache
2025-12-05 06:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 253ed866-e9fc-540c-9698-c26cd5f3cc11
2025-12-05 06:04:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23427e48d0>
2025-12-05 06:04:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_253ed866-e9fc-540c-9698-c26cd5f3cc11/253ed866-e9fc-540c-9698-c26cd5f3cc11_image_4.jpg HTTP/1.1" 201 0
2025-12-05 06:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0b717633-df64-4a29-a7ae-3e211136ae7b_5.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0b717633-df64-4a29-a7ae-3e211136ae7b_5.jpg saved to cache
2025-12-05 06:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 253ed866-e9fc-540c-9698-c26cd5f3cc11
2025-12-05 06:04:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342524b50>
2025-12-05 06:04:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 06:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_253ed866-e9fc-540c-9698-c26cd5f3cc11/253ed866-e9fc-540c-9698-c26cd5f3cc11_image_5.jpg HTTP/1.1" 201 0
2025-12-05 06:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0b717633-df64-4a29-a7ae-3e211136ae7b_4.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0b717633-df64-4a29-a7ae-3e211136ae7b_4.jpg saved to cache
2025-12-05 06:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 253ed866-e9fc-540c-9698-c26cd5f3cc11
2025-12-05 06:04:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 253ed866-e9fc-540c-9698-c26cd5f3cc11, skipping ID generation
2025-12-05 06:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 253ed866-e9fc-540c-9698-c26cd5f3cc11 from tracking dictionaries
2025-12-05 06:04:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 253ed866-e9fc-540c-9698-c26cd5f3cc11 sending to next pipeline
2025-12-05 06:04:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 253ed866-e9fc-540c-9698-c26cd5f3cc11, identifier: 3770420
2025-12-05 06:04:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 253ed866-e9fc-540c-9698-c26cd5f3cc11 with identifier: 3770420
2025-12-05 06:04:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 253ed866-e9fc-540c-9698-c26cd5f3cc11 with identifier: 3770420
2025-12-05 06:04:12 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 253ed866-e9fc-540c-9698-c26cd5f3cc11 with identifier: 3770420 to the API
2025-12-05 06:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 06:04:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 06:04:12 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/0b717633-df64-4a29-a7ae-3e211136ae7b_4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_253ed866-e9fc-540c-9698-c26cd5f3cc11/253ed866-e9fc-540c-9698-c26cd5f3cc11_expert_report_file_51ecbe42-6d4a-4e24-a5b8-3cf31c83aac1.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003770420-01955701-006.pdf',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': '2025-12-05T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '253ed866-e9fc-540c-9698-c26cd5f3cc11',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'GU24OBW',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/PEUGEOT/2008?id=3770420',
 'listing': 'auction',
 'location': 'Bruntingthorpe',
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 26567,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 32,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_253ed866-e9fc-540c-9698-c26cd5f3cc11/253ed866-e9fc-540c-9698-c26cd5f3cc11_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 160067,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0b717633-df64-4a29-a7ae-3e211136ae7b_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_253ed866-e9fc-540c-9698-c26cd5f3cc11/253ed866-e9fc-540c-9698-c26cd5f3cc11_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 160067,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0b717633-df64-4a29-a7ae-3e211136ae7b_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_253ed866-e9fc-540c-9698-c26cd5f3cc11/253ed866-e9fc-540c-9698-c26cd5f3cc11_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 204710,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0b717633-df64-4a29-a7ae-3e211136ae7b_ext_6.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_253ed866-e9fc-540c-9698-c26cd5f3cc11/253ed866-e9fc-540c-9698-c26cd5f3cc11_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 148126,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0b717633-df64-4a29-a7ae-3e211136ae7b_ext_1.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_253ed866-e9fc-540c-9698-c26cd5f3cc11/253ed866-e9fc-540c-9698-c26cd5f3cc11_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 154125,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0b717633-df64-4a29-a7ae-3e211136ae7b_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_253ed866-e9fc-540c-9698-c26cd5f3cc11/253ed866-e9fc-540c-9698-c26cd5f3cc11_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 152542,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0b717633-df64-4a29-a7ae-3e211136ae7b_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_253ed866-e9fc-540c-9698-c26cd5f3cc11/253ed866-e9fc-540c-9698-c26cd5f3cc11_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 145251,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0b717633-df64-4a29-a7ae-3e211136ae7b_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_253ed866-e9fc-540c-9698-c26cd5f3cc11/253ed866-e9fc-540c-9698-c26cd5f3cc11_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 141088,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0b717633-df64-4a29-a7ae-3e211136ae7b_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_253ed866-e9fc-540c-9698-c26cd5f3cc11/253ed866-e9fc-540c-9698-c26cd5f3cc11_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 142322,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0b717633-df64-4a29-a7ae-3e211136ae7b_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_253ed866-e9fc-540c-9698-c26cd5f3cc11/253ed866-e9fc-540c-9698-c26cd5f3cc11_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 284129,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0b717633-df64-4a29-a7ae-3e211136ae7b_ext_2.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_253ed866-e9fc-540c-9698-c26cd5f3cc11/253ed866-e9fc-540c-9698-c26cd5f3cc11_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 176435,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0b717633-df64-4a29-a7ae-3e211136ae7b_ext_5.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_253ed866-e9fc-540c-9698-c26cd5f3cc11/253ed866-e9fc-540c-9698-c26cd5f3cc11_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 213975,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0b717633-df64-4a29-a7ae-3e211136ae7b_ext_3.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_253ed866-e9fc-540c-9698-c26cd5f3cc11/253ed866-e9fc-540c-9698-c26cd5f3cc11_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 239419,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0b717633-df64-4a29-a7ae-3e211136ae7b_ext_4.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_253ed866-e9fc-540c-9698-c26cd5f3cc11/253ed866-e9fc-540c-9698-c26cd5f3cc11_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 485899,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3770420-3967228-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_253ed866-e9fc-540c-9698-c26cd5f3cc11/253ed866-e9fc-540c-9698-c26cd5f3cc11_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 539331,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3770420-3967228-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_253ed866-e9fc-540c-9698-c26cd5f3cc11/253ed866-e9fc-540c-9698-c26cd5f3cc11_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 652597,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3770420-3967228-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_253ed866-e9fc-540c-9698-c26cd5f3cc11/253ed866-e9fc-540c-9698-c26cd5f3cc11_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 446888,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3770420-3967228-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_253ed866-e9fc-540c-9698-c26cd5f3cc11/253ed866-e9fc-540c-9698-c26cd5f3cc11_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 631330,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3770420-3967228-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_253ed866-e9fc-540c-9698-c26cd5f3cc11/253ed866-e9fc-540c-9698-c26cd5f3cc11_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 470716,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3770420-3967228-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_253ed866-e9fc-540c-9698-c26cd5f3cc11/253ed866-e9fc-540c-9698-c26cd5f3cc11_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 528187,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3770420-3967228-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-05-02',
 'seller_name': 'Leasys',
 'title': 'PEUGEOT 2008 1.2 PureTech 130 Allure 5dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech 130 Allure 5dr',
 'year': 2024}
2025-12-05 06:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273770420%27 HTTP/1.1" 200 None
2025-12-05 06:04:12 [manheim.gb] INFO: Saving data for 3770420: {'created_time': 1764914652.919952, 'last_price_update_time': 1764914652.919963, 'auction_closing_time': 1764925200.0}
2025-12-05 06:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3770420') HTTP/1.1" 204 0
2025-12-05 06:04:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342482210>
2025-12-05 06:04:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac879400-02fb-57dd-9deb-b94848e0bc21/ac879400-02fb-57dd-9deb-b94848e0bc21_image_5.jpg HTTP/1.1" 201 0
2025-12-05 06:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3759761-9999999-338142912-005.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3759761-9999999-338142912-005.jpg saved to cache
2025-12-05 06:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ac879400-02fb-57dd-9deb-b94848e0bc21
2025-12-05 06:04:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342913290>
2025-12-05 06:04:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac879400-02fb-57dd-9deb-b94848e0bc21/ac879400-02fb-57dd-9deb-b94848e0bc21_image_4.jpg HTTP/1.1" 201 0
2025-12-05 06:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3759761-9999999-338142912-003.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3759761-9999999-338142912-003.jpg saved to cache
2025-12-05 06:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ac879400-02fb-57dd-9deb-b94848e0bc21
2025-12-05 06:04:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2346055510>
2025-12-05 06:04:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac879400-02fb-57dd-9deb-b94848e0bc21/ac879400-02fb-57dd-9deb-b94848e0bc21_image_1.jpg HTTP/1.1" 201 0
2025-12-05 06:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3759761-9999999-338142912-008.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3759761-9999999-338142912-008.jpg saved to cache
2025-12-05 06:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ac879400-02fb-57dd-9deb-b94848e0bc21
2025-12-05 06:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003754570-01979832-003.pdf> (referer: None)
2025-12-05 06:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/73170474-2804-4601-b51a-3dc0f987b70a_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003779127-01955168-004.pdf)
2025-12-05 06:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/73170474-2804-4601-b51a-3dc0f987b70a_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003779127-01955168-004.pdf)
2025-12-05 06:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/73170474-2804-4601-b51a-3dc0f987b70a_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003779127-01955168-004.pdf)
2025-12-05 06:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/73170474-2804-4601-b51a-3dc0f987b70a_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003779127-01955168-004.pdf)
2025-12-05 06:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3759761-9999999-338142912-004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003759761-01979829-002.pdf)
2025-12-05 06:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3779127-4000352-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003779127-01955168-004.pdf)
2025-12-05 06:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003753808-1001614823-003.pdf> (referer: None)
2025-12-05 06:04:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234266b950>
2025-12-05 06:04:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80aeb0e1-7dfe-59c3-981a-2e534f9c8044/80aeb0e1-7dfe-59c3-981a-2e534f9c8044_expert_report_file_16069d9b-6f40-418b-94c3-bf720c49c6a9.pdf HTTP/1.1" 201 0
2025-12-05 06:04:14 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 80aeb0e1-7dfe-59c3-981a-2e534f9c8044
2025-12-05 06:04:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 80aeb0e1-7dfe-59c3-981a-2e534f9c8044, skipping ID generation
2025-12-05 06:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 80aeb0e1-7dfe-59c3-981a-2e534f9c8044
2025-12-05 06:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3754570-9999999-335065157-004.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3754570-9999999-335065157-004.jpg not downloaded yet
2025-12-05 06:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3754570-9999999-335065157-008.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3754570-9999999-335065157-008.jpg not downloaded yet
2025-12-05 06:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a8587282-d24f-4bed-9861-a3b25f5902e2_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003780546-01983656-003.pdf)
2025-12-05 06:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3754570-9999999-335065157-001.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3754570-9999999-335065157-001.jpg not downloaded yet
2025-12-05 06:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a8587282-d24f-4bed-9861-a3b25f5902e2_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003780546-01983656-003.pdf)
2025-12-05 06:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a8587282-d24f-4bed-9861-a3b25f5902e2_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003780546-01983656-003.pdf)
2025-12-05 06:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a8587282-d24f-4bed-9861-a3b25f5902e2_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003780546-01983656-003.pdf)
2025-12-05 06:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a8587282-d24f-4bed-9861-a3b25f5902e2_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003780546-01983656-003.pdf)
2025-12-05 06:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a8587282-d24f-4bed-9861-a3b25f5902e2_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003780546-01983656-003.pdf)
2025-12-05 06:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a8587282-d24f-4bed-9861-a3b25f5902e2_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003780546-01983656-003.pdf)
2025-12-05 06:04:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341eb7f90>
2025-12-05 06:04:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1efb7f0-a31b-5a6d-a39c-a0009a989668/e1efb7f0-a31b-5a6d-a39c-a0009a989668_image_12.jpg HTTP/1.1" 201 0
2025-12-05 06:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F73170474-2804-4601-b51a-3dc0f987b70a_ext_4.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/73170474-2804-4601-b51a-3dc0f987b70a_ext_4.jpg saved to cache
2025-12-05 06:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item e1efb7f0-a31b-5a6d-a39c-a0009a989668
2025-12-05 06:04:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341f27790>
2025-12-05 06:04:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1efb7f0-a31b-5a6d-a39c-a0009a989668/e1efb7f0-a31b-5a6d-a39c-a0009a989668_image_10.jpg HTTP/1.1" 201 0
2025-12-05 06:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F73170474-2804-4601-b51a-3dc0f987b70a_ext_5.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/73170474-2804-4601-b51a-3dc0f987b70a_ext_5.jpg saved to cache
2025-12-05 06:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item e1efb7f0-a31b-5a6d-a39c-a0009a989668
2025-12-05 06:04:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341ef2b50>
2025-12-05 06:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1efb7f0-a31b-5a6d-a39c-a0009a989668/e1efb7f0-a31b-5a6d-a39c-a0009a989668_image_6.jpg HTTP/1.1" 201 0
2025-12-05 06:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F73170474-2804-4601-b51a-3dc0f987b70a_11.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/73170474-2804-4601-b51a-3dc0f987b70a_11.jpg saved to cache
2025-12-05 06:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e1efb7f0-a31b-5a6d-a39c-a0009a989668
2025-12-05 06:04:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234159ae50>
2025-12-05 06:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1efb7f0-a31b-5a6d-a39c-a0009a989668/e1efb7f0-a31b-5a6d-a39c-a0009a989668_image_11.jpg HTTP/1.1" 201 0
2025-12-05 06:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F73170474-2804-4601-b51a-3dc0f987b70a_ext_3.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/73170474-2804-4601-b51a-3dc0f987b70a_ext_3.jpg saved to cache
2025-12-05 06:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item e1efb7f0-a31b-5a6d-a39c-a0009a989668
2025-12-05 06:04:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234155e210>
2025-12-05 06:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac879400-02fb-57dd-9deb-b94848e0bc21/ac879400-02fb-57dd-9deb-b94848e0bc21_image_0.jpg HTTP/1.1" 201 0
2025-12-05 06:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3759761-9999999-338142912-004.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3759761-9999999-338142912-004.jpg saved to cache
2025-12-05 06:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ac879400-02fb-57dd-9deb-b94848e0bc21
2025-12-05 06:04:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ac879400-02fb-57dd-9deb-b94848e0bc21, skipping ID generation
2025-12-05 06:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ac879400-02fb-57dd-9deb-b94848e0bc21 from tracking dictionaries
2025-12-05 06:04:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ac879400-02fb-57dd-9deb-b94848e0bc21 sending to next pipeline
2025-12-05 06:04:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: ac879400-02fb-57dd-9deb-b94848e0bc21, identifier: 3759761
2025-12-05 06:04:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2343d32d10>
2025-12-05 06:04:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1efb7f0-a31b-5a6d-a39c-a0009a989668/e1efb7f0-a31b-5a6d-a39c-a0009a989668_image_15.jpg HTTP/1.1" 201 0
2025-12-05 06:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3779127-4000352-1001.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3779127-4000352-1001.jpg saved to cache
2025-12-05 06:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item e1efb7f0-a31b-5a6d-a39c-a0009a989668
2025-12-05 06:04:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e1efb7f0-a31b-5a6d-a39c-a0009a989668, skipping ID generation
2025-12-05 06:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e1efb7f0-a31b-5a6d-a39c-a0009a989668 from tracking dictionaries
2025-12-05 06:04:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e1efb7f0-a31b-5a6d-a39c-a0009a989668 sending to next pipeline
2025-12-05 06:04:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: e1efb7f0-a31b-5a6d-a39c-a0009a989668, identifier: 3779127
2025-12-05 06:04:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23424ea650>
2025-12-05 06:04:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 06:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d244159-a22a-50b9-8b50-f957d03c08f0/4d244159-a22a-50b9-8b50-f957d03c08f0_expert_report_file_7bdbb68c-f487-4a6c-9502-885fa6a7a327.pdf HTTP/1.1" 201 0
2025-12-05 06:04:16 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 4d244159-a22a-50b9-8b50-f957d03c08f0
2025-12-05 06:04:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4d244159-a22a-50b9-8b50-f957d03c08f0, skipping ID generation
2025-12-05 06:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 4d244159-a22a-50b9-8b50-f957d03c08f0
2025-12-05 06:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc49767d0-5627-4c30-a81d-debf93832d6f_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c49767d0-5627-4c30-a81d-debf93832d6f_ext_7.jpg not downloaded yet
2025-12-05 06:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3754570-9999999-335065157-002.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3754570-9999999-335065157-002.jpg not downloaded yet
2025-12-05 06:04:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: ac879400-02fb-57dd-9deb-b94848e0bc21 with identifier: 3759761
2025-12-05 06:04:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: ac879400-02fb-57dd-9deb-b94848e0bc21 with identifier: 3759761
2025-12-05 06:04:17 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: ac879400-02fb-57dd-9deb-b94848e0bc21 with identifier: 3759761 to the API
2025-12-05 06:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 06:04:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 06:04:17 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/3759761-9999999-338142912-004.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac879400-02fb-57dd-9deb-b94848e0bc21/ac879400-02fb-57dd-9deb-b94848e0bc21_expert_report_file_6f25bfda-cdc1-454c-80d8-f8c71035f781.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003759761-01979829-002.pdf',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': '2025-12-17T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'ac879400-02fb-57dd-9deb-b94848e0bc21',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'MP73JXE',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/PEUGEOT/208?id=3759761',
 'listing': 'auction',
 'location': 'Washington',
 'make': 'PEUGEOT',
 'model': '208',
 'odometer': 9849,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 35,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac879400-02fb-57dd-9deb-b94848e0bc21/ac879400-02fb-57dd-9deb-b94848e0bc21_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 302317,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3759761-9999999-338142912-004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac879400-02fb-57dd-9deb-b94848e0bc21/ac879400-02fb-57dd-9deb-b94848e0bc21_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 286132,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3759761-9999999-338142912-008.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac879400-02fb-57dd-9deb-b94848e0bc21/ac879400-02fb-57dd-9deb-b94848e0bc21_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 132706,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3759761-9999999-338142912-001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac879400-02fb-57dd-9deb-b94848e0bc21/ac879400-02fb-57dd-9deb-b94848e0bc21_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 303539,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3759761-9999999-338142912-002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac879400-02fb-57dd-9deb-b94848e0bc21/ac879400-02fb-57dd-9deb-b94848e0bc21_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 301837,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3759761-9999999-338142912-003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac879400-02fb-57dd-9deb-b94848e0bc21/ac879400-02fb-57dd-9deb-b94848e0bc21_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 284316,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3759761-9999999-338142912-005.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac879400-02fb-57dd-9deb-b94848e0bc21/ac879400-02fb-57dd-9deb-b94848e0bc21_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 220329,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3759761-9999999-338142912-006.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac879400-02fb-57dd-9deb-b94848e0bc21/ac879400-02fb-57dd-9deb-b94848e0bc21_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 267086,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3759761-9999999-338142912-007.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac879400-02fb-57dd-9deb-b94848e0bc21/ac879400-02fb-57dd-9deb-b94848e0bc21_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 248195,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3759761-9999999-338142912-009.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac879400-02fb-57dd-9deb-b94848e0bc21/ac879400-02fb-57dd-9deb-b94848e0bc21_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 222990,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3759761-9999999-338142912-010.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac879400-02fb-57dd-9deb-b94848e0bc21/ac879400-02fb-57dd-9deb-b94848e0bc21_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 231654,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3759761-9999999-338142912-011.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac879400-02fb-57dd-9deb-b94848e0bc21/ac879400-02fb-57dd-9deb-b94848e0bc21_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 211332,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3759761-9999999-338142912-012.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac879400-02fb-57dd-9deb-b94848e0bc21/ac879400-02fb-57dd-9deb-b94848e0bc21_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 385347,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759761-4007373-13.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac879400-02fb-57dd-9deb-b94848e0bc21/ac879400-02fb-57dd-9deb-b94848e0bc21_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 316278,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759761-4007373-1000.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac879400-02fb-57dd-9deb-b94848e0bc21/ac879400-02fb-57dd-9deb-b94848e0bc21_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 383484,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759761-4007373-1001.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac879400-02fb-57dd-9deb-b94848e0bc21/ac879400-02fb-57dd-9deb-b94848e0bc21_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 228227,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759761-4007373-1002.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac879400-02fb-57dd-9deb-b94848e0bc21/ac879400-02fb-57dd-9deb-b94848e0bc21_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 299355,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759761-4007373-1003.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac879400-02fb-57dd-9deb-b94848e0bc21/ac879400-02fb-57dd-9deb-b94848e0bc21_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 279913,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759761-4007373-1004.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac879400-02fb-57dd-9deb-b94848e0bc21/ac879400-02fb-57dd-9deb-b94848e0bc21_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 359844,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759761-4007373-1005.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac879400-02fb-57dd-9deb-b94848e0bc21/ac879400-02fb-57dd-9deb-b94848e0bc21_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 441990,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3759761-4007373-1006.jpg',
             'Width': 1500}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-02-29',
 'seller_name': 'Leasys',
 'title': 'PEUGEOT 208 1.2 PureTech 100 Allure 5dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech 100 Allure 5dr',
 'year': 2024}
2025-12-05 06:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273759761%27 HTTP/1.1" 200 None
2025-12-05 06:04:17 [manheim.gb] INFO: Saving data for 3759761: {'created_time': 1764914657.358363, 'last_price_update_time': 1764914657.358374, 'auction_closing_time': 1765962000.0}
2025-12-05 06:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3759761') HTTP/1.1" 204 0
2025-12-05 06:04:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: e1efb7f0-a31b-5a6d-a39c-a0009a989668 with identifier: 3779127
2025-12-05 06:04:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: e1efb7f0-a31b-5a6d-a39c-a0009a989668 with identifier: 3779127
2025-12-05 06:04:17 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: e1efb7f0-a31b-5a6d-a39c-a0009a989668 with identifier: 3779127 to the API
2025-12-05 06:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 06:04:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 06:04:17 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/insp-0001-3779127-4000352-1001.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 32,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1efb7f0-a31b-5a6d-a39c-a0009a989668/e1efb7f0-a31b-5a6d-a39c-a0009a989668_expert_report_file_12381eb1-11b0-45e6-8f4a-baa27a638fb8.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003779127-01955168-004.pdf',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': '2025-12-05T09:00:00Z',
 'fuel_type': 'Petrol/Hybrid',
 'id': 'e1efb7f0-a31b-5a6d-a39c-a0009a989668',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'LT22ZTK',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/CITROEN/C5?id=3779127',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'CITROEN',
 'model': 'C5',
 'odometer': 42086,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 37,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1efb7f0-a31b-5a6d-a39c-a0009a989668/e1efb7f0-a31b-5a6d-a39c-a0009a989668_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 216996,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/73170474-2804-4601-b51a-3dc0f987b70a_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1efb7f0-a31b-5a6d-a39c-a0009a989668/e1efb7f0-a31b-5a6d-a39c-a0009a989668_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 216996,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/73170474-2804-4601-b51a-3dc0f987b70a_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1efb7f0-a31b-5a6d-a39c-a0009a989668/e1efb7f0-a31b-5a6d-a39c-a0009a989668_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 254857,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/73170474-2804-4601-b51a-3dc0f987b70a_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1efb7f0-a31b-5a6d-a39c-a0009a989668/e1efb7f0-a31b-5a6d-a39c-a0009a989668_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 126154,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/73170474-2804-4601-b51a-3dc0f987b70a_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1efb7f0-a31b-5a6d-a39c-a0009a989668/e1efb7f0-a31b-5a6d-a39c-a0009a989668_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 219367,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/73170474-2804-4601-b51a-3dc0f987b70a_5.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1efb7f0-a31b-5a6d-a39c-a0009a989668/e1efb7f0-a31b-5a6d-a39c-a0009a989668_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 220835,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/73170474-2804-4601-b51a-3dc0f987b70a_4.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1efb7f0-a31b-5a6d-a39c-a0009a989668/e1efb7f0-a31b-5a6d-a39c-a0009a989668_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 204596,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/73170474-2804-4601-b51a-3dc0f987b70a_11.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1efb7f0-a31b-5a6d-a39c-a0009a989668/e1efb7f0-a31b-5a6d-a39c-a0009a989668_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 214302,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/73170474-2804-4601-b51a-3dc0f987b70a_10.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1efb7f0-a31b-5a6d-a39c-a0009a989668/e1efb7f0-a31b-5a6d-a39c-a0009a989668_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 224635,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/73170474-2804-4601-b51a-3dc0f987b70a_9.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1efb7f0-a31b-5a6d-a39c-a0009a989668/e1efb7f0-a31b-5a6d-a39c-a0009a989668_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 245063,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/73170474-2804-4601-b51a-3dc0f987b70a_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1efb7f0-a31b-5a6d-a39c-a0009a989668/e1efb7f0-a31b-5a6d-a39c-a0009a989668_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 205255,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/73170474-2804-4601-b51a-3dc0f987b70a_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1efb7f0-a31b-5a6d-a39c-a0009a989668/e1efb7f0-a31b-5a6d-a39c-a0009a989668_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 206360,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/73170474-2804-4601-b51a-3dc0f987b70a_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1efb7f0-a31b-5a6d-a39c-a0009a989668/e1efb7f0-a31b-5a6d-a39c-a0009a989668_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 210957,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/73170474-2804-4601-b51a-3dc0f987b70a_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1efb7f0-a31b-5a6d-a39c-a0009a989668/e1efb7f0-a31b-5a6d-a39c-a0009a989668_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 494660,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3779127-4000352-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1efb7f0-a31b-5a6d-a39c-a0009a989668/e1efb7f0-a31b-5a6d-a39c-a0009a989668_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 332784,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3779127-4000352-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1efb7f0-a31b-5a6d-a39c-a0009a989668/e1efb7f0-a31b-5a6d-a39c-a0009a989668_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 282906,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3779127-4000352-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1efb7f0-a31b-5a6d-a39c-a0009a989668/e1efb7f0-a31b-5a6d-a39c-a0009a989668_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 224081,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3779127-4000352-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1efb7f0-a31b-5a6d-a39c-a0009a989668/e1efb7f0-a31b-5a6d-a39c-a0009a989668_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 324663,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3779127-4000352-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1efb7f0-a31b-5a6d-a39c-a0009a989668/e1efb7f0-a31b-5a6d-a39c-a0009a989668_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 379009,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3779127-4000352-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1efb7f0-a31b-5a6d-a39c-a0009a989668/e1efb7f0-a31b-5a6d-a39c-a0009a989668_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 300056,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3779127-4000352-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-12',
 'seller_name': 'Leasys',
 'title': 'CITROEN C5 1.6 Plug-in Hybrid 225 Shine Plus 5dr e-EAT8',
 'transmission': 'automatic',
 'trim': '1.6 Plug-in Hybrid 225 Shine Plus 5dr e-EAT8',
 'year': 2022}
2025-12-05 06:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273779127%27 HTTP/1.1" 200 None
2025-12-05 06:04:17 [manheim.gb] INFO: Saving data for 3779127: {'created_time': 1764914657.769964, 'last_price_update_time': 1764914657.769974, 'auction_closing_time': 1764925200.0}
2025-12-05 06:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3779127') HTTP/1.1" 204 0
2025-12-05 06:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc49767d0-5627-4c30-a81d-debf93832d6f_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c49767d0-5627-4c30-a81d-debf93832d6f_ext_7.jpg not downloaded yet
2025-12-05 06:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3754570-9999999-335065157-003.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3754570-9999999-335065157-003.jpg not downloaded yet
2025-12-05 06:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VAUXHALL/CORSA?id=3829362&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233829362&indx=319> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/BMW/X3?id=3824213&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233824213&indx=316> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc49767d0-5627-4c30-a81d-debf93832d6f_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c49767d0-5627-4c30-a81d-debf93832d6f_ext_6.jpg not downloaded yet
2025-12-05 06:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/LAND%20ROVER/RANGEROVEREVOQUE?id=3826448&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233826448&indx=318> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3754570-9999999-335065157-005.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3754570-9999999-335065157-005.jpg not downloaded yet
2025-12-05 06:04:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341eb34d0>
2025-12-05 06:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc30a7f1-e5c4-5241-bd1d-06f8594e5351/fc30a7f1-e5c4-5241-bd1d-06f8594e5351_image_7.jpg HTTP/1.1" 201 0
2025-12-05 06:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa8587282-d24f-4bed-9861-a3b25f5902e2_10.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a8587282-d24f-4bed-9861-a3b25f5902e2_10.jpg saved to cache
2025-12-05 06:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fc30a7f1-e5c4-5241-bd1d-06f8594e5351
2025-12-05 06:04:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342802650>
2025-12-05 06:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 06:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc30a7f1-e5c4-5241-bd1d-06f8594e5351/fc30a7f1-e5c4-5241-bd1d-06f8594e5351_image_4.jpg HTTP/1.1" 201 0
2025-12-05 06:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa8587282-d24f-4bed-9861-a3b25f5902e2_5.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a8587282-d24f-4bed-9861-a3b25f5902e2_5.jpg saved to cache
2025-12-05 06:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fc30a7f1-e5c4-5241-bd1d-06f8594e5351
2025-12-05 06:04:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2343b689d0>
2025-12-05 06:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc30a7f1-e5c4-5241-bd1d-06f8594e5351/fc30a7f1-e5c4-5241-bd1d-06f8594e5351_image_9.jpg HTTP/1.1" 201 0
2025-12-05 06:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa8587282-d24f-4bed-9861-a3b25f5902e2_ext_2.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a8587282-d24f-4bed-9861-a3b25f5902e2_ext_2.jpg saved to cache
2025-12-05 06:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fc30a7f1-e5c4-5241-bd1d-06f8594e5351
2025-12-05 06:04:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341f32010>
2025-12-05 06:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc30a7f1-e5c4-5241-bd1d-06f8594e5351/fc30a7f1-e5c4-5241-bd1d-06f8594e5351_image_5.jpg HTTP/1.1" 201 0
2025-12-05 06:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa8587282-d24f-4bed-9861-a3b25f5902e2_4.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a8587282-d24f-4bed-9861-a3b25f5902e2_4.jpg saved to cache
2025-12-05 06:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fc30a7f1-e5c4-5241-bd1d-06f8594e5351
2025-12-05 06:04:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23415d6410>
2025-12-05 06:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc30a7f1-e5c4-5241-bd1d-06f8594e5351/fc30a7f1-e5c4-5241-bd1d-06f8594e5351_image_6.jpg HTTP/1.1" 201 0
2025-12-05 06:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa8587282-d24f-4bed-9861-a3b25f5902e2_11.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a8587282-d24f-4bed-9861-a3b25f5902e2_11.jpg saved to cache
2025-12-05 06:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fc30a7f1-e5c4-5241-bd1d-06f8594e5351
2025-12-05 06:04:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234157c090>
2025-12-05 06:04:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc30a7f1-e5c4-5241-bd1d-06f8594e5351/fc30a7f1-e5c4-5241-bd1d-06f8594e5351_image_8.jpg HTTP/1.1" 201 0
2025-12-05 06:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa8587282-d24f-4bed-9861-a3b25f5902e2_9.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a8587282-d24f-4bed-9861-a3b25f5902e2_9.jpg saved to cache
2025-12-05 06:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fc30a7f1-e5c4-5241-bd1d-06f8594e5351
2025-12-05 06:04:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341ef6250>
2025-12-05 06:04:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc30a7f1-e5c4-5241-bd1d-06f8594e5351/fc30a7f1-e5c4-5241-bd1d-06f8594e5351_image_10.jpg HTTP/1.1" 201 0
2025-12-05 06:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa8587282-d24f-4bed-9861-a3b25f5902e2_ext_5.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a8587282-d24f-4bed-9861-a3b25f5902e2_ext_5.jpg saved to cache
2025-12-05 06:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item fc30a7f1-e5c4-5241-bd1d-06f8594e5351
2025-12-05 06:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc49767d0-5627-4c30-a81d-debf93832d6f_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c49767d0-5627-4c30-a81d-debf93832d6f_ext_1.jpg not downloaded yet
2025-12-05 06:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3754570-9999999-335065157-006.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3754570-9999999-335065157-006.jpg not downloaded yet
2025-12-05 06:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc49767d0-5627-4c30-a81d-debf93832d6f_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c49767d0-5627-4c30-a81d-debf93832d6f_5.jpg not downloaded yet
2025-12-05 06:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3754570-9999999-335065157-007.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3754570-9999999-335065157-007.jpg not downloaded yet
2025-12-05 06:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc49767d0-5627-4c30-a81d-debf93832d6f_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c49767d0-5627-4c30-a81d-debf93832d6f_4.jpg not downloaded yet
2025-12-05 06:04:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cdd774ed-46ba-59f3-ac86-f300d5685ef9 with identifier: 3829362
2025-12-05 06:04:19 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item cdd774ed-46ba-59f3-ac86-f300d5685ef9
2025-12-05 06:04:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f877e35c-ec00-5047-a2f9-57204ecd5f7f with identifier: 3824213
2025-12-05 06:04:19 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item f877e35c-ec00-5047-a2f9-57204ecd5f7f
2025-12-05 06:04:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e58c8e76-2ff4-56cf-8cad-2de624eaaf51 with identifier: 3826448
2025-12-05 06:04:19 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item e58c8e76-2ff4-56cf-8cad-2de624eaaf51
2025-12-05 06:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3754570-9999999-335065157-009.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3754570-9999999-335065157-009.jpg not downloaded yet
2025-12-05 06:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc49767d0-5627-4c30-a81d-debf93832d6f_11.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c49767d0-5627-4c30-a81d-debf93832d6f_11.jpg not downloaded yet
2025-12-05 06:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3754570-9999999-335065157-010.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3754570-9999999-335065157-010.jpg not downloaded yet
2025-12-05 06:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc49767d0-5627-4c30-a81d-debf93832d6f_10.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c49767d0-5627-4c30-a81d-debf93832d6f_10.jpg not downloaded yet
2025-12-05 06:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3754570-9999999-335065157-011.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3754570-9999999-335065157-011.jpg not downloaded yet
2025-12-05 06:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc49767d0-5627-4c30-a81d-debf93832d6f_9.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c49767d0-5627-4c30-a81d-debf93832d6f_9.jpg not downloaded yet
2025-12-05 06:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3754570-9999999-335065157-012.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3754570-9999999-335065157-012.jpg not downloaded yet
2025-12-05 06:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc49767d0-5627-4c30-a81d-debf93832d6f_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c49767d0-5627-4c30-a81d-debf93832d6f_ext_2.jpg not downloaded yet
2025-12-05 06:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3754570-4002116-13.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3754570-4002116-13.jpg not downloaded yet
2025-12-05 06:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc49767d0-5627-4c30-a81d-debf93832d6f_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c49767d0-5627-4c30-a81d-debf93832d6f_ext_5.jpg not downloaded yet
2025-12-05 06:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3754570-4002116-1000.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3754570-4002116-1000.jpg not downloaded yet
2025-12-05 06:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc49767d0-5627-4c30-a81d-debf93832d6f_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c49767d0-5627-4c30-a81d-debf93832d6f_ext_3.jpg not downloaded yet
2025-12-05 06:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3754570-4002116-1001.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3754570-4002116-1001.jpg not downloaded yet
2025-12-05 06:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc49767d0-5627-4c30-a81d-debf93832d6f_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c49767d0-5627-4c30-a81d-debf93832d6f_ext_4.jpg not downloaded yet
2025-12-05 06:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3754570-4002116-1002.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3754570-4002116-1002.jpg not downloaded yet
2025-12-05 06:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3753808-3698566-13.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3753808-3698566-13.jpg not downloaded yet
2025-12-05 06:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3754570-4002116-1003.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3754570-4002116-1003.jpg not downloaded yet
2025-12-05 06:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3753808-3698566-1000.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3753808-3698566-1000.jpg not downloaded yet
2025-12-05 06:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3754570-4002116-1004.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3754570-4002116-1004.jpg not downloaded yet
2025-12-05 06:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3753808-3698566-1001.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3753808-3698566-1001.jpg not downloaded yet
2025-12-05 06:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3754570-4002116-1005.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3754570-4002116-1005.jpg not downloaded yet
2025-12-05 06:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3753808-3698566-1002.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3753808-3698566-1002.jpg not downloaded yet
2025-12-05 06:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3754570-4002116-1006.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3754570-4002116-1006.jpg not downloaded yet
2025-12-05 06:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3753808-3698566-1003.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3753808-3698566-1003.jpg not downloaded yet
2025-12-05 06:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3753808-3698566-1004.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3753808-3698566-1004.jpg not downloaded yet
2025-12-05 06:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3753808-3698566-1005.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3753808-3698566-1005.jpg not downloaded yet
2025-12-05 06:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3753808-3698566-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003753808-1001614823-003.pdf)
2025-12-05 06:04:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234238ab90>
2025-12-05 06:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d244159-a22a-50b9-8b50-f957d03c08f0/4d244159-a22a-50b9-8b50-f957d03c08f0_image_15.jpg HTTP/1.1" 201 0
2025-12-05 06:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3753808-3698566-1001.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3753808-3698566-1001.jpg saved to cache
2025-12-05 06:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 4d244159-a22a-50b9-8b50-f957d03c08f0
2025-12-05 06:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3754570-4002116-1006.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003754570-01979832-003.pdf)
2025-12-05 06:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3753808-3698566-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003753808-1001614823-003.pdf)
2025-12-05 06:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3753808-3698566-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003753808-1001614823-003.pdf)
2025-12-05 06:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3753808-3698566-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003753808-1001614823-003.pdf)
2025-12-05 06:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3753808-3698566-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003753808-1001614823-003.pdf)
2025-12-05 06:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3754570-4002116-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003754570-01979832-003.pdf)
2025-12-05 06:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3754570-4002116-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003754570-01979832-003.pdf)
2025-12-05 06:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3754570-4002116-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003754570-01979832-003.pdf)
2025-12-05 06:04:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234156b250>
2025-12-05 06:04:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80aeb0e1-7dfe-59c3-981a-2e534f9c8044/80aeb0e1-7dfe-59c3-981a-2e534f9c8044_image_19.jpg HTTP/1.1" 201 0
2025-12-05 06:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3754570-4002116-1006.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3754570-4002116-1006.jpg saved to cache
2025-12-05 06:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 80aeb0e1-7dfe-59c3-981a-2e534f9c8044
2025-12-05 06:04:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234266b550>
2025-12-05 06:04:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d244159-a22a-50b9-8b50-f957d03c08f0/4d244159-a22a-50b9-8b50-f957d03c08f0_image_14.jpg HTTP/1.1" 201 0
2025-12-05 06:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3753808-3698566-1000.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3753808-3698566-1000.jpg saved to cache
2025-12-05 06:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 4d244159-a22a-50b9-8b50-f957d03c08f0
2025-12-05 06:04:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425ead10>
2025-12-05 06:04:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d244159-a22a-50b9-8b50-f957d03c08f0/4d244159-a22a-50b9-8b50-f957d03c08f0_image_16.jpg HTTP/1.1" 201 0
2025-12-05 06:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3753808-3698566-1002.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3753808-3698566-1002.jpg saved to cache
2025-12-05 06:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 4d244159-a22a-50b9-8b50-f957d03c08f0
2025-12-05 06:04:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234269f1d0>
2025-12-05 06:04:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d244159-a22a-50b9-8b50-f957d03c08f0/4d244159-a22a-50b9-8b50-f957d03c08f0_image_18.jpg HTTP/1.1" 201 0
2025-12-05 06:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3753808-3698566-1004.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3753808-3698566-1004.jpg saved to cache
2025-12-05 06:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 4d244159-a22a-50b9-8b50-f957d03c08f0
2025-12-05 06:04:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341f24150>
2025-12-05 06:04:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d244159-a22a-50b9-8b50-f957d03c08f0/4d244159-a22a-50b9-8b50-f957d03c08f0_image_17.jpg HTTP/1.1" 201 0
2025-12-05 06:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3753808-3698566-1003.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3753808-3698566-1003.jpg saved to cache
2025-12-05 06:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 4d244159-a22a-50b9-8b50-f957d03c08f0
2025-12-05 06:04:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341547690>
2025-12-05 06:04:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80aeb0e1-7dfe-59c3-981a-2e534f9c8044/80aeb0e1-7dfe-59c3-981a-2e534f9c8044_image_17.jpg HTTP/1.1" 201 0
2025-12-05 06:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3754570-4002116-1004.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3754570-4002116-1004.jpg saved to cache
2025-12-05 06:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 80aeb0e1-7dfe-59c3-981a-2e534f9c8044
2025-12-05 06:04:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23427bbd10>
2025-12-05 06:04:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80aeb0e1-7dfe-59c3-981a-2e534f9c8044/80aeb0e1-7dfe-59c3-981a-2e534f9c8044_image_18.jpg HTTP/1.1" 201 0
2025-12-05 06:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3754570-4002116-1005.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3754570-4002116-1005.jpg saved to cache
2025-12-05 06:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 80aeb0e1-7dfe-59c3-981a-2e534f9c8044
2025-12-05 06:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c49767d0-5627-4c30-a81d-debf93832d6f_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003753808-1001614823-003.pdf)
2025-12-05 06:04:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342840990>
2025-12-05 06:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80aeb0e1-7dfe-59c3-981a-2e534f9c8044/80aeb0e1-7dfe-59c3-981a-2e534f9c8044_image_16.jpg HTTP/1.1" 201 0
2025-12-05 06:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3754570-4002116-1003.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3754570-4002116-1003.jpg saved to cache
2025-12-05 06:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 80aeb0e1-7dfe-59c3-981a-2e534f9c8044
2025-12-05 06:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c49767d0-5627-4c30-a81d-debf93832d6f_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003753808-1001614823-003.pdf)
2025-12-05 06:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3753808-3698566-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003753808-1001614823-003.pdf)
2025-12-05 06:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c49767d0-5627-4c30-a81d-debf93832d6f_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003753808-1001614823-003.pdf)
2025-12-05 06:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3753808-3698566-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003753808-1001614823-003.pdf)
2025-12-05 06:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3754570-4002116-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003754570-01979832-003.pdf)
2025-12-05 06:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3754570-4002116-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003754570-01979832-003.pdf)
2025-12-05 06:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3754570-4002116-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003754570-01979832-003.pdf)
2025-12-05 06:04:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23424a3290>
2025-12-05 06:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d244159-a22a-50b9-8b50-f957d03c08f0/4d244159-a22a-50b9-8b50-f957d03c08f0_image_10.jpg HTTP/1.1" 201 0
2025-12-05 06:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc49767d0-5627-4c30-a81d-debf93832d6f_ext_5.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c49767d0-5627-4c30-a81d-debf93832d6f_ext_5.jpg saved to cache
2025-12-05 06:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 4d244159-a22a-50b9-8b50-f957d03c08f0
2025-12-05 06:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c49767d0-5627-4c30-a81d-debf93832d6f_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003753808-1001614823-003.pdf)
2025-12-05 06:04:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342928d10>
2025-12-05 06:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d244159-a22a-50b9-8b50-f957d03c08f0/4d244159-a22a-50b9-8b50-f957d03c08f0_image_12.jpg HTTP/1.1" 201 0
2025-12-05 06:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc49767d0-5627-4c30-a81d-debf93832d6f_ext_4.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c49767d0-5627-4c30-a81d-debf93832d6f_ext_4.jpg saved to cache
2025-12-05 06:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 4d244159-a22a-50b9-8b50-f957d03c08f0
2025-12-05 06:04:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342776010>
2025-12-05 06:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d244159-a22a-50b9-8b50-f957d03c08f0/4d244159-a22a-50b9-8b50-f957d03c08f0_image_19.jpg HTTP/1.1" 201 0
2025-12-05 06:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3753808-3698566-1005.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3753808-3698566-1005.jpg saved to cache
2025-12-05 06:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 4d244159-a22a-50b9-8b50-f957d03c08f0
2025-12-05 06:04:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342775250>
2025-12-05 06:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d244159-a22a-50b9-8b50-f957d03c08f0/4d244159-a22a-50b9-8b50-f957d03c08f0_image_11.jpg HTTP/1.1" 201 0
2025-12-05 06:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc49767d0-5627-4c30-a81d-debf93832d6f_ext_3.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c49767d0-5627-4c30-a81d-debf93832d6f_ext_3.jpg saved to cache
2025-12-05 06:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 4d244159-a22a-50b9-8b50-f957d03c08f0
2025-12-05 06:04:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425e38d0>
2025-12-05 06:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d244159-a22a-50b9-8b50-f957d03c08f0/4d244159-a22a-50b9-8b50-f957d03c08f0_image_13.jpg HTTP/1.1" 201 0
2025-12-05 06:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3753808-3698566-13.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3753808-3698566-13.jpg saved to cache
2025-12-05 06:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 4d244159-a22a-50b9-8b50-f957d03c08f0
2025-12-05 06:04:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234156cb50>
2025-12-05 06:04:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80aeb0e1-7dfe-59c3-981a-2e534f9c8044/80aeb0e1-7dfe-59c3-981a-2e534f9c8044_image_15.jpg HTTP/1.1" 201 0
2025-12-05 06:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3754570-4002116-1002.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3754570-4002116-1002.jpg saved to cache
2025-12-05 06:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 80aeb0e1-7dfe-59c3-981a-2e534f9c8044
2025-12-05 06:04:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23424de490>
2025-12-05 06:04:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80aeb0e1-7dfe-59c3-981a-2e534f9c8044/80aeb0e1-7dfe-59c3-981a-2e534f9c8044_image_14.jpg HTTP/1.1" 201 0
2025-12-05 06:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3754570-4002116-1001.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3754570-4002116-1001.jpg saved to cache
2025-12-05 06:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 80aeb0e1-7dfe-59c3-981a-2e534f9c8044
2025-12-05 06:04:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23426e74d0>
2025-12-05 06:04:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80aeb0e1-7dfe-59c3-981a-2e534f9c8044/80aeb0e1-7dfe-59c3-981a-2e534f9c8044_image_13.jpg HTTP/1.1" 201 0
2025-12-05 06:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3754570-4002116-1000.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3754570-4002116-1000.jpg saved to cache
2025-12-05 06:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 80aeb0e1-7dfe-59c3-981a-2e534f9c8044
2025-12-05 06:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c49767d0-5627-4c30-a81d-debf93832d6f_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003753808-1001614823-003.pdf)
2025-12-05 06:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/ECLASS?id=3831881&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233831881&indx=320> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:04:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23415f93d0>
2025-12-05 06:04:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d244159-a22a-50b9-8b50-f957d03c08f0/4d244159-a22a-50b9-8b50-f957d03c08f0_image_8.jpg HTTP/1.1" 201 0
2025-12-05 06:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc49767d0-5627-4c30-a81d-debf93832d6f_9.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c49767d0-5627-4c30-a81d-debf93832d6f_9.jpg saved to cache
2025-12-05 06:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4d244159-a22a-50b9-8b50-f957d03c08f0
2025-12-05 06:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3754570-9999999-335065157-012.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003754570-01979832-003.pdf)
2025-12-05 06:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3754570-9999999-335065157-011.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003754570-01979832-003.pdf)
2025-12-05 06:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c49767d0-5627-4c30-a81d-debf93832d6f_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003753808-1001614823-003.pdf)
2025-12-05 06:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3754570-9999999-335065157-010.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003754570-01979832-003.pdf)
2025-12-05 06:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c49767d0-5627-4c30-a81d-debf93832d6f_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003753808-1001614823-003.pdf)
2025-12-05 06:04:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425f86d0>
2025-12-05 06:04:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d244159-a22a-50b9-8b50-f957d03c08f0/4d244159-a22a-50b9-8b50-f957d03c08f0_image_7.jpg HTTP/1.1" 201 0
2025-12-05 06:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc49767d0-5627-4c30-a81d-debf93832d6f_10.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c49767d0-5627-4c30-a81d-debf93832d6f_10.jpg saved to cache
2025-12-05 06:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4d244159-a22a-50b9-8b50-f957d03c08f0
2025-12-05 06:04:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83204fc1-f428-5a86-beee-2ee7a68db53f with identifier: 3831881
2025-12-05 06:04:26 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 83204fc1-f428-5a86-beee-2ee7a68db53f
2025-12-05 06:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3754570-4002116-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003754570-01979832-003.pdf)
2025-12-05 06:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c49767d0-5627-4c30-a81d-debf93832d6f_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003753808-1001614823-003.pdf)
2025-12-05 06:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3754570-9999999-335065157-009.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003754570-01979832-003.pdf)
2025-12-05 06:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c49767d0-5627-4c30-a81d-debf93832d6f_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003753808-1001614823-003.pdf)
2025-12-05 06:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c49767d0-5627-4c30-a81d-debf93832d6f_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003753808-1001614823-003.pdf)
2025-12-05 06:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3754570-9999999-335065157-006.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003754570-01979832-003.pdf)
2025-12-05 06:04:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425991d0>
2025-12-05 06:04:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80aeb0e1-7dfe-59c3-981a-2e534f9c8044/80aeb0e1-7dfe-59c3-981a-2e534f9c8044_image_11.jpg HTTP/1.1" 201 0
2025-12-05 06:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3754570-9999999-335065157-012.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3754570-9999999-335065157-012.jpg saved to cache
2025-12-05 06:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 80aeb0e1-7dfe-59c3-981a-2e534f9c8044
2025-12-05 06:04:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341ebb490>
2025-12-05 06:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80aeb0e1-7dfe-59c3-981a-2e534f9c8044/80aeb0e1-7dfe-59c3-981a-2e534f9c8044_image_10.jpg HTTP/1.1" 201 0
2025-12-05 06:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3754570-9999999-335065157-011.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3754570-9999999-335065157-011.jpg saved to cache
2025-12-05 06:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 80aeb0e1-7dfe-59c3-981a-2e534f9c8044
2025-12-05 06:04:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342755d50>
2025-12-05 06:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d244159-a22a-50b9-8b50-f957d03c08f0/4d244159-a22a-50b9-8b50-f957d03c08f0_image_6.jpg HTTP/1.1" 201 0
2025-12-05 06:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc49767d0-5627-4c30-a81d-debf93832d6f_11.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c49767d0-5627-4c30-a81d-debf93832d6f_11.jpg saved to cache
2025-12-05 06:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4d244159-a22a-50b9-8b50-f957d03c08f0
2025-12-05 06:04:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234244d9d0>
2025-12-05 06:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80aeb0e1-7dfe-59c3-981a-2e534f9c8044/80aeb0e1-7dfe-59c3-981a-2e534f9c8044_image_9.jpg HTTP/1.1" 201 0
2025-12-05 06:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3754570-9999999-335065157-010.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3754570-9999999-335065157-010.jpg saved to cache
2025-12-05 06:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 80aeb0e1-7dfe-59c3-981a-2e534f9c8044
2025-12-05 06:04:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342801f50>
2025-12-05 06:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d244159-a22a-50b9-8b50-f957d03c08f0/4d244159-a22a-50b9-8b50-f957d03c08f0_image_9.jpg HTTP/1.1" 201 0
2025-12-05 06:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc49767d0-5627-4c30-a81d-debf93832d6f_ext_2.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c49767d0-5627-4c30-a81d-debf93832d6f_ext_2.jpg saved to cache
2025-12-05 06:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4d244159-a22a-50b9-8b50-f957d03c08f0
2025-12-05 06:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3754570-9999999-335065157-007.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003754570-01979832-003.pdf)
2025-12-05 06:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c49767d0-5627-4c30-a81d-debf93832d6f_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003753808-1001614823-003.pdf)
2025-12-05 06:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3754570-9999999-335065157-005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003754570-01979832-003.pdf)
2025-12-05 06:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3754570-9999999-335065157-003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003754570-01979832-003.pdf)
2025-12-05 06:04:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341ecb1d0>
2025-12-05 06:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80aeb0e1-7dfe-59c3-981a-2e534f9c8044/80aeb0e1-7dfe-59c3-981a-2e534f9c8044_image_12.jpg HTTP/1.1" 201 0
2025-12-05 06:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3754570-4002116-13.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3754570-4002116-13.jpg saved to cache
2025-12-05 06:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 80aeb0e1-7dfe-59c3-981a-2e534f9c8044
2025-12-05 06:04:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342811f90>
2025-12-05 06:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d244159-a22a-50b9-8b50-f957d03c08f0/4d244159-a22a-50b9-8b50-f957d03c08f0_image_5.jpg HTTP/1.1" 201 0
2025-12-05 06:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc49767d0-5627-4c30-a81d-debf93832d6f_4.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c49767d0-5627-4c30-a81d-debf93832d6f_4.jpg saved to cache
2025-12-05 06:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4d244159-a22a-50b9-8b50-f957d03c08f0
2025-12-05 06:04:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23427264d0>
2025-12-05 06:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80aeb0e1-7dfe-59c3-981a-2e534f9c8044/80aeb0e1-7dfe-59c3-981a-2e534f9c8044_image_8.jpg HTTP/1.1" 201 0
2025-12-05 06:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3754570-9999999-335065157-009.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3754570-9999999-335065157-009.jpg saved to cache
2025-12-05 06:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 80aeb0e1-7dfe-59c3-981a-2e534f9c8044
2025-12-05 06:04:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23424799d0>
2025-12-05 06:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d244159-a22a-50b9-8b50-f957d03c08f0/4d244159-a22a-50b9-8b50-f957d03c08f0_image_4.jpg HTTP/1.1" 201 0
2025-12-05 06:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc49767d0-5627-4c30-a81d-debf93832d6f_5.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c49767d0-5627-4c30-a81d-debf93832d6f_5.jpg saved to cache
2025-12-05 06:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4d244159-a22a-50b9-8b50-f957d03c08f0
2025-12-05 06:04:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425e1750>
2025-12-05 06:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d244159-a22a-50b9-8b50-f957d03c08f0/4d244159-a22a-50b9-8b50-f957d03c08f0_image_3.jpg HTTP/1.1" 201 0
2025-12-05 06:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc49767d0-5627-4c30-a81d-debf93832d6f_ext_1.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c49767d0-5627-4c30-a81d-debf93832d6f_ext_1.jpg saved to cache
2025-12-05 06:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4d244159-a22a-50b9-8b50-f957d03c08f0
2025-12-05 06:04:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234245e1d0>
2025-12-05 06:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80aeb0e1-7dfe-59c3-981a-2e534f9c8044/80aeb0e1-7dfe-59c3-981a-2e534f9c8044_image_6.jpg HTTP/1.1" 201 0
2025-12-05 06:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3754570-9999999-335065157-006.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3754570-9999999-335065157-006.jpg saved to cache
2025-12-05 06:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 80aeb0e1-7dfe-59c3-981a-2e534f9c8044
2025-12-05 06:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c49767d0-5627-4c30-a81d-debf93832d6f_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003753808-1001614823-003.pdf)
2025-12-05 06:04:30 [scrapy.extensions.logstats] INFO: Crawled 78 pages (at 25 pages/min), scraped 17 items (at 6 items/min)
2025-12-05 06:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3754570-9999999-335065157-001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003754570-01979832-003.pdf)
2025-12-05 06:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c49767d0-5627-4c30-a81d-debf93832d6f_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003753808-1001614823-003.pdf)
2025-12-05 06:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3754570-9999999-335065157-008.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003754570-01979832-003.pdf)
2025-12-05 06:04:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23426a9f90>
2025-12-05 06:04:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 06:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80aeb0e1-7dfe-59c3-981a-2e534f9c8044/80aeb0e1-7dfe-59c3-981a-2e534f9c8044_image_7.jpg HTTP/1.1" 201 0
2025-12-05 06:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3754570-9999999-335065157-007.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3754570-9999999-335065157-007.jpg saved to cache
2025-12-05 06:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 80aeb0e1-7dfe-59c3-981a-2e534f9c8044
2025-12-05 06:04:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23426326d0>
2025-12-05 06:04:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d244159-a22a-50b9-8b50-f957d03c08f0/4d244159-a22a-50b9-8b50-f957d03c08f0_image_1.jpg HTTP/1.1" 201 0
2025-12-05 06:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc49767d0-5627-4c30-a81d-debf93832d6f_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c49767d0-5627-4c30-a81d-debf93832d6f_ext_7.jpg saved to cache
2025-12-05 06:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4d244159-a22a-50b9-8b50-f957d03c08f0
2025-12-05 06:04:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234259be90>
2025-12-05 06:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80aeb0e1-7dfe-59c3-981a-2e534f9c8044/80aeb0e1-7dfe-59c3-981a-2e534f9c8044_image_5.jpg HTTP/1.1" 201 0
2025-12-05 06:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3754570-9999999-335065157-005.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3754570-9999999-335065157-005.jpg saved to cache
2025-12-05 06:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 80aeb0e1-7dfe-59c3-981a-2e534f9c8044
2025-12-05 06:04:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23428cc3d0>
2025-12-05 06:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80aeb0e1-7dfe-59c3-981a-2e534f9c8044/80aeb0e1-7dfe-59c3-981a-2e534f9c8044_image_4.jpg HTTP/1.1" 201 0
2025-12-05 06:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3754570-9999999-335065157-003.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3754570-9999999-335065157-003.jpg saved to cache
2025-12-05 06:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 80aeb0e1-7dfe-59c3-981a-2e534f9c8044
2025-12-05 06:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3754570-9999999-335065157-002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003754570-01979832-003.pdf)
2025-12-05 06:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VAUXHALL/MOKKA?id=3823600&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233823600&indx=314> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a8587282-d24f-4bed-9861-a3b25f5902e2_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003780546-01983656-003.pdf)
2025-12-05 06:04:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425f2650>
2025-12-05 06:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d244159-a22a-50b9-8b50-f957d03c08f0/4d244159-a22a-50b9-8b50-f957d03c08f0_image_2.jpg HTTP/1.1" 201 0
2025-12-05 06:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc49767d0-5627-4c30-a81d-debf93832d6f_ext_6.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c49767d0-5627-4c30-a81d-debf93832d6f_ext_6.jpg saved to cache
2025-12-05 06:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4d244159-a22a-50b9-8b50-f957d03c08f0
2025-12-05 06:04:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23428a5750>
2025-12-05 06:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80aeb0e1-7dfe-59c3-981a-2e534f9c8044/80aeb0e1-7dfe-59c3-981a-2e534f9c8044_image_2.jpg HTTP/1.1" 201 0
2025-12-05 06:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3754570-9999999-335065157-001.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3754570-9999999-335065157-001.jpg saved to cache
2025-12-05 06:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 80aeb0e1-7dfe-59c3-981a-2e534f9c8044
2025-12-05 06:04:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23415f8110>
2025-12-05 06:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d244159-a22a-50b9-8b50-f957d03c08f0/4d244159-a22a-50b9-8b50-f957d03c08f0_image_0.jpg HTTP/1.1" 201 0
2025-12-05 06:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc49767d0-5627-4c30-a81d-debf93832d6f_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c49767d0-5627-4c30-a81d-debf93832d6f_ext_7.jpg saved to cache
2025-12-05 06:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4d244159-a22a-50b9-8b50-f957d03c08f0
2025-12-05 06:04:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4d244159-a22a-50b9-8b50-f957d03c08f0, skipping ID generation
2025-12-05 06:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 4d244159-a22a-50b9-8b50-f957d03c08f0 from tracking dictionaries
2025-12-05 06:04:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4d244159-a22a-50b9-8b50-f957d03c08f0 sending to next pipeline
2025-12-05 06:04:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 4d244159-a22a-50b9-8b50-f957d03c08f0, identifier: 3753808
2025-12-05 06:04:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342633550>
2025-12-05 06:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80aeb0e1-7dfe-59c3-981a-2e534f9c8044/80aeb0e1-7dfe-59c3-981a-2e534f9c8044_image_1.jpg HTTP/1.1" 201 0
2025-12-05 06:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3754570-9999999-335065157-008.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3754570-9999999-335065157-008.jpg saved to cache
2025-12-05 06:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 80aeb0e1-7dfe-59c3-981a-2e534f9c8044
2025-12-05 06:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3754570-9999999-335065157-004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003754570-01979832-003.pdf)
2025-12-05 06:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a8587282-d24f-4bed-9861-a3b25f5902e2_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003780546-01983656-003.pdf)
2025-12-05 06:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3503375-4008869-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003503375-01992995-001.pdf)
2025-12-05 06:04:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 4d244159-a22a-50b9-8b50-f957d03c08f0 with identifier: 3753808
2025-12-05 06:04:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 4d244159-a22a-50b9-8b50-f957d03c08f0 with identifier: 3753808
2025-12-05 06:04:33 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 4d244159-a22a-50b9-8b50-f957d03c08f0 with identifier: 3753808 to the API
2025-12-05 06:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 06:04:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 06:04:33 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/c49767d0-5627-4c30-a81d-debf93832d6f_ext_7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d244159-a22a-50b9-8b50-f957d03c08f0/4d244159-a22a-50b9-8b50-f957d03c08f0_expert_report_file_7bdbb68c-f487-4a6c-9502-885fa6a7a327.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003753808-1001614823-003.pdf',
 'color': 'SILVER',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '4d244159-a22a-50b9-8b50-f957d03c08f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'EJ17LDE',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/E%20CLASS?id=3753808',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'MERCEDES-BENZ',
 'model': 'E CLASS',
 'odometer': 72989,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 32,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d244159-a22a-50b9-8b50-f957d03c08f0/4d244159-a22a-50b9-8b50-f957d03c08f0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 151802,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c49767d0-5627-4c30-a81d-debf93832d6f_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d244159-a22a-50b9-8b50-f957d03c08f0/4d244159-a22a-50b9-8b50-f957d03c08f0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 151802,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c49767d0-5627-4c30-a81d-debf93832d6f_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d244159-a22a-50b9-8b50-f957d03c08f0/4d244159-a22a-50b9-8b50-f957d03c08f0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 294576,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c49767d0-5627-4c30-a81d-debf93832d6f_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d244159-a22a-50b9-8b50-f957d03c08f0/4d244159-a22a-50b9-8b50-f957d03c08f0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 227643,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c49767d0-5627-4c30-a81d-debf93832d6f_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d244159-a22a-50b9-8b50-f957d03c08f0/4d244159-a22a-50b9-8b50-f957d03c08f0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 141844,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c49767d0-5627-4c30-a81d-debf93832d6f_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d244159-a22a-50b9-8b50-f957d03c08f0/4d244159-a22a-50b9-8b50-f957d03c08f0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 131632,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c49767d0-5627-4c30-a81d-debf93832d6f_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d244159-a22a-50b9-8b50-f957d03c08f0/4d244159-a22a-50b9-8b50-f957d03c08f0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 142659,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c49767d0-5627-4c30-a81d-debf93832d6f_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d244159-a22a-50b9-8b50-f957d03c08f0/4d244159-a22a-50b9-8b50-f957d03c08f0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 126184,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c49767d0-5627-4c30-a81d-debf93832d6f_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d244159-a22a-50b9-8b50-f957d03c08f0/4d244159-a22a-50b9-8b50-f957d03c08f0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 147329,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c49767d0-5627-4c30-a81d-debf93832d6f_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d244159-a22a-50b9-8b50-f957d03c08f0/4d244159-a22a-50b9-8b50-f957d03c08f0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 278196,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c49767d0-5627-4c30-a81d-debf93832d6f_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d244159-a22a-50b9-8b50-f957d03c08f0/4d244159-a22a-50b9-8b50-f957d03c08f0_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 261173,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c49767d0-5627-4c30-a81d-debf93832d6f_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d244159-a22a-50b9-8b50-f957d03c08f0/4d244159-a22a-50b9-8b50-f957d03c08f0_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 268895,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c49767d0-5627-4c30-a81d-debf93832d6f_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d244159-a22a-50b9-8b50-f957d03c08f0/4d244159-a22a-50b9-8b50-f957d03c08f0_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 296953,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c49767d0-5627-4c30-a81d-debf93832d6f_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d244159-a22a-50b9-8b50-f957d03c08f0/4d244159-a22a-50b9-8b50-f957d03c08f0_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 407239,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3753808-3698566-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d244159-a22a-50b9-8b50-f957d03c08f0/4d244159-a22a-50b9-8b50-f957d03c08f0_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 123169,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3753808-3698566-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d244159-a22a-50b9-8b50-f957d03c08f0/4d244159-a22a-50b9-8b50-f957d03c08f0_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 124553,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3753808-3698566-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d244159-a22a-50b9-8b50-f957d03c08f0/4d244159-a22a-50b9-8b50-f957d03c08f0_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 200561,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3753808-3698566-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d244159-a22a-50b9-8b50-f957d03c08f0/4d244159-a22a-50b9-8b50-f957d03c08f0_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 213597,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3753808-3698566-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d244159-a22a-50b9-8b50-f957d03c08f0/4d244159-a22a-50b9-8b50-f957d03c08f0_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 281144,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3753808-3698566-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d244159-a22a-50b9-8b50-f957d03c08f0/4d244159-a22a-50b9-8b50-f957d03c08f0_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 192862,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3753808-3698566-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-05',
 'seller_name': 'MotoNovo Finance',
 'title': 'MERCEDES-BENZ E CLASS E220d SE 4dr 9G-Tronic',
 'transmission': 'automatic',
 'trim': 'E220d SE 4dr 9G-Tronic',
 'year': 2017}
2025-12-05 06:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273753808%27 HTTP/1.1" 200 None
2025-12-05 06:04:33 [manheim.gb] INFO: Saving data for 3753808: {'created_time': 1764914673.699991, 'last_price_update_time': 1764914673.700003, 'auction_closing_time': 1765270800.0}
2025-12-05 06:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3753808') HTTP/1.1" 204 0
2025-12-05 06:04:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342937d10>
2025-12-05 06:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80aeb0e1-7dfe-59c3-981a-2e534f9c8044/80aeb0e1-7dfe-59c3-981a-2e534f9c8044_image_3.jpg HTTP/1.1" 201 0
2025-12-05 06:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3754570-9999999-335065157-002.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3754570-9999999-335065157-002.jpg saved to cache
2025-12-05 06:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 80aeb0e1-7dfe-59c3-981a-2e534f9c8044
2025-12-05 06:04:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45ebf3a4-61c8-577e-86db-bf89effb7a62 with identifier: 3823600
2025-12-05 06:04:34 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 45ebf3a4-61c8-577e-86db-bf89effb7a62
2025-12-05 06:04:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23427b2190>
2025-12-05 06:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 06:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc30a7f1-e5c4-5241-bd1d-06f8594e5351/fc30a7f1-e5c4-5241-bd1d-06f8594e5351_image_3.jpg HTTP/1.1" 201 0
2025-12-05 06:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa8587282-d24f-4bed-9861-a3b25f5902e2_ext_1.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a8587282-d24f-4bed-9861-a3b25f5902e2_ext_1.jpg saved to cache
2025-12-05 06:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fc30a7f1-e5c4-5241-bd1d-06f8594e5351
2025-12-05 06:04:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23423a1690>
2025-12-05 06:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80aeb0e1-7dfe-59c3-981a-2e534f9c8044/80aeb0e1-7dfe-59c3-981a-2e534f9c8044_image_0.jpg HTTP/1.1" 201 0
2025-12-05 06:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3754570-9999999-335065157-004.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3754570-9999999-335065157-004.jpg saved to cache
2025-12-05 06:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 80aeb0e1-7dfe-59c3-981a-2e534f9c8044
2025-12-05 06:04:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 80aeb0e1-7dfe-59c3-981a-2e534f9c8044, skipping ID generation
2025-12-05 06:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 80aeb0e1-7dfe-59c3-981a-2e534f9c8044 from tracking dictionaries
2025-12-05 06:04:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 80aeb0e1-7dfe-59c3-981a-2e534f9c8044 sending to next pipeline
2025-12-05 06:04:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 80aeb0e1-7dfe-59c3-981a-2e534f9c8044, identifier: 3754570
2025-12-05 06:04:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23427b3510>
2025-12-05 06:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc30a7f1-e5c4-5241-bd1d-06f8594e5351/fc30a7f1-e5c4-5241-bd1d-06f8594e5351_image_1.jpg HTTP/1.1" 201 0
2025-12-05 06:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa8587282-d24f-4bed-9861-a3b25f5902e2_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a8587282-d24f-4bed-9861-a3b25f5902e2_ext_7.jpg saved to cache
2025-12-05 06:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fc30a7f1-e5c4-5241-bd1d-06f8594e5351
2025-12-05 06:04:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425e1750>
2025-12-05 06:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82b277c2-1593-59af-b2dc-3c987cf84e54/82b277c2-1593-59af-b2dc-3c987cf84e54_image_19.jpg HTTP/1.1" 201 0
2025-12-05 06:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3503375-4008869-1005.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3503375-4008869-1005.jpg saved to cache
2025-12-05 06:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 82b277c2-1593-59af-b2dc-3c987cf84e54
2025-12-05 06:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a8587282-d24f-4bed-9861-a3b25f5902e2_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003780546-01983656-003.pdf)
2025-12-05 06:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3503375-4008869-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003503375-01992995-001.pdf)
2025-12-05 06:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3503375-4008869-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003503375-01992995-001.pdf)
2025-12-05 06:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3503375-4008869-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003503375-01992995-001.pdf)
2025-12-05 06:04:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 80aeb0e1-7dfe-59c3-981a-2e534f9c8044 with identifier: 3754570
2025-12-05 06:04:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 80aeb0e1-7dfe-59c3-981a-2e534f9c8044 with identifier: 3754570
2025-12-05 06:04:35 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 80aeb0e1-7dfe-59c3-981a-2e534f9c8044 with identifier: 3754570 to the API
2025-12-05 06:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 06:04:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 06:04:35 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/3754570-9999999-335065157-004.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80aeb0e1-7dfe-59c3-981a-2e534f9c8044/80aeb0e1-7dfe-59c3-981a-2e534f9c8044_expert_report_file_16069d9b-6f40-418b-94c3-bf720c49c6a9.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003754570-01979832-003.pdf',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': '2025-12-17T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '80aeb0e1-7dfe-59c3-981a-2e534f9c8044',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'MP73JXF',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/PEUGEOT/208?id=3754570',
 'listing': 'auction',
 'location': 'Washington',
 'make': 'PEUGEOT',
 'model': '208',
 'odometer': 8451,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 30,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80aeb0e1-7dfe-59c3-981a-2e534f9c8044/80aeb0e1-7dfe-59c3-981a-2e534f9c8044_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 288531,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3754570-9999999-335065157-004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80aeb0e1-7dfe-59c3-981a-2e534f9c8044/80aeb0e1-7dfe-59c3-981a-2e534f9c8044_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 253063,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3754570-9999999-335065157-008.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80aeb0e1-7dfe-59c3-981a-2e534f9c8044/80aeb0e1-7dfe-59c3-981a-2e534f9c8044_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 165172,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3754570-9999999-335065157-001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80aeb0e1-7dfe-59c3-981a-2e534f9c8044/80aeb0e1-7dfe-59c3-981a-2e534f9c8044_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 297075,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3754570-9999999-335065157-002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80aeb0e1-7dfe-59c3-981a-2e534f9c8044/80aeb0e1-7dfe-59c3-981a-2e534f9c8044_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 252960,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3754570-9999999-335065157-003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80aeb0e1-7dfe-59c3-981a-2e534f9c8044/80aeb0e1-7dfe-59c3-981a-2e534f9c8044_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 253827,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3754570-9999999-335065157-005.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80aeb0e1-7dfe-59c3-981a-2e534f9c8044/80aeb0e1-7dfe-59c3-981a-2e534f9c8044_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 226938,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3754570-9999999-335065157-006.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80aeb0e1-7dfe-59c3-981a-2e534f9c8044/80aeb0e1-7dfe-59c3-981a-2e534f9c8044_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 286019,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3754570-9999999-335065157-007.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80aeb0e1-7dfe-59c3-981a-2e534f9c8044/80aeb0e1-7dfe-59c3-981a-2e534f9c8044_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 272821,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3754570-9999999-335065157-009.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80aeb0e1-7dfe-59c3-981a-2e534f9c8044/80aeb0e1-7dfe-59c3-981a-2e534f9c8044_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 229238,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3754570-9999999-335065157-010.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80aeb0e1-7dfe-59c3-981a-2e534f9c8044/80aeb0e1-7dfe-59c3-981a-2e534f9c8044_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 233434,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3754570-9999999-335065157-011.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80aeb0e1-7dfe-59c3-981a-2e534f9c8044/80aeb0e1-7dfe-59c3-981a-2e534f9c8044_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 241378,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3754570-9999999-335065157-012.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80aeb0e1-7dfe-59c3-981a-2e534f9c8044/80aeb0e1-7dfe-59c3-981a-2e534f9c8044_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 433158,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3754570-4002116-13.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80aeb0e1-7dfe-59c3-981a-2e534f9c8044/80aeb0e1-7dfe-59c3-981a-2e534f9c8044_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 458305,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3754570-4002116-1000.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80aeb0e1-7dfe-59c3-981a-2e534f9c8044/80aeb0e1-7dfe-59c3-981a-2e534f9c8044_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 457353,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3754570-4002116-1001.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80aeb0e1-7dfe-59c3-981a-2e534f9c8044/80aeb0e1-7dfe-59c3-981a-2e534f9c8044_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 452780,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3754570-4002116-1002.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80aeb0e1-7dfe-59c3-981a-2e534f9c8044/80aeb0e1-7dfe-59c3-981a-2e534f9c8044_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 270401,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3754570-4002116-1003.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80aeb0e1-7dfe-59c3-981a-2e534f9c8044/80aeb0e1-7dfe-59c3-981a-2e534f9c8044_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 183743,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3754570-4002116-1004.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80aeb0e1-7dfe-59c3-981a-2e534f9c8044/80aeb0e1-7dfe-59c3-981a-2e534f9c8044_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 261022,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3754570-4002116-1005.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80aeb0e1-7dfe-59c3-981a-2e534f9c8044/80aeb0e1-7dfe-59c3-981a-2e534f9c8044_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 200477,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3754570-4002116-1006.jpg',
             'Width': 1500}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-02-29',
 'seller_name': 'Leasys',
 'title': 'PEUGEOT 208 1.2 PureTech 100 Allure 5dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech 100 Allure 5dr',
 'year': 2024}
2025-12-05 06:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273754570%27 HTTP/1.1" 200 None
2025-12-05 06:04:35 [manheim.gb] INFO: Saving data for 3754570: {'created_time': 1764914675.996066, 'last_price_update_time': 1764914675.996078, 'auction_closing_time': 1765962000.0}
2025-12-05 06:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3754570') HTTP/1.1" 204 0
2025-12-05 06:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3503375-4008869-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003503375-01992995-001.pdf)
2025-12-05 06:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=3823672&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233823672&indx=315> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/PEUGEOT/3008?id=3817425&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233817425&indx=313> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003826448-01984349-004.pdf> (referer: None)
2025-12-05 06:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003503375-01992995-001.pdf)
2025-12-05 06:04:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425c5310>
2025-12-05 06:04:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc30a7f1-e5c4-5241-bd1d-06f8594e5351/fc30a7f1-e5c4-5241-bd1d-06f8594e5351_image_0.jpg HTTP/1.1" 201 0
2025-12-05 06:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa8587282-d24f-4bed-9861-a3b25f5902e2_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a8587282-d24f-4bed-9861-a3b25f5902e2_ext_7.jpg saved to cache
2025-12-05 06:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fc30a7f1-e5c4-5241-bd1d-06f8594e5351
2025-12-05 06:04:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fc30a7f1-e5c4-5241-bd1d-06f8594e5351, skipping ID generation
2025-12-05 06:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Removing item fc30a7f1-e5c4-5241-bd1d-06f8594e5351 from tracking dictionaries
2025-12-05 06:04:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fc30a7f1-e5c4-5241-bd1d-06f8594e5351 sending to next pipeline
2025-12-05 06:04:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: fc30a7f1-e5c4-5241-bd1d-06f8594e5351, identifier: 3780546
2025-12-05 06:04:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342a255d0>
2025-12-05 06:04:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82b277c2-1593-59af-b2dc-3c987cf84e54/82b277c2-1593-59af-b2dc-3c987cf84e54_image_17.jpg HTTP/1.1" 201 0
2025-12-05 06:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3503375-4008869-1003.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3503375-4008869-1003.jpg saved to cache
2025-12-05 06:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 82b277c2-1593-59af-b2dc-3c987cf84e54
2025-12-05 06:04:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425c4cd0>
2025-12-05 06:04:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82b277c2-1593-59af-b2dc-3c987cf84e54/82b277c2-1593-59af-b2dc-3c987cf84e54_image_16.jpg HTTP/1.1" 201 0
2025-12-05 06:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3503375-4008869-1002.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3503375-4008869-1002.jpg saved to cache
2025-12-05 06:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 82b277c2-1593-59af-b2dc-3c987cf84e54
2025-12-05 06:04:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23427a6550>
2025-12-05 06:04:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 06:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82b277c2-1593-59af-b2dc-3c987cf84e54/82b277c2-1593-59af-b2dc-3c987cf84e54_image_18.jpg HTTP/1.1" 201 0
2025-12-05 06:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3503375-4008869-1004.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3503375-4008869-1004.jpg saved to cache
2025-12-05 06:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 82b277c2-1593-59af-b2dc-3c987cf84e54
2025-12-05 06:04:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: fc30a7f1-e5c4-5241-bd1d-06f8594e5351 with identifier: 3780546
2025-12-05 06:04:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: fc30a7f1-e5c4-5241-bd1d-06f8594e5351 with identifier: 3780546
2025-12-05 06:04:37 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: fc30a7f1-e5c4-5241-bd1d-06f8594e5351 with identifier: 3780546 to the API
2025-12-05 06:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 06:04:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 06:04:37 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/a8587282-d24f-4bed-9861-a3b25f5902e2_ext_7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc30a7f1-e5c4-5241-bd1d-06f8594e5351/fc30a7f1-e5c4-5241-bd1d-06f8594e5351_expert_report_file_17f789d4-ea71-4c5f-b300-84afdb81dd98.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003780546-01983656-003.pdf',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'fc30a7f1-e5c4-5241-bd1d-06f8594e5351',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'DN24TCO',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VAUXHALL/GRANDLAND?id=3780546',
 'listing': 'auction',
 'location': 'Bristol',
 'make': 'VAUXHALL',
 'model': 'GRANDLAND',
 'odometer': 14990,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 26,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc30a7f1-e5c4-5241-bd1d-06f8594e5351/fc30a7f1-e5c4-5241-bd1d-06f8594e5351_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 267599,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a8587282-d24f-4bed-9861-a3b25f5902e2_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc30a7f1-e5c4-5241-bd1d-06f8594e5351/fc30a7f1-e5c4-5241-bd1d-06f8594e5351_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 267599,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a8587282-d24f-4bed-9861-a3b25f5902e2_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc30a7f1-e5c4-5241-bd1d-06f8594e5351/fc30a7f1-e5c4-5241-bd1d-06f8594e5351_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 230631,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a8587282-d24f-4bed-9861-a3b25f5902e2_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc30a7f1-e5c4-5241-bd1d-06f8594e5351/fc30a7f1-e5c4-5241-bd1d-06f8594e5351_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116713,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a8587282-d24f-4bed-9861-a3b25f5902e2_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc30a7f1-e5c4-5241-bd1d-06f8594e5351/fc30a7f1-e5c4-5241-bd1d-06f8594e5351_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 258182,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a8587282-d24f-4bed-9861-a3b25f5902e2_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc30a7f1-e5c4-5241-bd1d-06f8594e5351/fc30a7f1-e5c4-5241-bd1d-06f8594e5351_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 219330,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a8587282-d24f-4bed-9861-a3b25f5902e2_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc30a7f1-e5c4-5241-bd1d-06f8594e5351/fc30a7f1-e5c4-5241-bd1d-06f8594e5351_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 245119,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a8587282-d24f-4bed-9861-a3b25f5902e2_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc30a7f1-e5c4-5241-bd1d-06f8594e5351/fc30a7f1-e5c4-5241-bd1d-06f8594e5351_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 187797,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a8587282-d24f-4bed-9861-a3b25f5902e2_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc30a7f1-e5c4-5241-bd1d-06f8594e5351/fc30a7f1-e5c4-5241-bd1d-06f8594e5351_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 258096,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a8587282-d24f-4bed-9861-a3b25f5902e2_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc30a7f1-e5c4-5241-bd1d-06f8594e5351/fc30a7f1-e5c4-5241-bd1d-06f8594e5351_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 246642,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a8587282-d24f-4bed-9861-a3b25f5902e2_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc30a7f1-e5c4-5241-bd1d-06f8594e5351/fc30a7f1-e5c4-5241-bd1d-06f8594e5351_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 204956,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a8587282-d24f-4bed-9861-a3b25f5902e2_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc30a7f1-e5c4-5241-bd1d-06f8594e5351/fc30a7f1-e5c4-5241-bd1d-06f8594e5351_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 190967,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a8587282-d24f-4bed-9861-a3b25f5902e2_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc30a7f1-e5c4-5241-bd1d-06f8594e5351/fc30a7f1-e5c4-5241-bd1d-06f8594e5351_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 160841,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a8587282-d24f-4bed-9861-a3b25f5902e2_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc30a7f1-e5c4-5241-bd1d-06f8594e5351/fc30a7f1-e5c4-5241-bd1d-06f8594e5351_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 341739,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3780546-3999371-13.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc30a7f1-e5c4-5241-bd1d-06f8594e5351/fc30a7f1-e5c4-5241-bd1d-06f8594e5351_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 244674,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3780546-3999371-1000.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc30a7f1-e5c4-5241-bd1d-06f8594e5351/fc30a7f1-e5c4-5241-bd1d-06f8594e5351_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 337134,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3780546-3999371-1001.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc30a7f1-e5c4-5241-bd1d-06f8594e5351/fc30a7f1-e5c4-5241-bd1d-06f8594e5351_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 271918,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3780546-3999371-1002.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc30a7f1-e5c4-5241-bd1d-06f8594e5351/fc30a7f1-e5c4-5241-bd1d-06f8594e5351_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 275354,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3780546-3999371-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc30a7f1-e5c4-5241-bd1d-06f8594e5351/fc30a7f1-e5c4-5241-bd1d-06f8594e5351_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 352272,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3780546-3999371-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc30a7f1-e5c4-5241-bd1d-06f8594e5351/fc30a7f1-e5c4-5241-bd1d-06f8594e5351_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 212454,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3780546-3999371-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-03-31',
 'seller_name': 'Leasys',
 'title': 'VAUXHALL GRANDLAND 1.2 Turbo Ultimate 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.2 Turbo Ultimate 5dr Auto',
 'year': 2024}
2025-12-05 06:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273780546%27 HTTP/1.1" 200 None
2025-12-05 06:04:37 [manheim.gb] INFO: Saving data for 3780546: {'created_time': 1764914677.846259, 'last_price_update_time': 1764914677.846274, 'auction_closing_time': 1765270800.0}
2025-12-05 06:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3780546') HTTP/1.1" 204 0
2025-12-05 06:04:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3503375-4008869-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003503375-01992995-001.pdf)
2025-12-05 06:04:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3503375-4008869-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003503375-01992995-001.pdf)
2025-12-05 06:04:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003503375-01992995-001.pdf)
2025-12-05 06:04:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003503375-01992995-001.pdf)
2025-12-05 06:04:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003503375-01992995-001.pdf)
2025-12-05 06:04:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:04:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:04:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342554b10>
2025-12-05 06:04:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82b277c2-1593-59af-b2dc-3c987cf84e54/82b277c2-1593-59af-b2dc-3c987cf84e54_image_15.jpg HTTP/1.1" 201 0
2025-12-05 06:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3503375-4008869-1001.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3503375-4008869-1001.jpg saved to cache
2025-12-05 06:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 82b277c2-1593-59af-b2dc-3c987cf84e54
2025-12-05 06:04:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e7b446d-32b9-5f4d-b8c9-277d3bd70f39 with identifier: 3823672
2025-12-05 06:04:38 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 3e7b446d-32b9-5f4d-b8c9-277d3bd70f39
2025-12-05 06:04:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3a5ec65-b2dd-5298-b0b2-31410f732030 with identifier: 3817425
2025-12-05 06:04:38 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item f3a5ec65-b2dd-5298-b0b2-31410f732030
2025-12-05 06:04:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342560850>
2025-12-05 06:04:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e58c8e76-2ff4-56cf-8cad-2de624eaaf51/e58c8e76-2ff4-56cf-8cad-2de624eaaf51_expert_report_file_512f24d2-e87f-4cdc-87c9-1c01f00a8065.pdf HTTP/1.1" 201 0
2025-12-05 06:04:38 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item e58c8e76-2ff4-56cf-8cad-2de624eaaf51
2025-12-05 06:04:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e58c8e76-2ff4-56cf-8cad-2de624eaaf51, skipping ID generation
2025-12-05 06:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item e58c8e76-2ff4-56cf-8cad-2de624eaaf51
2025-12-05 06:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ffb737c6f-c492-4fae-8d44-7d2b06025fc2_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fb737c6f-c492-4fae-8d44-7d2b06025fc2_ext_7.jpg not downloaded yet
2025-12-05 06:04:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23423a0d50>
2025-12-05 06:04:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 06:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82b277c2-1593-59af-b2dc-3c987cf84e54/82b277c2-1593-59af-b2dc-3c987cf84e54_image_12.jpg HTTP/1.1" 201 0
2025-12-05 06:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_ext_4.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_ext_4.jpg saved to cache
2025-12-05 06:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 82b277c2-1593-59af-b2dc-3c987cf84e54
2025-12-05 06:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003503375-01992995-001.pdf)
2025-12-05 06:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003503375-01992995-001.pdf)
2025-12-05 06:04:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:04:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003503375-01992995-001.pdf)
2025-12-05 06:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ffb737c6f-c492-4fae-8d44-7d2b06025fc2_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fb737c6f-c492-4fae-8d44-7d2b06025fc2_ext_7.jpg not downloaded yet
2025-12-05 06:04:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425f0f90>
2025-12-05 06:04:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82b277c2-1593-59af-b2dc-3c987cf84e54/82b277c2-1593-59af-b2dc-3c987cf84e54_image_14.jpg HTTP/1.1" 201 0
2025-12-05 06:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3503375-4008869-1000.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3503375-4008869-1000.jpg saved to cache
2025-12-05 06:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 82b277c2-1593-59af-b2dc-3c987cf84e54
2025-12-05 06:04:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425e9350>
2025-12-05 06:04:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82b277c2-1593-59af-b2dc-3c987cf84e54/82b277c2-1593-59af-b2dc-3c987cf84e54_image_13.jpg HTTP/1.1" 201 0
2025-12-05 06:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3503375-4008869-13.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3503375-4008869-13.jpg saved to cache
2025-12-05 06:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 82b277c2-1593-59af-b2dc-3c987cf84e54
2025-12-05 06:04:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425e8d10>
2025-12-05 06:04:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82b277c2-1593-59af-b2dc-3c987cf84e54/82b277c2-1593-59af-b2dc-3c987cf84e54_image_11.jpg HTTP/1.1" 201 0
2025-12-05 06:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_ext_3.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_ext_3.jpg saved to cache
2025-12-05 06:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 82b277c2-1593-59af-b2dc-3c987cf84e54
2025-12-05 06:04:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234158a1d0>
2025-12-05 06:04:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82b277c2-1593-59af-b2dc-3c987cf84e54/82b277c2-1593-59af-b2dc-3c987cf84e54_image_8.jpg HTTP/1.1" 201 0
2025-12-05 06:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_9.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_9.jpg saved to cache
2025-12-05 06:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 82b277c2-1593-59af-b2dc-3c987cf84e54
2025-12-05 06:04:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425f3310>
2025-12-05 06:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82b277c2-1593-59af-b2dc-3c987cf84e54/82b277c2-1593-59af-b2dc-3c987cf84e54_image_7.jpg HTTP/1.1" 201 0
2025-12-05 06:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_10.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_10.jpg saved to cache
2025-12-05 06:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 82b277c2-1593-59af-b2dc-3c987cf84e54
2025-12-05 06:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003829362-01842225-006.pdf> (referer: None)
2025-12-05 06:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003503375-01992995-001.pdf)
2025-12-05 06:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003503375-01992995-001.pdf)
2025-12-05 06:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ffb737c6f-c492-4fae-8d44-7d2b06025fc2_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fb737c6f-c492-4fae-8d44-7d2b06025fc2_ext_6.jpg not downloaded yet
2025-12-05 06:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ffb737c6f-c492-4fae-8d44-7d2b06025fc2_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fb737c6f-c492-4fae-8d44-7d2b06025fc2_ext_1.jpg not downloaded yet
2025-12-05 06:04:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23426e6550>
2025-12-05 06:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82b277c2-1593-59af-b2dc-3c987cf84e54/82b277c2-1593-59af-b2dc-3c987cf84e54_image_10.jpg HTTP/1.1" 201 0
2025-12-05 06:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_ext_5.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_ext_5.jpg saved to cache
2025-12-05 06:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 82b277c2-1593-59af-b2dc-3c987cf84e54
2025-12-05 06:04:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234287ca50>
2025-12-05 06:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82b277c2-1593-59af-b2dc-3c987cf84e54/82b277c2-1593-59af-b2dc-3c987cf84e54_image_6.jpg HTTP/1.1" 201 0
2025-12-05 06:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_11.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_11.jpg saved to cache
2025-12-05 06:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 82b277c2-1593-59af-b2dc-3c987cf84e54
2025-12-05 06:04:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234278e450>
2025-12-05 06:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82b277c2-1593-59af-b2dc-3c987cf84e54/82b277c2-1593-59af-b2dc-3c987cf84e54_image_9.jpg HTTP/1.1" 201 0
2025-12-05 06:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_ext_2.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_ext_2.jpg saved to cache
2025-12-05 06:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 82b277c2-1593-59af-b2dc-3c987cf84e54
2025-12-05 06:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003824213-01978293-001.pdf> (referer: None)
2025-12-05 06:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003503375-01992995-001.pdf)
2025-12-05 06:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003503375-01992995-001.pdf)
2025-12-05 06:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003503375-01992995-001.pdf)
2025-12-05 06:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ffb737c6f-c492-4fae-8d44-7d2b06025fc2_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fb737c6f-c492-4fae-8d44-7d2b06025fc2_5.jpg not downloaded yet
2025-12-05 06:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003503375-01992995-001.pdf)
2025-12-05 06:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ffb737c6f-c492-4fae-8d44-7d2b06025fc2_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fb737c6f-c492-4fae-8d44-7d2b06025fc2_4.jpg not downloaded yet
2025-12-05 06:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/fb737c6f-c492-4fae-8d44-7d2b06025fc2_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003826448-01984349-004.pdf)
2025-12-05 06:04:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342374850>
2025-12-05 06:04:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 06:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdd774ed-46ba-59f3-ac86-f300d5685ef9/cdd774ed-46ba-59f3-ac86-f300d5685ef9_expert_report_file_b0d4a835-ba82-4325-9f8c-ce5dd3c6e273.pdf HTTP/1.1" 201 0
2025-12-05 06:04:41 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item cdd774ed-46ba-59f3-ac86-f300d5685ef9
2025-12-05 06:04:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cdd774ed-46ba-59f3-ac86-f300d5685ef9, skipping ID generation
2025-12-05 06:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item cdd774ed-46ba-59f3-ac86-f300d5685ef9
2025-12-05 06:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2e6ddce8-3187-4da9-a215-b05262291ef5_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2e6ddce8-3187-4da9-a215-b05262291ef5_ext_7.jpg already downloaded
2025-12-05 06:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2e6ddce8-3187-4da9-a215-b05262291ef5_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2e6ddce8-3187-4da9-a215-b05262291ef5_ext_7.jpg already downloaded
2025-12-05 06:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2e6ddce8-3187-4da9-a215-b05262291ef5_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2e6ddce8-3187-4da9-a215-b05262291ef5_ext_6.jpg already downloaded
2025-12-05 06:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2e6ddce8-3187-4da9-a215-b05262291ef5_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2e6ddce8-3187-4da9-a215-b05262291ef5_ext_1.jpg already downloaded
2025-12-05 06:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2e6ddce8-3187-4da9-a215-b05262291ef5_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2e6ddce8-3187-4da9-a215-b05262291ef5_5.jpg already downloaded
2025-12-05 06:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2e6ddce8-3187-4da9-a215-b05262291ef5_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2e6ddce8-3187-4da9-a215-b05262291ef5_4.jpg already downloaded
2025-12-05 06:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2e6ddce8-3187-4da9-a215-b05262291ef5_11.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2e6ddce8-3187-4da9-a215-b05262291ef5_11.jpg already downloaded
2025-12-05 06:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2e6ddce8-3187-4da9-a215-b05262291ef5_10.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2e6ddce8-3187-4da9-a215-b05262291ef5_10.jpg already downloaded
2025-12-05 06:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2e6ddce8-3187-4da9-a215-b05262291ef5_9.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2e6ddce8-3187-4da9-a215-b05262291ef5_9.jpg already downloaded
2025-12-05 06:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2e6ddce8-3187-4da9-a215-b05262291ef5_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2e6ddce8-3187-4da9-a215-b05262291ef5_ext_2.jpg already downloaded
2025-12-05 06:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2e6ddce8-3187-4da9-a215-b05262291ef5_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2e6ddce8-3187-4da9-a215-b05262291ef5_ext_5.jpg already downloaded
2025-12-05 06:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2e6ddce8-3187-4da9-a215-b05262291ef5_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2e6ddce8-3187-4da9-a215-b05262291ef5_ext_3.jpg already downloaded
2025-12-05 06:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2e6ddce8-3187-4da9-a215-b05262291ef5_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2e6ddce8-3187-4da9-a215-b05262291ef5_ext_4.jpg already downloaded
2025-12-05 06:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3829362-3917972-13.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3829362-3917972-13.jpg already downloaded
2025-12-05 06:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3829362-3917972-1000.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3829362-3917972-1000.jpg already downloaded
2025-12-05 06:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3829362-3917972-1001.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3829362-3917972-1001.jpg already downloaded
2025-12-05 06:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3829362-3917972-1002.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3829362-3917972-1002.jpg already downloaded
2025-12-05 06:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3829362-3917972-1003.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3829362-3917972-1003.jpg already downloaded
2025-12-05 06:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3829362-3917972-1004.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3829362-3917972-1004.jpg already downloaded
2025-12-05 06:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3829362-3917972-1005.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3829362-3917972-1005.jpg already downloaded
2025-12-05 06:04:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: cdd774ed-46ba-59f3-ac86-f300d5685ef9, identifier: 3829362
2025-12-05 06:04:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342617350>
2025-12-05 06:04:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 06:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82b277c2-1593-59af-b2dc-3c987cf84e54/82b277c2-1593-59af-b2dc-3c987cf84e54_image_5.jpg HTTP/1.1" 201 0
2025-12-05 06:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_4.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_4.jpg saved to cache
2025-12-05 06:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 82b277c2-1593-59af-b2dc-3c987cf84e54
2025-12-05 06:04:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23427f7c50>
2025-12-05 06:04:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82b277c2-1593-59af-b2dc-3c987cf84e54/82b277c2-1593-59af-b2dc-3c987cf84e54_image_4.jpg HTTP/1.1" 201 0
2025-12-05 06:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_5.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_5.jpg saved to cache
2025-12-05 06:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 82b277c2-1593-59af-b2dc-3c987cf84e54
2025-12-05 06:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ffb737c6f-c492-4fae-8d44-7d2b06025fc2_11.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fb737c6f-c492-4fae-8d44-7d2b06025fc2_11.jpg not downloaded yet
2025-12-05 06:04:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: cdd774ed-46ba-59f3-ac86-f300d5685ef9 with identifier: 3829362
2025-12-05 06:04:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: cdd774ed-46ba-59f3-ac86-f300d5685ef9 with identifier: 3829362
2025-12-05 06:04:43 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: cdd774ed-46ba-59f3-ac86-f300d5685ef9 with identifier: 3829362 to the API
2025-12-05 06:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 06:04:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 06:04:43 [scrapy.core.scraper] DEBUG: Scraped from <200 http://ecr.manheim.co.uk/pdf/MOL-0003829362-01842225-006.pdf>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdd774ed-46ba-59f3-ac86-f300d5685ef9/cdd774ed-46ba-59f3-ac86-f300d5685ef9_expert_report_file_b0d4a835-ba82-4325-9f8c-ce5dd3c6e273.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003829362-01842225-006.pdf',
 'color': 'RED',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': '2025-12-05T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'cdd774ed-46ba-59f3-ac86-f300d5685ef9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'KF73CMO',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VAUXHALL/CORSA?id=3829362',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'VAUXHALL',
 'model': 'CORSA',
 'odometer': 9165,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 34,
 'photo_urls': ['http://images.manheim.co.uk/images/units/zoom/2e6ddce8-3187-4da9-a215-b05262291ef5_ext_7.jpg',
                'http://images.manheim.co.uk/images/units/zoom/2e6ddce8-3187-4da9-a215-b05262291ef5_ext_7.jpg',
                'http://images.manheim.co.uk/images/units/zoom/2e6ddce8-3187-4da9-a215-b05262291ef5_ext_6.jpg',
                'http://images.manheim.co.uk/images/units/zoom/2e6ddce8-3187-4da9-a215-b05262291ef5_ext_1.jpg',
                'http://images.manheim.co.uk/images/units/zoom/2e6ddce8-3187-4da9-a215-b05262291ef5_5.jpg',
                'http://images.manheim.co.uk/images/units/zoom/2e6ddce8-3187-4da9-a215-b05262291ef5_4.jpg',
                'http://images.manheim.co.uk/images/units/zoom/2e6ddce8-3187-4da9-a215-b05262291ef5_11.jpg',
                'http://images.manheim.co.uk/images/units/zoom/2e6ddce8-3187-4da9-a215-b05262291ef5_10.jpg',
                'http://images.manheim.co.uk/images/units/zoom/2e6ddce8-3187-4da9-a215-b05262291ef5_9.jpg',
                'http://images.manheim.co.uk/images/units/zoom/2e6ddce8-3187-4da9-a215-b05262291ef5_ext_2.jpg',
                'http://images.manheim.co.uk/images/units/zoom/2e6ddce8-3187-4da9-a215-b05262291ef5_ext_5.jpg',
                'http://images.manheim.co.uk/images/units/zoom/2e6ddce8-3187-4da9-a215-b05262291ef5_ext_3.jpg',
                'http://images.manheim.co.uk/images/units/zoom/2e6ddce8-3187-4da9-a215-b05262291ef5_ext_4.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3829362-3917972-13.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3829362-3917972-1000.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3829362-3917972-1001.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3829362-3917972-1002.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3829362-3917972-1003.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3829362-3917972-1004.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3829362-3917972-1005.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdd774ed-46ba-59f3-ac86-f300d5685ef9/cdd774ed-46ba-59f3-ac86-f300d5685ef9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 122103,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2e6ddce8-3187-4da9-a215-b05262291ef5_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdd774ed-46ba-59f3-ac86-f300d5685ef9/cdd774ed-46ba-59f3-ac86-f300d5685ef9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 122103,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2e6ddce8-3187-4da9-a215-b05262291ef5_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdd774ed-46ba-59f3-ac86-f300d5685ef9/cdd774ed-46ba-59f3-ac86-f300d5685ef9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 259534,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2e6ddce8-3187-4da9-a215-b05262291ef5_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdd774ed-46ba-59f3-ac86-f300d5685ef9/cdd774ed-46ba-59f3-ac86-f300d5685ef9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120459,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2e6ddce8-3187-4da9-a215-b05262291ef5_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdd774ed-46ba-59f3-ac86-f300d5685ef9/cdd774ed-46ba-59f3-ac86-f300d5685ef9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110874,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2e6ddce8-3187-4da9-a215-b05262291ef5_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdd774ed-46ba-59f3-ac86-f300d5685ef9/cdd774ed-46ba-59f3-ac86-f300d5685ef9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101182,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2e6ddce8-3187-4da9-a215-b05262291ef5_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdd774ed-46ba-59f3-ac86-f300d5685ef9/cdd774ed-46ba-59f3-ac86-f300d5685ef9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 129317,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2e6ddce8-3187-4da9-a215-b05262291ef5_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdd774ed-46ba-59f3-ac86-f300d5685ef9/cdd774ed-46ba-59f3-ac86-f300d5685ef9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116180,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2e6ddce8-3187-4da9-a215-b05262291ef5_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdd774ed-46ba-59f3-ac86-f300d5685ef9/cdd774ed-46ba-59f3-ac86-f300d5685ef9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 133269,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2e6ddce8-3187-4da9-a215-b05262291ef5_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdd774ed-46ba-59f3-ac86-f300d5685ef9/cdd774ed-46ba-59f3-ac86-f300d5685ef9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 272154,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2e6ddce8-3187-4da9-a215-b05262291ef5_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdd774ed-46ba-59f3-ac86-f300d5685ef9/cdd774ed-46ba-59f3-ac86-f300d5685ef9_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 272204,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2e6ddce8-3187-4da9-a215-b05262291ef5_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdd774ed-46ba-59f3-ac86-f300d5685ef9/cdd774ed-46ba-59f3-ac86-f300d5685ef9_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 231204,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2e6ddce8-3187-4da9-a215-b05262291ef5_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdd774ed-46ba-59f3-ac86-f300d5685ef9/cdd774ed-46ba-59f3-ac86-f300d5685ef9_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 253709,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2e6ddce8-3187-4da9-a215-b05262291ef5_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdd774ed-46ba-59f3-ac86-f300d5685ef9/cdd774ed-46ba-59f3-ac86-f300d5685ef9_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 503370,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3829362-3917972-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdd774ed-46ba-59f3-ac86-f300d5685ef9/cdd774ed-46ba-59f3-ac86-f300d5685ef9_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 368501,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3829362-3917972-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdd774ed-46ba-59f3-ac86-f300d5685ef9/cdd774ed-46ba-59f3-ac86-f300d5685ef9_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 308848,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3829362-3917972-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdd774ed-46ba-59f3-ac86-f300d5685ef9/cdd774ed-46ba-59f3-ac86-f300d5685ef9_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 275522,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3829362-3917972-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdd774ed-46ba-59f3-ac86-f300d5685ef9/cdd774ed-46ba-59f3-ac86-f300d5685ef9_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 550975,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3829362-3917972-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdd774ed-46ba-59f3-ac86-f300d5685ef9/cdd774ed-46ba-59f3-ac86-f300d5685ef9_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 262575,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3829362-3917972-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdd774ed-46ba-59f3-ac86-f300d5685ef9/cdd774ed-46ba-59f3-ac86-f300d5685ef9_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 473240,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3829362-3917972-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-01-31',
 'seller_name': 'Leasys',
 'title': 'VAUXHALL CORSA 1.2 Turbo 130 GS 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.2 Turbo 130 GS 5dr Auto',
 'year': 2024}
2025-12-05 06:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273829362%27 HTTP/1.1" 200 None
2025-12-05 06:04:43 [manheim.gb] INFO: Saving data for 3829362: {'created_time': 1764914683.280018, 'last_price_update_time': 1764914683.280032, 'auction_closing_time': 1764925200.0}
2025-12-05 06:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3829362') HTTP/1.1" 204 0
2025-12-05 06:04:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/PEUGEOT/308?id=3813190&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233813190&indx=312> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ffb737c6f-c492-4fae-8d44-7d2b06025fc2_10.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fb737c6f-c492-4fae-8d44-7d2b06025fc2_10.jpg not downloaded yet
2025-12-05 06:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ffb737c6f-c492-4fae-8d44-7d2b06025fc2_9.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fb737c6f-c492-4fae-8d44-7d2b06025fc2_9.jpg not downloaded yet
2025-12-05 06:04:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234234b390>
2025-12-05 06:04:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_expert_report_file_a9e63c42-e51c-458d-8d19-d8371f9f0020.pdf HTTP/1.1" 201 0
2025-12-05 06:04:43 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item f877e35c-ec00-5047-a2f9-57204ecd5f7f
2025-12-05 06:04:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f877e35c-ec00-5047-a2f9-57204ecd5f7f, skipping ID generation
2025-12-05 06:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item f877e35c-ec00-5047-a2f9-57204ecd5f7f
2025-12-05 06:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc56a8903-6ffb-4568-bd07-6c623cf256da_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_ext_7.jpg not downloaded yet
2025-12-05 06:04:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342696650>
2025-12-05 06:04:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82b277c2-1593-59af-b2dc-3c987cf84e54/82b277c2-1593-59af-b2dc-3c987cf84e54_image_1.jpg HTTP/1.1" 201 0
2025-12-05 06:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_ext_7.jpg saved to cache
2025-12-05 06:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 82b277c2-1593-59af-b2dc-3c987cf84e54
2025-12-05 06:04:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23426f4990>
2025-12-05 06:04:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82b277c2-1593-59af-b2dc-3c987cf84e54/82b277c2-1593-59af-b2dc-3c987cf84e54_image_3.jpg HTTP/1.1" 201 0
2025-12-05 06:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_ext_1.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_ext_1.jpg saved to cache
2025-12-05 06:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 82b277c2-1593-59af-b2dc-3c987cf84e54
2025-12-05 06:04:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23427bb6d0>
2025-12-05 06:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82b277c2-1593-59af-b2dc-3c987cf84e54/82b277c2-1593-59af-b2dc-3c987cf84e54_image_0.jpg HTTP/1.1" 201 0
2025-12-05 06:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_ext_7.jpg saved to cache
2025-12-05 06:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 82b277c2-1593-59af-b2dc-3c987cf84e54
2025-12-05 06:04:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425c4310>
2025-12-05 06:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82b277c2-1593-59af-b2dc-3c987cf84e54/82b277c2-1593-59af-b2dc-3c987cf84e54_image_2.jpg HTTP/1.1" 201 0
2025-12-05 06:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_ext_6.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_ext_6.jpg saved to cache
2025-12-05 06:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 82b277c2-1593-59af-b2dc-3c987cf84e54
2025-12-05 06:04:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 82b277c2-1593-59af-b2dc-3c987cf84e54, skipping ID generation
2025-12-05 06:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 82b277c2-1593-59af-b2dc-3c987cf84e54 from tracking dictionaries
2025-12-05 06:04:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 82b277c2-1593-59af-b2dc-3c987cf84e54 sending to next pipeline
2025-12-05 06:04:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 82b277c2-1593-59af-b2dc-3c987cf84e54, identifier: 3503375
2025-12-05 06:04:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23427c0cd0>
2025-12-05 06:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e58c8e76-2ff4-56cf-8cad-2de624eaaf51/e58c8e76-2ff4-56cf-8cad-2de624eaaf51_image_0.jpg HTTP/1.1" 201 0
2025-12-05 06:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ffb737c6f-c492-4fae-8d44-7d2b06025fc2_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fb737c6f-c492-4fae-8d44-7d2b06025fc2_ext_7.jpg saved to cache
2025-12-05 06:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e58c8e76-2ff4-56cf-8cad-2de624eaaf51
2025-12-05 06:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003831881-01817630-003.pdf> (referer: None)
2025-12-05 06:04:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 82b277c2-1593-59af-b2dc-3c987cf84e54 with identifier: 3503375
2025-12-05 06:04:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 82b277c2-1593-59af-b2dc-3c987cf84e54 with identifier: 3503375
2025-12-05 06:04:45 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 179967 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    179967
2025-12-05 06:04:45 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 82b277c2-1593-59af-b2dc-3c987cf84e54 spider: manheim.gb
2025-12-05 06:04:45 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 82b277c2-1593-59af-b2dc-3c987cf84e54 due to rule: high_mileage_for_country.json, error: 179967 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    179967
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82b277c2-1593-59af-b2dc-3c987cf84e54/82b277c2-1593-59af-b2dc-3c987cf84e54_expert_report_file_9135562e-9d63-42e8-86b4-e7fd0dbb7c78.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003503375-01992995-001.pdf',
 'color': 'RED',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': '2025-12-11T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '82b277c2-1593-59af-b2dc-3c987cf84e54',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'AK16PNX',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/PEUGEOT/208?id=3503375',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'PEUGEOT',
 'model': '208',
 'odometer': 111827,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 42,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82b277c2-1593-59af-b2dc-3c987cf84e54/82b277c2-1593-59af-b2dc-3c987cf84e54_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 168278,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82b277c2-1593-59af-b2dc-3c987cf84e54/82b277c2-1593-59af-b2dc-3c987cf84e54_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 168278,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82b277c2-1593-59af-b2dc-3c987cf84e54/82b277c2-1593-59af-b2dc-3c987cf84e54_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 271257,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82b277c2-1593-59af-b2dc-3c987cf84e54/82b277c2-1593-59af-b2dc-3c987cf84e54_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 167613,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82b277c2-1593-59af-b2dc-3c987cf84e54/82b277c2-1593-59af-b2dc-3c987cf84e54_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 168647,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_5.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82b277c2-1593-59af-b2dc-3c987cf84e54/82b277c2-1593-59af-b2dc-3c987cf84e54_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 172570,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_4.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82b277c2-1593-59af-b2dc-3c987cf84e54/82b277c2-1593-59af-b2dc-3c987cf84e54_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 170741,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_11.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82b277c2-1593-59af-b2dc-3c987cf84e54/82b277c2-1593-59af-b2dc-3c987cf84e54_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 168694,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_10.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82b277c2-1593-59af-b2dc-3c987cf84e54/82b277c2-1593-59af-b2dc-3c987cf84e54_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 167217,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_9.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82b277c2-1593-59af-b2dc-3c987cf84e54/82b277c2-1593-59af-b2dc-3c987cf84e54_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 282307,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82b277c2-1593-59af-b2dc-3c987cf84e54/82b277c2-1593-59af-b2dc-3c987cf84e54_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 208539,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82b277c2-1593-59af-b2dc-3c987cf84e54/82b277c2-1593-59af-b2dc-3c987cf84e54_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 168246,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82b277c2-1593-59af-b2dc-3c987cf84e54/82b277c2-1593-59af-b2dc-3c987cf84e54_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 241040,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5443f7e6-4dd0-43e0-843e-9ef7b020cc0f_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82b277c2-1593-59af-b2dc-3c987cf84e54/82b277c2-1593-59af-b2dc-3c987cf84e54_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 394305,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3503375-4008869-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82b277c2-1593-59af-b2dc-3c987cf84e54/82b277c2-1593-59af-b2dc-3c987cf84e54_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 381572,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3503375-4008869-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82b277c2-1593-59af-b2dc-3c987cf84e54/82b277c2-1593-59af-b2dc-3c987cf84e54_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 357832,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3503375-4008869-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82b277c2-1593-59af-b2dc-3c987cf84e54/82b277c2-1593-59af-b2dc-3c987cf84e54_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 299140,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3503375-4008869-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82b277c2-1593-59af-b2dc-3c987cf84e54/82b277c2-1593-59af-b2dc-3c987cf84e54_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 274357,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3503375-4008869-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82b277c2-1593-59af-b2dc-3c987cf84e54/82b277c2-1593-59af-b2dc-3c987cf84e54_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 324343,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3503375-4008869-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82b277c2-1593-59af-b2dc-3c987cf84e54/82b277c2-1593-59af-b2dc-3c987cf84e54_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 296738,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3503375-4008869-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-30',
 'seller_name': 'MotoNovo Finance',
 'title': 'PEUGEOT 208 1.2 PureTech 110 GT Line 5dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech 110 GT Line 5dr',
 'year': 2016}
2025-12-05 06:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273503375%27 HTTP/1.1" 200 None
2025-12-05 06:04:45 [manheim.gb] INFO: Saving data for 3503375: {'created_time': 1764914685.474096, 'last_price_update_time': 1764914685.474113, 'auction_closing_time': 1765443600.0}
2025-12-05 06:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3503375') HTTP/1.1" 204 0
2025-12-05 06:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ffb737c6f-c492-4fae-8d44-7d2b06025fc2_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fb737c6f-c492-4fae-8d44-7d2b06025fc2_ext_2.jpg not downloaded yet
2025-12-05 06:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc56a8903-6ffb-4568-bd07-6c623cf256da_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_ext_7.jpg not downloaded yet
2025-12-05 06:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ffb737c6f-c492-4fae-8d44-7d2b06025fc2_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fb737c6f-c492-4fae-8d44-7d2b06025fc2_ext_5.jpg not downloaded yet
2025-12-05 06:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc56a8903-6ffb-4568-bd07-6c623cf256da_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_ext_6.jpg not downloaded yet
2025-12-05 06:04:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22b951ae-4a77-5890-87b1-2bbcd3929ff0 with identifier: 3813190
2025-12-05 06:04:45 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 22b951ae-4a77-5890-87b1-2bbcd3929ff0
2025-12-05 06:04:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341567590>
2025-12-05 06:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83204fc1-f428-5a86-beee-2ee7a68db53f/83204fc1-f428-5a86-beee-2ee7a68db53f_expert_report_file_5880b861-ee51-4bd5-aec4-ced34dd7ac79.pdf HTTP/1.1" 201 0
2025-12-05 06:04:45 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 83204fc1-f428-5a86-beee-2ee7a68db53f
2025-12-05 06:04:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 83204fc1-f428-5a86-beee-2ee7a68db53f, skipping ID generation
2025-12-05 06:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 83204fc1-f428-5a86-beee-2ee7a68db53f
2025-12-05 06:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4b1eba83-8ce4-4764-be38-bb3706453840_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b1eba83-8ce4-4764-be38-bb3706453840_ext_7.jpg not downloaded yet
2025-12-05 06:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ffb737c6f-c492-4fae-8d44-7d2b06025fc2_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fb737c6f-c492-4fae-8d44-7d2b06025fc2_ext_3.jpg not downloaded yet
2025-12-05 06:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc56a8903-6ffb-4568-bd07-6c623cf256da_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_ext_1.jpg not downloaded yet
2025-12-05 06:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4b1eba83-8ce4-4764-be38-bb3706453840_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b1eba83-8ce4-4764-be38-bb3706453840_ext_7.jpg not downloaded yet
2025-12-05 06:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ffb737c6f-c492-4fae-8d44-7d2b06025fc2_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fb737c6f-c492-4fae-8d44-7d2b06025fc2_ext_4.jpg not downloaded yet
2025-12-05 06:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc56a8903-6ffb-4568-bd07-6c623cf256da_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_5.jpg not downloaded yet
2025-12-05 06:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003823600-01832134-002.pdf> (referer: None)
2025-12-05 06:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4b1eba83-8ce4-4764-be38-bb3706453840_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b1eba83-8ce4-4764-be38-bb3706453840_ext_6.jpg not downloaded yet
2025-12-05 06:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3826448-4003120-13.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3826448-4003120-13.jpg not downloaded yet
2025-12-05 06:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc56a8903-6ffb-4568-bd07-6c623cf256da_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_4.jpg not downloaded yet
2025-12-05 06:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4b1eba83-8ce4-4764-be38-bb3706453840_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b1eba83-8ce4-4764-be38-bb3706453840_ext_1.jpg not downloaded yet
2025-12-05 06:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3826448-4003120-1000.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3826448-4003120-1000.jpg not downloaded yet
2025-12-05 06:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc56a8903-6ffb-4568-bd07-6c623cf256da_11.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_11.jpg not downloaded yet
2025-12-05 06:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4b1eba83-8ce4-4764-be38-bb3706453840_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b1eba83-8ce4-4764-be38-bb3706453840_5.jpg not downloaded yet
2025-12-05 06:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3826448-4003120-1001.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3826448-4003120-1001.jpg not downloaded yet
2025-12-05 06:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc56a8903-6ffb-4568-bd07-6c623cf256da_10.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_10.jpg not downloaded yet
2025-12-05 06:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4b1eba83-8ce4-4764-be38-bb3706453840_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b1eba83-8ce4-4764-be38-bb3706453840_4.jpg not downloaded yet
2025-12-05 06:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3826448-4003120-1002.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3826448-4003120-1002.jpg not downloaded yet
2025-12-05 06:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc56a8903-6ffb-4568-bd07-6c623cf256da_9.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_9.jpg not downloaded yet
2025-12-05 06:04:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342910450>
2025-12-05 06:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_expert_report_file_fb4824e6-5b1f-4170-b596-9061c202f82f.pdf HTTP/1.1" 201 0
2025-12-05 06:04:46 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 45ebf3a4-61c8-577e-86db-bf89effb7a62
2025-12-05 06:04:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 45ebf3a4-61c8-577e-86db-bf89effb7a62, skipping ID generation
2025-12-05 06:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 45ebf3a4-61c8-577e-86db-bf89effb7a62
2025-12-05 06:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1eca6e6e-984f-49fc-980d-607bb35b426d_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_ext_7.jpg not downloaded yet
2025-12-05 06:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4b1eba83-8ce4-4764-be38-bb3706453840_11.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b1eba83-8ce4-4764-be38-bb3706453840_11.jpg not downloaded yet
2025-12-05 06:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3826448-4003120-1003.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3826448-4003120-1003.jpg not downloaded yet
2025-12-05 06:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc56a8903-6ffb-4568-bd07-6c623cf256da_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_ext_2.jpg not downloaded yet
2025-12-05 06:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1eca6e6e-984f-49fc-980d-607bb35b426d_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_ext_7.jpg not downloaded yet
2025-12-05 06:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4b1eba83-8ce4-4764-be38-bb3706453840_10.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b1eba83-8ce4-4764-be38-bb3706453840_10.jpg not downloaded yet
2025-12-05 06:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3826448-4003120-1004.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3826448-4003120-1004.jpg not downloaded yet
2025-12-05 06:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc56a8903-6ffb-4568-bd07-6c623cf256da_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_ext_5.jpg not downloaded yet
2025-12-05 06:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1eca6e6e-984f-49fc-980d-607bb35b426d_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_ext_6.jpg not downloaded yet
2025-12-05 06:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4b1eba83-8ce4-4764-be38-bb3706453840_9.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b1eba83-8ce4-4764-be38-bb3706453840_9.jpg not downloaded yet
2025-12-05 06:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3826448-4003120-1005.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3826448-4003120-1005.jpg not downloaded yet
2025-12-05 06:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc56a8903-6ffb-4568-bd07-6c623cf256da_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_ext_3.jpg not downloaded yet
2025-12-05 06:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1eca6e6e-984f-49fc-980d-607bb35b426d_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_ext_1.jpg not downloaded yet
2025-12-05 06:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4b1eba83-8ce4-4764-be38-bb3706453840_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b1eba83-8ce4-4764-be38-bb3706453840_ext_2.jpg not downloaded yet
2025-12-05 06:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc56a8903-6ffb-4568-bd07-6c623cf256da_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_ext_4.jpg not downloaded yet
2025-12-05 06:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1eca6e6e-984f-49fc-980d-607bb35b426d_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_5.jpg not downloaded yet
2025-12-05 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4b1eba83-8ce4-4764-be38-bb3706453840_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b1eba83-8ce4-4764-be38-bb3706453840_ext_5.jpg not downloaded yet
2025-12-05 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3824213-4000660-13.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3824213-4000660-13.jpg not downloaded yet
2025-12-05 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1eca6e6e-984f-49fc-980d-607bb35b426d_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_4.jpg not downloaded yet
2025-12-05 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4b1eba83-8ce4-4764-be38-bb3706453840_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b1eba83-8ce4-4764-be38-bb3706453840_ext_3.jpg not downloaded yet
2025-12-05 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3824213-4000660-1000.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3824213-4000660-1000.jpg not downloaded yet
2025-12-05 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1eca6e6e-984f-49fc-980d-607bb35b426d_11.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_11.jpg not downloaded yet
2025-12-05 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4b1eba83-8ce4-4764-be38-bb3706453840_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b1eba83-8ce4-4764-be38-bb3706453840_ext_4.jpg not downloaded yet
2025-12-05 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3824213-4000660-1001.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3824213-4000660-1001.jpg not downloaded yet
2025-12-05 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1eca6e6e-984f-49fc-980d-607bb35b426d_10.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_10.jpg not downloaded yet
2025-12-05 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3831881-3793437-13.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3831881-3793437-13.jpg not downloaded yet
2025-12-05 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3824213-4000660-1002.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3824213-4000660-1002.jpg not downloaded yet
2025-12-05 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1eca6e6e-984f-49fc-980d-607bb35b426d_9.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_9.jpg not downloaded yet
2025-12-05 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3831881-3793437-1000.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3831881-3793437-1000.jpg not downloaded yet
2025-12-05 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3824213-4000660-1003.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3824213-4000660-1003.jpg not downloaded yet
2025-12-05 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1eca6e6e-984f-49fc-980d-607bb35b426d_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_ext_2.jpg not downloaded yet
2025-12-05 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3831881-3793437-1001.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3831881-3793437-1001.jpg not downloaded yet
2025-12-05 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3824213-4000660-1004.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3824213-4000660-1004.jpg not downloaded yet
2025-12-05 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1eca6e6e-984f-49fc-980d-607bb35b426d_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_ext_5.jpg not downloaded yet
2025-12-05 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3831881-3793437-1002.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3831881-3793437-1002.jpg not downloaded yet
2025-12-05 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3824213-4000660-1005.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3824213-4000660-1005.jpg not downloaded yet
2025-12-05 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1eca6e6e-984f-49fc-980d-607bb35b426d_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_ext_3.jpg not downloaded yet
2025-12-05 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3831881-3793437-1003.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3831881-3793437-1003.jpg not downloaded yet
2025-12-05 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1eca6e6e-984f-49fc-980d-607bb35b426d_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_ext_4.jpg not downloaded yet
2025-12-05 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3831881-3793437-1004.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3831881-3793437-1004.jpg not downloaded yet
2025-12-05 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3823600-3828660-13.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3823600-3828660-13.jpg not downloaded yet
2025-12-05 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3831881-3793437-1005.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3831881-3793437-1005.jpg not downloaded yet
2025-12-05 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3823600-3828660-1000.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3823600-3828660-1000.jpg not downloaded yet
2025-12-05 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3823600-3828660-1001.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3823600-3828660-1001.jpg not downloaded yet
2025-12-05 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3823600-3828660-1002.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3823600-3828660-1002.jpg not downloaded yet
2025-12-05 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3823600-3828660-1003.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3823600-3828660-1003.jpg not downloaded yet
2025-12-05 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3823600-3828660-1004.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3823600-3828660-1004.jpg not downloaded yet
2025-12-05 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3823600-3828660-1005.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3823600-3828660-1005.jpg not downloaded yet
2025-12-05 06:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3831881-3793437-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003831881-01817630-003.pdf)
2025-12-05 06:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3831881-3793437-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003831881-01817630-003.pdf)
2025-12-05 06:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3831881-3793437-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003831881-01817630-003.pdf)
2025-12-05 06:04:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342801150>
2025-12-05 06:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83204fc1-f428-5a86-beee-2ee7a68db53f/83204fc1-f428-5a86-beee-2ee7a68db53f_image_17.jpg HTTP/1.1" 201 0
2025-12-05 06:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3831881-3793437-1003.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3831881-3793437-1003.jpg saved to cache
2025-12-05 06:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 83204fc1-f428-5a86-beee-2ee7a68db53f
2025-12-05 06:04:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23426e67d0>
2025-12-05 06:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83204fc1-f428-5a86-beee-2ee7a68db53f/83204fc1-f428-5a86-beee-2ee7a68db53f_image_18.jpg HTTP/1.1" 201 0
2025-12-05 06:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3831881-3793437-1004.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3831881-3793437-1004.jpg saved to cache
2025-12-05 06:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 83204fc1-f428-5a86-beee-2ee7a68db53f
2025-12-05 06:04:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234238a050>
2025-12-05 06:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83204fc1-f428-5a86-beee-2ee7a68db53f/83204fc1-f428-5a86-beee-2ee7a68db53f_image_16.jpg HTTP/1.1" 201 0
2025-12-05 06:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3831881-3793437-1002.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3831881-3793437-1002.jpg saved to cache
2025-12-05 06:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 83204fc1-f428-5a86-beee-2ee7a68db53f
2025-12-05 06:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003823600-01832134-002.pdf)
2025-12-05 06:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003823600-01832134-002.pdf)
2025-12-05 06:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003823600-01832134-002.pdf)
2025-12-05 06:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3824213-4000660-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003824213-01978293-001.pdf)
2025-12-05 06:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3831881-3793437-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003831881-01817630-003.pdf)
2025-12-05 06:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3824213-4000660-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003824213-01978293-001.pdf)
2025-12-05 06:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3824213-4000660-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003824213-01978293-001.pdf)
2025-12-05 06:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003823600-01832134-002.pdf)
2025-12-05 06:04:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23429113d0>
2025-12-05 06:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 06:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_12.jpg HTTP/1.1" 201 0
2025-12-05 06:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1eca6e6e-984f-49fc-980d-607bb35b426d_ext_4.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_ext_4.jpg saved to cache
2025-12-05 06:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 45ebf3a4-61c8-577e-86db-bf89effb7a62
2025-12-05 06:04:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2343b69890>
2025-12-05 06:04:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 06:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_11.jpg HTTP/1.1" 201 0
2025-12-05 06:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1eca6e6e-984f-49fc-980d-607bb35b426d_ext_3.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_ext_3.jpg saved to cache
2025-12-05 06:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 45ebf3a4-61c8-577e-86db-bf89effb7a62
2025-12-05 06:04:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234247b0d0>
2025-12-05 06:04:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_10.jpg HTTP/1.1" 201 0
2025-12-05 06:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1eca6e6e-984f-49fc-980d-607bb35b426d_ext_5.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_ext_5.jpg saved to cache
2025-12-05 06:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 45ebf3a4-61c8-577e-86db-bf89effb7a62
2025-12-05 06:04:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23423a3450>
2025-12-05 06:04:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_19.jpg HTTP/1.1" 201 0
2025-12-05 06:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3824213-4000660-1005.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3824213-4000660-1005.jpg saved to cache
2025-12-05 06:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item f877e35c-ec00-5047-a2f9-57204ecd5f7f
2025-12-05 06:04:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23423ab6d0>
2025-12-05 06:04:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:04:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83204fc1-f428-5a86-beee-2ee7a68db53f/83204fc1-f428-5a86-beee-2ee7a68db53f_image_15.jpg HTTP/1.1" 201 0
2025-12-05 06:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3831881-3793437-1001.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3831881-3793437-1001.jpg saved to cache
2025-12-05 06:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 83204fc1-f428-5a86-beee-2ee7a68db53f
2025-12-05 06:04:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234244fb50>
2025-12-05 06:04:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:04:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_17.jpg HTTP/1.1" 201 0
2025-12-05 06:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3824213-4000660-1003.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3824213-4000660-1003.jpg saved to cache
2025-12-05 06:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item f877e35c-ec00-5047-a2f9-57204ecd5f7f
2025-12-05 06:04:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23428cc950>
2025-12-05 06:04:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_18.jpg HTTP/1.1" 201 0
2025-12-05 06:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3824213-4000660-1004.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3824213-4000660-1004.jpg saved to cache
2025-12-05 06:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item f877e35c-ec00-5047-a2f9-57204ecd5f7f
2025-12-05 06:04:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341ea0b50>
2025-12-05 06:04:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_9.jpg HTTP/1.1" 201 0
2025-12-05 06:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1eca6e6e-984f-49fc-980d-607bb35b426d_ext_2.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_ext_2.jpg saved to cache
2025-12-05 06:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 45ebf3a4-61c8-577e-86db-bf89effb7a62
2025-12-05 06:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3823600-3828660-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003823600-01832134-002.pdf)
2025-12-05 06:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3823600-3828660-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003823600-01832134-002.pdf)
2025-12-05 06:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3831881-3793437-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003831881-01817630-003.pdf)
2025-12-05 06:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3823600-3828660-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003823600-01832134-002.pdf)
2025-12-05 06:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3823600-3828660-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003823600-01832134-002.pdf)
2025-12-05 06:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3831881-3793437-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003831881-01817630-003.pdf)
2025-12-05 06:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3823600-3828660-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003823600-01832134-002.pdf)
2025-12-05 06:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3823600-3828660-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003823600-01832134-002.pdf)
2025-12-05 06:04:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341f01950>
2025-12-05 06:04:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_14.jpg HTTP/1.1" 201 0
2025-12-05 06:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3823600-3828660-1000.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3823600-3828660-1000.jpg saved to cache
2025-12-05 06:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 45ebf3a4-61c8-577e-86db-bf89effb7a62
2025-12-05 06:04:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342727590>
2025-12-05 06:04:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_17.jpg HTTP/1.1" 201 0
2025-12-05 06:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3823600-3828660-1003.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3823600-3828660-1003.jpg saved to cache
2025-12-05 06:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 45ebf3a4-61c8-577e-86db-bf89effb7a62
2025-12-05 06:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4b1eba83-8ce4-4764-be38-bb3706453840_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003831881-01817630-003.pdf)
2025-12-05 06:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003823600-01832134-002.pdf)
2025-12-05 06:04:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23424f45d0>
2025-12-05 06:04:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83204fc1-f428-5a86-beee-2ee7a68db53f/83204fc1-f428-5a86-beee-2ee7a68db53f_image_14.jpg HTTP/1.1" 201 0
2025-12-05 06:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3831881-3793437-1000.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3831881-3793437-1000.jpg saved to cache
2025-12-05 06:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 83204fc1-f428-5a86-beee-2ee7a68db53f
2025-12-05 06:04:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23424ace10>
2025-12-05 06:04:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_15.jpg HTTP/1.1" 201 0
2025-12-05 06:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3823600-3828660-1001.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3823600-3828660-1001.jpg saved to cache
2025-12-05 06:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 45ebf3a4-61c8-577e-86db-bf89effb7a62
2025-12-05 06:04:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342928490>
2025-12-05 06:04:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_19.jpg HTTP/1.1" 201 0
2025-12-05 06:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3823600-3828660-1005.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3823600-3828660-1005.jpg saved to cache
2025-12-05 06:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 45ebf3a4-61c8-577e-86db-bf89effb7a62
2025-12-05 06:04:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23415694d0>
2025-12-05 06:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:04:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83204fc1-f428-5a86-beee-2ee7a68db53f/83204fc1-f428-5a86-beee-2ee7a68db53f_image_19.jpg HTTP/1.1" 201 0
2025-12-05 06:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3831881-3793437-1005.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3831881-3793437-1005.jpg saved to cache
2025-12-05 06:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 83204fc1-f428-5a86-beee-2ee7a68db53f
2025-12-05 06:04:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23424adfd0>
2025-12-05 06:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:04:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_18.jpg HTTP/1.1" 201 0
2025-12-05 06:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3823600-3828660-1004.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3823600-3828660-1004.jpg saved to cache
2025-12-05 06:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 45ebf3a4-61c8-577e-86db-bf89effb7a62
2025-12-05 06:04:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23415a25d0>
2025-12-05 06:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:04:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_16.jpg HTTP/1.1" 201 0
2025-12-05 06:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3823600-3828660-1002.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3823600-3828660-1002.jpg saved to cache
2025-12-05 06:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 45ebf3a4-61c8-577e-86db-bf89effb7a62
2025-12-05 06:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3824213-4000660-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003824213-01978293-001.pdf)
2025-12-05 06:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003823600-01832134-002.pdf)
2025-12-05 06:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3831881-3793437-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003831881-01817630-003.pdf)
2025-12-05 06:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003823600-01832134-002.pdf)
2025-12-05 06:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4b1eba83-8ce4-4764-be38-bb3706453840_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003831881-01817630-003.pdf)
2025-12-05 06:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3823600-3828660-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003823600-01832134-002.pdf)
2025-12-05 06:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3824213-4000660-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003824213-01978293-001.pdf)
2025-12-05 06:04:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234239bbd0>
2025-12-05 06:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83204fc1-f428-5a86-beee-2ee7a68db53f/83204fc1-f428-5a86-beee-2ee7a68db53f_image_12.jpg HTTP/1.1" 201 0
2025-12-05 06:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4b1eba83-8ce4-4764-be38-bb3706453840_ext_4.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b1eba83-8ce4-4764-be38-bb3706453840_ext_4.jpg saved to cache
2025-12-05 06:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 83204fc1-f428-5a86-beee-2ee7a68db53f
2025-12-05 06:04:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425fba90>
2025-12-05 06:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_8.jpg HTTP/1.1" 201 0
2025-12-05 06:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1eca6e6e-984f-49fc-980d-607bb35b426d_9.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_9.jpg saved to cache
2025-12-05 06:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 45ebf3a4-61c8-577e-86db-bf89effb7a62
2025-12-05 06:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3824213-4000660-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003824213-01978293-001.pdf)
2025-12-05 06:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003823600-01832134-002.pdf)
2025-12-05 06:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003823600-01832134-002.pdf)
2025-12-05 06:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4b1eba83-8ce4-4764-be38-bb3706453840_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003831881-01817630-003.pdf)
2025-12-05 06:04:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341eba850>
2025-12-05 06:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_16.jpg HTTP/1.1" 201 0
2025-12-05 06:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3824213-4000660-1002.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3824213-4000660-1002.jpg saved to cache
2025-12-05 06:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item f877e35c-ec00-5047-a2f9-57204ecd5f7f
2025-12-05 06:04:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23429342d0>
2025-12-05 06:04:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_7.jpg HTTP/1.1" 201 0
2025-12-05 06:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1eca6e6e-984f-49fc-980d-607bb35b426d_10.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_10.jpg saved to cache
2025-12-05 06:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 45ebf3a4-61c8-577e-86db-bf89effb7a62
2025-12-05 06:04:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23423c6610>
2025-12-05 06:04:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83204fc1-f428-5a86-beee-2ee7a68db53f/83204fc1-f428-5a86-beee-2ee7a68db53f_image_13.jpg HTTP/1.1" 201 0
2025-12-05 06:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3831881-3793437-13.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3831881-3793437-13.jpg saved to cache
2025-12-05 06:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 83204fc1-f428-5a86-beee-2ee7a68db53f
2025-12-05 06:04:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23423c7710>
2025-12-05 06:04:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_6.jpg HTTP/1.1" 201 0
2025-12-05 06:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1eca6e6e-984f-49fc-980d-607bb35b426d_11.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_11.jpg saved to cache
2025-12-05 06:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 45ebf3a4-61c8-577e-86db-bf89effb7a62
2025-12-05 06:04:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23424c4690>
2025-12-05 06:04:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 06:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83204fc1-f428-5a86-beee-2ee7a68db53f/83204fc1-f428-5a86-beee-2ee7a68db53f_image_11.jpg HTTP/1.1" 201 0
2025-12-05 06:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4b1eba83-8ce4-4764-be38-bb3706453840_ext_3.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b1eba83-8ce4-4764-be38-bb3706453840_ext_3.jpg saved to cache
2025-12-05 06:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 83204fc1-f428-5a86-beee-2ee7a68db53f
2025-12-05 06:04:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341ea9490>
2025-12-05 06:04:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_13.jpg HTTP/1.1" 201 0
2025-12-05 06:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3823600-3828660-13.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3823600-3828660-13.jpg saved to cache
2025-12-05 06:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 45ebf3a4-61c8-577e-86db-bf89effb7a62
2025-12-05 06:04:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342525810>
2025-12-05 06:04:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_15.jpg HTTP/1.1" 201 0
2025-12-05 06:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3824213-4000660-1001.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3824213-4000660-1001.jpg saved to cache
2025-12-05 06:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item f877e35c-ec00-5047-a2f9-57204ecd5f7f
2025-12-05 06:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003824213-01978293-001.pdf)
2025-12-05 06:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3824213-4000660-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003824213-01978293-001.pdf)
2025-12-05 06:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4b1eba83-8ce4-4764-be38-bb3706453840_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003831881-01817630-003.pdf)
2025-12-05 06:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003823600-01832134-002.pdf)
2025-12-05 06:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3826448-4003120-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003826448-01984349-004.pdf)
2025-12-05 06:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4b1eba83-8ce4-4764-be38-bb3706453840_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003831881-01817630-003.pdf)
2025-12-05 06:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003824213-01978293-001.pdf)
2025-12-05 06:04:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23427542d0>
2025-12-05 06:04:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_14.jpg HTTP/1.1" 201 0
2025-12-05 06:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3824213-4000660-1000.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3824213-4000660-1000.jpg saved to cache
2025-12-05 06:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item f877e35c-ec00-5047-a2f9-57204ecd5f7f
2025-12-05 06:04:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341ec3390>
2025-12-05 06:04:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_5.jpg HTTP/1.1" 201 0
2025-12-05 06:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1eca6e6e-984f-49fc-980d-607bb35b426d_4.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_4.jpg saved to cache
2025-12-05 06:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 45ebf3a4-61c8-577e-86db-bf89effb7a62
2025-12-05 06:04:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23427a7010>
2025-12-05 06:04:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_4.jpg HTTP/1.1" 201 0
2025-12-05 06:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1eca6e6e-984f-49fc-980d-607bb35b426d_5.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_5.jpg saved to cache
2025-12-05 06:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 45ebf3a4-61c8-577e-86db-bf89effb7a62
2025-12-05 06:04:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342828890>
2025-12-05 06:04:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 06:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83204fc1-f428-5a86-beee-2ee7a68db53f/83204fc1-f428-5a86-beee-2ee7a68db53f_image_10.jpg HTTP/1.1" 201 0
2025-12-05 06:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4b1eba83-8ce4-4764-be38-bb3706453840_ext_5.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b1eba83-8ce4-4764-be38-bb3706453840_ext_5.jpg saved to cache
2025-12-05 06:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 83204fc1-f428-5a86-beee-2ee7a68db53f
2025-12-05 06:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003823600-01832134-002.pdf)
2025-12-05 06:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003823600-01832134-002.pdf)
2025-12-05 06:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3826448-4003120-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003826448-01984349-004.pdf)
2025-12-05 06:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4b1eba83-8ce4-4764-be38-bb3706453840_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003831881-01817630-003.pdf)
2025-12-05 06:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003824213-01978293-001.pdf)
2025-12-05 06:04:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23428e37d0>
2025-12-05 06:04:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_12.jpg HTTP/1.1" 201 0
2025-12-05 06:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc56a8903-6ffb-4568-bd07-6c623cf256da_ext_4.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_ext_4.jpg saved to cache
2025-12-05 06:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item f877e35c-ec00-5047-a2f9-57204ecd5f7f
2025-12-05 06:04:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342497fd0>
2025-12-05 06:04:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_13.jpg HTTP/1.1" 201 0
2025-12-05 06:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3824213-4000660-13.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3824213-4000660-13.jpg saved to cache
2025-12-05 06:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item f877e35c-ec00-5047-a2f9-57204ecd5f7f
2025-12-05 06:04:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341ea8210>
2025-12-05 06:04:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 06:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83204fc1-f428-5a86-beee-2ee7a68db53f/83204fc1-f428-5a86-beee-2ee7a68db53f_image_8.jpg HTTP/1.1" 201 0
2025-12-05 06:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4b1eba83-8ce4-4764-be38-bb3706453840_9.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b1eba83-8ce4-4764-be38-bb3706453840_9.jpg saved to cache
2025-12-05 06:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 83204fc1-f428-5a86-beee-2ee7a68db53f
2025-12-05 06:04:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23428e0450>
2025-12-05 06:04:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_3.jpg HTTP/1.1" 201 0
2025-12-05 06:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1eca6e6e-984f-49fc-980d-607bb35b426d_ext_1.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_ext_1.jpg saved to cache
2025-12-05 06:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 45ebf3a4-61c8-577e-86db-bf89effb7a62
2025-12-05 06:04:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234157fad0>
2025-12-05 06:04:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e58c8e76-2ff4-56cf-8cad-2de624eaaf51/e58c8e76-2ff4-56cf-8cad-2de624eaaf51_image_19.jpg HTTP/1.1" 201 0
2025-12-05 06:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3826448-4003120-1005.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3826448-4003120-1005.jpg saved to cache
2025-12-05 06:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item e58c8e76-2ff4-56cf-8cad-2de624eaaf51
2025-12-05 06:04:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234237ecd0>
2025-12-05 06:04:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:04:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:04:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83204fc1-f428-5a86-beee-2ee7a68db53f/83204fc1-f428-5a86-beee-2ee7a68db53f_image_9.jpg HTTP/1.1" 201 0
2025-12-05 06:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4b1eba83-8ce4-4764-be38-bb3706453840_ext_2.jpg') HTTP/1.1" 204 0
2025-12-05 06:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b1eba83-8ce4-4764-be38-bb3706453840_ext_2.jpg saved to cache
2025-12-05 06:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 83204fc1-f428-5a86-beee-2ee7a68db53f
2025-12-05 06:04:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:04:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:04:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:04:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234274ff50>
2025-12-05 06:04:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_11.jpg HTTP/1.1" 201 0
2025-12-05 06:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc56a8903-6ffb-4568-bd07-6c623cf256da_ext_3.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_ext_3.jpg saved to cache
2025-12-05 06:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item f877e35c-ec00-5047-a2f9-57204ecd5f7f
2025-12-05 06:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003824213-01978293-001.pdf)
2025-12-05 06:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3826448-4003120-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003826448-01984349-004.pdf)
2025-12-05 06:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003823600-01832134-002.pdf)
2025-12-05 06:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4b1eba83-8ce4-4764-be38-bb3706453840_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003831881-01817630-003.pdf)
2025-12-05 06:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4b1eba83-8ce4-4764-be38-bb3706453840_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003831881-01817630-003.pdf)
2025-12-05 06:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003824213-01978293-001.pdf)
2025-12-05 06:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3826448-4003120-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003826448-01984349-004.pdf)
2025-12-05 06:05:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425a3790>
2025-12-05 06:05:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_2.jpg HTTP/1.1" 201 0
2025-12-05 06:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1eca6e6e-984f-49fc-980d-607bb35b426d_ext_6.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_ext_6.jpg saved to cache
2025-12-05 06:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 45ebf3a4-61c8-577e-86db-bf89effb7a62
2025-12-05 06:05:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23415d83d0>
2025-12-05 06:05:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_1.jpg HTTP/1.1" 201 0
2025-12-05 06:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1eca6e6e-984f-49fc-980d-607bb35b426d_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_ext_7.jpg saved to cache
2025-12-05 06:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 45ebf3a4-61c8-577e-86db-bf89effb7a62
2025-12-05 06:05:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23415ea6d0>
2025-12-05 06:05:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e58c8e76-2ff4-56cf-8cad-2de624eaaf51/e58c8e76-2ff4-56cf-8cad-2de624eaaf51_image_18.jpg HTTP/1.1" 201 0
2025-12-05 06:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3826448-4003120-1004.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3826448-4003120-1004.jpg saved to cache
2025-12-05 06:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item e58c8e76-2ff4-56cf-8cad-2de624eaaf51
2025-12-05 06:05:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23427bb090>
2025-12-05 06:05:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83204fc1-f428-5a86-beee-2ee7a68db53f/83204fc1-f428-5a86-beee-2ee7a68db53f_image_7.jpg HTTP/1.1" 201 0
2025-12-05 06:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4b1eba83-8ce4-4764-be38-bb3706453840_10.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b1eba83-8ce4-4764-be38-bb3706453840_10.jpg saved to cache
2025-12-05 06:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 83204fc1-f428-5a86-beee-2ee7a68db53f
2025-12-05 06:05:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23424a3250>
2025-12-05 06:05:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_10.jpg HTTP/1.1" 201 0
2025-12-05 06:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc56a8903-6ffb-4568-bd07-6c623cf256da_ext_5.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_ext_5.jpg saved to cache
2025-12-05 06:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item f877e35c-ec00-5047-a2f9-57204ecd5f7f
2025-12-05 06:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4b1eba83-8ce4-4764-be38-bb3706453840_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003831881-01817630-003.pdf)
2025-12-05 06:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003824213-01978293-001.pdf)
2025-12-05 06:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003824213-01978293-001.pdf)
2025-12-05 06:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3826448-4003120-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003826448-01984349-004.pdf)
2025-12-05 06:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3826448-4003120-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003826448-01984349-004.pdf)
2025-12-05 06:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4b1eba83-8ce4-4764-be38-bb3706453840_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003831881-01817630-003.pdf)
2025-12-05 06:05:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234243d810>
2025-12-05 06:05:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_9.jpg HTTP/1.1" 201 0
2025-12-05 06:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc56a8903-6ffb-4568-bd07-6c623cf256da_ext_2.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_ext_2.jpg saved to cache
2025-12-05 06:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f877e35c-ec00-5047-a2f9-57204ecd5f7f
2025-12-05 06:05:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234157da10>
2025-12-05 06:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e58c8e76-2ff4-56cf-8cad-2de624eaaf51/e58c8e76-2ff4-56cf-8cad-2de624eaaf51_image_17.jpg HTTP/1.1" 201 0
2025-12-05 06:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3826448-4003120-1003.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3826448-4003120-1003.jpg saved to cache
2025-12-05 06:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item e58c8e76-2ff4-56cf-8cad-2de624eaaf51
2025-12-05 06:05:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234274d950>
2025-12-05 06:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_0.jpg HTTP/1.1" 201 0
2025-12-05 06:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1eca6e6e-984f-49fc-980d-607bb35b426d_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_ext_7.jpg saved to cache
2025-12-05 06:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 45ebf3a4-61c8-577e-86db-bf89effb7a62
2025-12-05 06:05:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 45ebf3a4-61c8-577e-86db-bf89effb7a62, skipping ID generation
2025-12-05 06:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 45ebf3a4-61c8-577e-86db-bf89effb7a62 from tracking dictionaries
2025-12-05 06:05:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 45ebf3a4-61c8-577e-86db-bf89effb7a62 sending to next pipeline
2025-12-05 06:05:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 45ebf3a4-61c8-577e-86db-bf89effb7a62, identifier: 3823600
2025-12-05 06:05:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23428fea10>
2025-12-05 06:05:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83204fc1-f428-5a86-beee-2ee7a68db53f/83204fc1-f428-5a86-beee-2ee7a68db53f_image_6.jpg HTTP/1.1" 201 0
2025-12-05 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4b1eba83-8ce4-4764-be38-bb3706453840_11.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b1eba83-8ce4-4764-be38-bb3706453840_11.jpg saved to cache
2025-12-05 06:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 83204fc1-f428-5a86-beee-2ee7a68db53f
2025-12-05 06:05:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234259a790>
2025-12-05 06:05:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83204fc1-f428-5a86-beee-2ee7a68db53f/83204fc1-f428-5a86-beee-2ee7a68db53f_image_5.jpg HTTP/1.1" 201 0
2025-12-05 06:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4b1eba83-8ce4-4764-be38-bb3706453840_4.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b1eba83-8ce4-4764-be38-bb3706453840_4.jpg saved to cache
2025-12-05 06:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 83204fc1-f428-5a86-beee-2ee7a68db53f
2025-12-05 06:05:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23424a3690>
2025-12-05 06:05:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_8.jpg HTTP/1.1" 201 0
2025-12-05 06:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc56a8903-6ffb-4568-bd07-6c623cf256da_9.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_9.jpg saved to cache
2025-12-05 06:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f877e35c-ec00-5047-a2f9-57204ecd5f7f
2025-12-05 06:05:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23426c4a50>
2025-12-05 06:05:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e58c8e76-2ff4-56cf-8cad-2de624eaaf51/e58c8e76-2ff4-56cf-8cad-2de624eaaf51_image_16.jpg HTTP/1.1" 201 0
2025-12-05 06:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3826448-4003120-1002.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3826448-4003120-1002.jpg saved to cache
2025-12-05 06:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item e58c8e76-2ff4-56cf-8cad-2de624eaaf51
2025-12-05 06:05:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 45ebf3a4-61c8-577e-86db-bf89effb7a62 with identifier: 3823600
2025-12-05 06:05:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 45ebf3a4-61c8-577e-86db-bf89effb7a62 with identifier: 3823600
2025-12-05 06:05:04 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 20, 'seller_name': 'vauxhall motors limited', 'price_includes_vat': False, 'title': 'vauxhall mokka 100kw gs 50kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'vauxhall', 'model': 'mokka', 'transmission': 'automatic', 'engine': '0.0l', 'fuel_type': 'electric', 'odometer': 1653, 'odometer_reading_unit': 'mi', 'registration_date': '2023-06-30', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/vauxhall/mokka?id=3823600', 'location': 'colchester', 'origin_country_code': 'gb', 'trim': '100kw gs 50kwh 5dr auto', 'license_plate': 'wm23llr', 'year': 2023, 'listing': 'auction', 'c_o_2_emission_value': 0, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0003823600-01832134-002.pdf', 'expiration_date': '2025-12-09t09:00:00z', 'is_vat_deductible': True, 'is_vat_included': False, 'id': '45ebf3a4-61c8-577e-86db-bf89effb7a62', 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_expert_report_file_fb4824e6-5b1f-4170-b596-9061c202f82f.pdf', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_0.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_ext_7.jpg', 'Width': 1499, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 165236}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_1.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_ext_7.jpg', 'Width': 1499, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 165236}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_2.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_ext_6.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 305326}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_3.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_ext_1.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 185635}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_4.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_5.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 165618}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_5.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_4.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 162222}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_6.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_11.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 166023}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_7.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_10.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 165422}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_8.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_9.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 169501}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_9.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_ext_2.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 336110}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_10.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_ext_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 260421}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_11.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_ext_3.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 262875}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_12.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_ext_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 308135}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_13.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3823600-3828660-13.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 408970}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_14.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3823600-3828660-1000.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 247901}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_15.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3823600-3828660-1001.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 298065}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_16.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3823600-3828660-1002.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 384383}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_17.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3823600-3828660-1003.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 213777}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_18.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3823600-3828660-1004.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 347626}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_19.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3823600-3828660-1005.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 268804}], 'current_year_diff': 2, 'age_in_months': 29, 'make_model': 'vauxhall mokka', 'sanitized_make': 'vauxhall', 'odometer_in_km': 2660} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 29,
     'auction_title': '',
     'c_o_2_emission_value': 0,
     'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_expert_report_file_fb4824e6-5b1f-4170-b596-9061c202f82f.pdf',
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0003823600-01832134-002.pdf',
     'color': 'red',
     'currency': 'gbp',
     'current_year_diff': 2,
     'engine': '0.0l',
     'expiration_date': '2025-12-09t09:00:00z',
     'fuel_type': 'electric',
     'id': '45ebf3a4-61c8-577e-86db-bf89effb7a62',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'wm23llr',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/vauxhall/mokka?id=3823600',
     'listing': 'auction',
     'location': 'colchester',
     'make': 'vauxhall',
     'make_model': 'vauxhall mokka',
     'model': 'mokka',
     'odometer': 1653,
     'odometer_in_km': 2660,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 20,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 165236,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_ext_7.jpg',
                 'Width': 1499},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 165236,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_ext_7.jpg',
                 'Width': 1499},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 305326,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_ext_6.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 185635,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_ext_1.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 165618,
                 'Height': 999,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_5.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 162222,
                 'Height': 999,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_4.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 166023,
                 'Height': 999,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_11.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 165422,
                 'Height': 999,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_10.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 169501,
                 'Height': 999,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_9.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 336110,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_ext_2.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 260421,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_ext_5.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 262875,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_ext_3.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 308135,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_ext_4.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 408970,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3823600-3828660-13.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 247901,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3823600-3828660-1000.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_15.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 298065,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3823600-3828660-1001.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_16.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 384383,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3823600-3828660-1002.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_17.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 213777,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3823600-3828660-1003.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_18.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 347626,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3823600-3828660-1004.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_19.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 268804,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3823600-3828660-1005.jpg',
                 'Width': 1333}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2023-06-30',
     'sanitized_make': 'vauxhall',
     'seller_name': 'vauxhall motors limited',
     'title': 'vauxhall mokka 100kw gs 50kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '100kw gs 50kwh 5dr auto',
     'year': 2023}
2025-12-05 06:05:04 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 45ebf3a4-61c8-577e-86db-bf89effb7a62 spider: manheim.gb
2025-12-05 06:05:04 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 45ebf3a4-61c8-577e-86db-bf89effb7a62 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 20, 'seller_name': 'vauxhall motors limited', 'price_includes_vat': False, 'title': 'vauxhall mokka 100kw gs 50kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'vauxhall', 'model': 'mokka', 'transmission': 'automatic', 'engine': '0.0l', 'fuel_type': 'electric', 'odometer': 1653, 'odometer_reading_unit': 'mi', 'registration_date': '2023-06-30', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/vauxhall/mokka?id=3823600', 'location': 'colchester', 'origin_country_code': 'gb', 'trim': '100kw gs 50kwh 5dr auto', 'license_plate': 'wm23llr', 'year': 2023, 'listing': 'auction', 'c_o_2_emission_value': 0, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0003823600-01832134-002.pdf', 'expiration_date': '2025-12-09t09:00:00z', 'is_vat_deductible': True, 'is_vat_included': False, 'id': '45ebf3a4-61c8-577e-86db-bf89effb7a62', 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_expert_report_file_fb4824e6-5b1f-4170-b596-9061c202f82f.pdf', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_0.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_ext_7.jpg', 'Width': 1499, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 165236}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_1.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_ext_7.jpg', 'Width': 1499, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 165236}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_2.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_ext_6.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 305326}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_3.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_ext_1.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 185635}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_4.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_5.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 165618}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_5.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_4.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 162222}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_6.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_11.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 166023}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_7.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_10.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 165422}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_8.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_9.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 169501}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_9.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_ext_2.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 336110}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_10.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_ext_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 260421}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_11.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_ext_3.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 262875}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_12.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_ext_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 308135}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_13.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3823600-3828660-13.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 408970}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_14.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3823600-3828660-1000.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 247901}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_15.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3823600-3828660-1001.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 298065}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_16.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3823600-3828660-1002.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 384383}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_17.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3823600-3828660-1003.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 213777}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_18.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3823600-3828660-1004.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 347626}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_19.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3823600-3828660-1005.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 268804}], 'current_year_diff': 2, 'age_in_months': 29, 'make_model': 'vauxhall mokka', 'sanitized_make': 'vauxhall', 'odometer_in_km': 2660} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 29,
     'auction_title': '',
     'c_o_2_emission_value': 0,
     'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_expert_report_file_fb4824e6-5b1f-4170-b596-9061c202f82f.pdf',
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0003823600-01832134-002.pdf',
     'color': 'red',
     'currency': 'gbp',
     'current_year_diff': 2,
     'engine': '0.0l',
     'expiration_date': '2025-12-09t09:00:00z',
     'fuel_type': 'electric',
     'id': '45ebf3a4-61c8-577e-86db-bf89effb7a62',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'wm23llr',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/vauxhall/mokka?id=3823600',
     'listing': 'auction',
     'location': 'colchester',
     'make': 'vauxhall',
     'make_model': 'vauxhall mokka',
     'model': 'mokka',
     'odometer': 1653,
     'odometer_in_km': 2660,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 20,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 165236,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_ext_7.jpg',
                 'Width': 1499},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 165236,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_ext_7.jpg',
                 'Width': 1499},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 305326,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_ext_6.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 185635,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_ext_1.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 165618,
                 'Height': 999,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_5.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 162222,
                 'Height': 999,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_4.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 166023,
                 'Height': 999,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_11.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 165422,
                 'Height': 999,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_10.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 169501,
                 'Height': 999,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_9.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 336110,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_ext_2.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 260421,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_ext_5.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 262875,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_ext_3.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 308135,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_ext_4.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 408970,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3823600-3828660-13.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 247901,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3823600-3828660-1000.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_15.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 298065,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3823600-3828660-1001.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_16.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 384383,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3823600-3828660-1002.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_17.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 213777,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3823600-3828660-1003.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_18.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 347626,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3823600-3828660-1004.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_19.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 268804,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3823600-3828660-1005.jpg',
                 'Width': 1333}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2023-06-30',
     'sanitized_make': 'vauxhall',
     'seller_name': 'vauxhall motors limited',
     'title': 'vauxhall mokka 100kw gs 50kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '100kw gs 50kwh 5dr auto',
     'year': 2023}
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_expert_report_file_fb4824e6-5b1f-4170-b596-9061c202f82f.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003823600-01832134-002.pdf',
 'color': 'RED',
 'currency': 'GBP',
 'engine': '0.0L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Electric',
 'id': '45ebf3a4-61c8-577e-86db-bf89effb7a62',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'WM23LLR',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VAUXHALL/MOKKA?id=3823600',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'VAUXHALL',
 'model': 'MOKKA',
 'odometer': 1653,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 165236,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 165236,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 305326,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 185635,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 165618,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_5.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 162222,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_4.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 166023,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_11.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 165422,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_10.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 169501,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_9.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 336110,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 260421,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 262875,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 308135,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1eca6e6e-984f-49fc-980d-607bb35b426d_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 408970,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3823600-3828660-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 247901,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3823600-3828660-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 298065,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3823600-3828660-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 384383,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3823600-3828660-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 213777,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3823600-3828660-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347626,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3823600-3828660-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45ebf3a4-61c8-577e-86db-bf89effb7a62/45ebf3a4-61c8-577e-86db-bf89effb7a62_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 268804,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3823600-3828660-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-30',
 'seller_name': 'Vauxhall Motors Limited',
 'title': 'VAUXHALL MOKKA 100kW GS 50kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '100kW GS 50kWh 5dr Auto',
 'year': 2023}
2025-12-05 06:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273823600%27 HTTP/1.1" 200 None
2025-12-05 06:05:04 [manheim.gb] INFO: Saving data for 3823600: {'created_time': 1764914704.86048, 'last_price_update_time': 1764914704.860495, 'auction_closing_time': 1765270800.0}
2025-12-05 06:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3823600') HTTP/1.1" 204 0
2025-12-05 06:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003824213-01978293-001.pdf)
2025-12-05 06:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4b1eba83-8ce4-4764-be38-bb3706453840_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003831881-01817630-003.pdf)
2025-12-05 06:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003824213-01978293-001.pdf)
2025-12-05 06:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4b1eba83-8ce4-4764-be38-bb3706453840_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003831881-01817630-003.pdf)
2025-12-05 06:05:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342377e90>
2025-12-05 06:05:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83204fc1-f428-5a86-beee-2ee7a68db53f/83204fc1-f428-5a86-beee-2ee7a68db53f_image_4.jpg HTTP/1.1" 201 0
2025-12-05 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4b1eba83-8ce4-4764-be38-bb3706453840_5.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b1eba83-8ce4-4764-be38-bb3706453840_5.jpg saved to cache
2025-12-05 06:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 83204fc1-f428-5a86-beee-2ee7a68db53f
2025-12-05 06:05:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234264c550>
2025-12-05 06:05:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_7.jpg HTTP/1.1" 201 0
2025-12-05 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc56a8903-6ffb-4568-bd07-6c623cf256da_10.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_10.jpg saved to cache
2025-12-05 06:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f877e35c-ec00-5047-a2f9-57204ecd5f7f
2025-12-05 06:05:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23426eb690>
2025-12-05 06:05:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_6.jpg HTTP/1.1" 201 0
2025-12-05 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc56a8903-6ffb-4568-bd07-6c623cf256da_11.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_11.jpg saved to cache
2025-12-05 06:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f877e35c-ec00-5047-a2f9-57204ecd5f7f
2025-12-05 06:05:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23424ddf90>
2025-12-05 06:05:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 06:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e58c8e76-2ff4-56cf-8cad-2de624eaaf51/e58c8e76-2ff4-56cf-8cad-2de624eaaf51_image_14.jpg HTTP/1.1" 201 0
2025-12-05 06:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3826448-4003120-1000.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3826448-4003120-1000.jpg saved to cache
2025-12-05 06:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item e58c8e76-2ff4-56cf-8cad-2de624eaaf51
2025-12-05 06:05:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342375690>
2025-12-05 06:05:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:05:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e58c8e76-2ff4-56cf-8cad-2de624eaaf51/e58c8e76-2ff4-56cf-8cad-2de624eaaf51_image_15.jpg HTTP/1.1" 201 0
2025-12-05 06:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3826448-4003120-1001.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3826448-4003120-1001.jpg saved to cache
2025-12-05 06:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item e58c8e76-2ff4-56cf-8cad-2de624eaaf51
2025-12-05 06:05:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23415ea3d0>
2025-12-05 06:05:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:05:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83204fc1-f428-5a86-beee-2ee7a68db53f/83204fc1-f428-5a86-beee-2ee7a68db53f_image_3.jpg HTTP/1.1" 201 0
2025-12-05 06:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4b1eba83-8ce4-4764-be38-bb3706453840_ext_1.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b1eba83-8ce4-4764-be38-bb3706453840_ext_1.jpg saved to cache
2025-12-05 06:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 83204fc1-f428-5a86-beee-2ee7a68db53f
2025-12-05 06:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3826448-4003120-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003826448-01984349-004.pdf)
2025-12-05 06:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/fb737c6f-c492-4fae-8d44-7d2b06025fc2_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003826448-01984349-004.pdf)
2025-12-05 06:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003824213-01978293-001.pdf)
2025-12-05 06:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/fb737c6f-c492-4fae-8d44-7d2b06025fc2_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003826448-01984349-004.pdf)
2025-12-05 06:05:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23423aafd0>
2025-12-05 06:05:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:05:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_5.jpg HTTP/1.1" 201 0
2025-12-05 06:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc56a8903-6ffb-4568-bd07-6c623cf256da_4.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_4.jpg saved to cache
2025-12-05 06:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f877e35c-ec00-5047-a2f9-57204ecd5f7f
2025-12-05 06:05:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342556190>
2025-12-05 06:05:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83204fc1-f428-5a86-beee-2ee7a68db53f/83204fc1-f428-5a86-beee-2ee7a68db53f_image_2.jpg HTTP/1.1" 201 0
2025-12-05 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4b1eba83-8ce4-4764-be38-bb3706453840_ext_6.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b1eba83-8ce4-4764-be38-bb3706453840_ext_6.jpg saved to cache
2025-12-05 06:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 83204fc1-f428-5a86-beee-2ee7a68db53f
2025-12-05 06:05:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234244c910>
2025-12-05 06:05:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 06:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_3.jpg HTTP/1.1" 201 0
2025-12-05 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc56a8903-6ffb-4568-bd07-6c623cf256da_ext_1.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_ext_1.jpg saved to cache
2025-12-05 06:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f877e35c-ec00-5047-a2f9-57204ecd5f7f
2025-12-05 06:05:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234259a750>
2025-12-05 06:05:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83204fc1-f428-5a86-beee-2ee7a68db53f/83204fc1-f428-5a86-beee-2ee7a68db53f_image_1.jpg HTTP/1.1" 201 0
2025-12-05 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4b1eba83-8ce4-4764-be38-bb3706453840_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b1eba83-8ce4-4764-be38-bb3706453840_ext_7.jpg saved to cache
2025-12-05 06:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 83204fc1-f428-5a86-beee-2ee7a68db53f
2025-12-05 06:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/PEUGEOT/2008?id=3809067&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233809067&indx=311> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4b1eba83-8ce4-4764-be38-bb3706453840_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003831881-01817630-003.pdf)
2025-12-05 06:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003824213-01978293-001.pdf)
2025-12-05 06:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003824213-01978293-001.pdf)
2025-12-05 06:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/fb737c6f-c492-4fae-8d44-7d2b06025fc2_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003826448-01984349-004.pdf)
2025-12-05 06:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003824213-01978293-001.pdf)
2025-12-05 06:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/fb737c6f-c492-4fae-8d44-7d2b06025fc2_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003826448-01984349-004.pdf)
2025-12-05 06:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/fb737c6f-c492-4fae-8d44-7d2b06025fc2_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003826448-01984349-004.pdf)
2025-12-05 06:05:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:05:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:05:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:05:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23429347d0>
2025-12-05 06:05:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e58c8e76-2ff4-56cf-8cad-2de624eaaf51/e58c8e76-2ff4-56cf-8cad-2de624eaaf51_image_13.jpg HTTP/1.1" 201 0
2025-12-05 06:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3826448-4003120-13.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3826448-4003120-13.jpg saved to cache
2025-12-05 06:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item e58c8e76-2ff4-56cf-8cad-2de624eaaf51
2025-12-05 06:05:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23415c5490>
2025-12-05 06:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 06:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e58c8e76-2ff4-56cf-8cad-2de624eaaf51/e58c8e76-2ff4-56cf-8cad-2de624eaaf51_image_12.jpg HTTP/1.1" 201 0
2025-12-05 06:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ffb737c6f-c492-4fae-8d44-7d2b06025fc2_ext_4.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fb737c6f-c492-4fae-8d44-7d2b06025fc2_ext_4.jpg saved to cache
2025-12-05 06:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item e58c8e76-2ff4-56cf-8cad-2de624eaaf51
2025-12-05 06:05:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342755750>
2025-12-05 06:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 06:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_4.jpg HTTP/1.1" 201 0
2025-12-05 06:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc56a8903-6ffb-4568-bd07-6c623cf256da_5.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_5.jpg saved to cache
2025-12-05 06:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f877e35c-ec00-5047-a2f9-57204ecd5f7f
2025-12-05 06:05:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23415a2f90>
2025-12-05 06:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e58c8e76-2ff4-56cf-8cad-2de624eaaf51/e58c8e76-2ff4-56cf-8cad-2de624eaaf51_image_11.jpg HTTP/1.1" 201 0
2025-12-05 06:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ffb737c6f-c492-4fae-8d44-7d2b06025fc2_ext_3.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fb737c6f-c492-4fae-8d44-7d2b06025fc2_ext_3.jpg saved to cache
2025-12-05 06:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item e58c8e76-2ff4-56cf-8cad-2de624eaaf51
2025-12-05 06:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/fb737c6f-c492-4fae-8d44-7d2b06025fc2_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003826448-01984349-004.pdf)
2025-12-05 06:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/fb737c6f-c492-4fae-8d44-7d2b06025fc2_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003826448-01984349-004.pdf)
2025-12-05 06:05:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 033c781b-dda1-5929-8ccb-625fce7cc686 with identifier: 3809067
2025-12-05 06:05:08 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 033c781b-dda1-5929-8ccb-625fce7cc686
2025-12-05 06:05:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234274d6d0>
2025-12-05 06:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83204fc1-f428-5a86-beee-2ee7a68db53f/83204fc1-f428-5a86-beee-2ee7a68db53f_image_0.jpg HTTP/1.1" 201 0
2025-12-05 06:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4b1eba83-8ce4-4764-be38-bb3706453840_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4b1eba83-8ce4-4764-be38-bb3706453840_ext_7.jpg saved to cache
2025-12-05 06:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 83204fc1-f428-5a86-beee-2ee7a68db53f
2025-12-05 06:05:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 83204fc1-f428-5a86-beee-2ee7a68db53f, skipping ID generation
2025-12-05 06:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 83204fc1-f428-5a86-beee-2ee7a68db53f from tracking dictionaries
2025-12-05 06:05:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 83204fc1-f428-5a86-beee-2ee7a68db53f sending to next pipeline
2025-12-05 06:05:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 83204fc1-f428-5a86-beee-2ee7a68db53f, identifier: 3831881
2025-12-05 06:05:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234155f690>
2025-12-05 06:05:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_2.jpg HTTP/1.1" 201 0
2025-12-05 06:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc56a8903-6ffb-4568-bd07-6c623cf256da_ext_6.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_ext_6.jpg saved to cache
2025-12-05 06:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f877e35c-ec00-5047-a2f9-57204ecd5f7f
2025-12-05 06:05:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23415a65d0>
2025-12-05 06:05:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_1.jpg HTTP/1.1" 201 0
2025-12-05 06:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc56a8903-6ffb-4568-bd07-6c623cf256da_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_ext_7.jpg saved to cache
2025-12-05 06:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f877e35c-ec00-5047-a2f9-57204ecd5f7f
2025-12-05 06:05:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234245fed0>
2025-12-05 06:05:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e58c8e76-2ff4-56cf-8cad-2de624eaaf51/e58c8e76-2ff4-56cf-8cad-2de624eaaf51_image_10.jpg HTTP/1.1" 201 0
2025-12-05 06:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ffb737c6f-c492-4fae-8d44-7d2b06025fc2_ext_5.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fb737c6f-c492-4fae-8d44-7d2b06025fc2_ext_5.jpg saved to cache
2025-12-05 06:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item e58c8e76-2ff4-56cf-8cad-2de624eaaf51
2025-12-05 06:05:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23423d1c90>
2025-12-05 06:05:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_0.jpg HTTP/1.1" 201 0
2025-12-05 06:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc56a8903-6ffb-4568-bd07-6c623cf256da_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_ext_7.jpg saved to cache
2025-12-05 06:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f877e35c-ec00-5047-a2f9-57204ecd5f7f
2025-12-05 06:05:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f877e35c-ec00-5047-a2f9-57204ecd5f7f, skipping ID generation
2025-12-05 06:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Removing item f877e35c-ec00-5047-a2f9-57204ecd5f7f from tracking dictionaries
2025-12-05 06:05:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f877e35c-ec00-5047-a2f9-57204ecd5f7f sending to next pipeline
2025-12-05 06:05:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: f877e35c-ec00-5047-a2f9-57204ecd5f7f, identifier: 3824213
2025-12-05 06:05:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342554290>
2025-12-05 06:05:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e58c8e76-2ff4-56cf-8cad-2de624eaaf51/e58c8e76-2ff4-56cf-8cad-2de624eaaf51_image_9.jpg HTTP/1.1" 201 0
2025-12-05 06:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ffb737c6f-c492-4fae-8d44-7d2b06025fc2_ext_2.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fb737c6f-c492-4fae-8d44-7d2b06025fc2_ext_2.jpg saved to cache
2025-12-05 06:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e58c8e76-2ff4-56cf-8cad-2de624eaaf51
2025-12-05 06:05:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341f11a50>
2025-12-05 06:05:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e58c8e76-2ff4-56cf-8cad-2de624eaaf51/e58c8e76-2ff4-56cf-8cad-2de624eaaf51_image_8.jpg HTTP/1.1" 201 0
2025-12-05 06:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ffb737c6f-c492-4fae-8d44-7d2b06025fc2_9.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fb737c6f-c492-4fae-8d44-7d2b06025fc2_9.jpg saved to cache
2025-12-05 06:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e58c8e76-2ff4-56cf-8cad-2de624eaaf51
2025-12-05 06:05:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:05:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:05:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 83204fc1-f428-5a86-beee-2ee7a68db53f with identifier: 3831881
2025-12-05 06:05:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 83204fc1-f428-5a86-beee-2ee7a68db53f with identifier: 3831881
2025-12-05 06:05:11 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 83204fc1-f428-5a86-beee-2ee7a68db53f with identifier: 3831881 to the API
2025-12-05 06:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 06:05:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 06:05:11 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/4b1eba83-8ce4-4764-be38-bb3706453840_ext_7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83204fc1-f428-5a86-beee-2ee7a68db53f/83204fc1-f428-5a86-beee-2ee7a68db53f_expert_report_file_5880b861-ee51-4bd5-aec4-ced34dd7ac79.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003831881-01817630-003.pdf',
 'color': 'BLUE',
 'currency': 'GBP',
 'engine': '2.1L',
 'expiration_date': '2025-12-11T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '83204fc1-f428-5a86-beee-2ee7a68db53f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'WA16BJJ',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/E%20CLASS?id=3831881',
 'listing': 'auction',
 'location': 'Manchester',
 'make': 'MERCEDES-BENZ',
 'model': 'E CLASS',
 'odometer': 54983,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83204fc1-f428-5a86-beee-2ee7a68db53f/83204fc1-f428-5a86-beee-2ee7a68db53f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 171914,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4b1eba83-8ce4-4764-be38-bb3706453840_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83204fc1-f428-5a86-beee-2ee7a68db53f/83204fc1-f428-5a86-beee-2ee7a68db53f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 171914,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4b1eba83-8ce4-4764-be38-bb3706453840_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83204fc1-f428-5a86-beee-2ee7a68db53f/83204fc1-f428-5a86-beee-2ee7a68db53f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 206755,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4b1eba83-8ce4-4764-be38-bb3706453840_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83204fc1-f428-5a86-beee-2ee7a68db53f/83204fc1-f428-5a86-beee-2ee7a68db53f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 197466,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4b1eba83-8ce4-4764-be38-bb3706453840_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83204fc1-f428-5a86-beee-2ee7a68db53f/83204fc1-f428-5a86-beee-2ee7a68db53f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 172838,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4b1eba83-8ce4-4764-be38-bb3706453840_5.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83204fc1-f428-5a86-beee-2ee7a68db53f/83204fc1-f428-5a86-beee-2ee7a68db53f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 172961,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4b1eba83-8ce4-4764-be38-bb3706453840_4.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83204fc1-f428-5a86-beee-2ee7a68db53f/83204fc1-f428-5a86-beee-2ee7a68db53f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 175556,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4b1eba83-8ce4-4764-be38-bb3706453840_11.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83204fc1-f428-5a86-beee-2ee7a68db53f/83204fc1-f428-5a86-beee-2ee7a68db53f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 168409,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4b1eba83-8ce4-4764-be38-bb3706453840_10.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83204fc1-f428-5a86-beee-2ee7a68db53f/83204fc1-f428-5a86-beee-2ee7a68db53f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 161588,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4b1eba83-8ce4-4764-be38-bb3706453840_9.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83204fc1-f428-5a86-beee-2ee7a68db53f/83204fc1-f428-5a86-beee-2ee7a68db53f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 224273,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4b1eba83-8ce4-4764-be38-bb3706453840_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83204fc1-f428-5a86-beee-2ee7a68db53f/83204fc1-f428-5a86-beee-2ee7a68db53f_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 180181,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4b1eba83-8ce4-4764-be38-bb3706453840_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83204fc1-f428-5a86-beee-2ee7a68db53f/83204fc1-f428-5a86-beee-2ee7a68db53f_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 189115,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4b1eba83-8ce4-4764-be38-bb3706453840_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83204fc1-f428-5a86-beee-2ee7a68db53f/83204fc1-f428-5a86-beee-2ee7a68db53f_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 139256,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4b1eba83-8ce4-4764-be38-bb3706453840_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83204fc1-f428-5a86-beee-2ee7a68db53f/83204fc1-f428-5a86-beee-2ee7a68db53f_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 364438,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3831881-3793437-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83204fc1-f428-5a86-beee-2ee7a68db53f/83204fc1-f428-5a86-beee-2ee7a68db53f_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 323442,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3831881-3793437-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83204fc1-f428-5a86-beee-2ee7a68db53f/83204fc1-f428-5a86-beee-2ee7a68db53f_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 324804,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3831881-3793437-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83204fc1-f428-5a86-beee-2ee7a68db53f/83204fc1-f428-5a86-beee-2ee7a68db53f_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257146,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3831881-3793437-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83204fc1-f428-5a86-beee-2ee7a68db53f/83204fc1-f428-5a86-beee-2ee7a68db53f_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 258416,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3831881-3793437-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83204fc1-f428-5a86-beee-2ee7a68db53f/83204fc1-f428-5a86-beee-2ee7a68db53f_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 313514,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3831881-3793437-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83204fc1-f428-5a86-beee-2ee7a68db53f/83204fc1-f428-5a86-beee-2ee7a68db53f_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 373923,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3831881-3793437-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-30',
 'seller_name': 'MotoNovo Finance',
 'title': 'MERCEDES-BENZ E CLASS E220 BlueTEC AMG Night Edition 4dr 7G-Tronic',
 'transmission': 'automatic',
 'trim': 'E220 BlueTEC AMG Night Edition 4dr 7G-Tronic',
 'year': 2016}
2025-12-05 06:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273831881%27 HTTP/1.1" 200 None
2025-12-05 06:05:11 [manheim.gb] INFO: Saving data for 3831881: {'created_time': 1764914711.626635, 'last_price_update_time': 1764914711.626647, 'auction_closing_time': 1765443600.0}
2025-12-05 06:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3831881') HTTP/1.1" 204 0
2025-12-05 06:05:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: f877e35c-ec00-5047-a2f9-57204ecd5f7f with identifier: 3824213
2025-12-05 06:05:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: f877e35c-ec00-5047-a2f9-57204ecd5f7f with identifier: 3824213
2025-12-05 06:05:11 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 30, 'seller_name': 'lloyd motor group', 'price_includes_vat': False, 'title': 'bmw x3 xdrive 30e m sport 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'bmw', 'model': 'x3', 'transmission': 'automatic', 'engine': '2.0l', 'fuel_type': 'petrol/hybrid', 'odometer': 128822, 'odometer_reading_unit': 'mi', 'registration_date': '2020-06-30', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/bmw/x3?id=3824213', 'location': 'leeds', 'origin_country_code': 'gb', 'trim': 'xdrive 30e m sport 5dr auto', 'license_plate': 'fl20vuj', 'year': 2020, 'listing': 'directbuy', 'c_o_2_emission_value': 53, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0003824213-01978293-001.pdf', 'expiration_date': '2025-12-10t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': 'f877e35c-ec00-5047-a2f9-57204ecd5f7f', 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_expert_report_file_a9e63c42-e51c-458d-8d19-d8371f9f0020.pdf', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_0.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_ext_7.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 221678}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_1.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_ext_7.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 221678}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_2.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_ext_6.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 243251}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_3.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_ext_1.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 191989}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_4.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 199276}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_5.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 221354}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_6.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_11.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 209773}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_7.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_10.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 229446}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_8.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_9.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 246159}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_9.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_ext_2.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 301958}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_10.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_ext_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 218614}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_11.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_ext_3.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 230575}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_12.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_ext_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 178521}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_13.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3824213-4000660-13.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 361417}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_14.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3824213-4000660-1000.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 338694}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_15.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3824213-4000660-1001.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 329311}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_16.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3824213-4000660-1002.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 291992}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_17.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3824213-4000660-1003.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 234297}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_18.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3824213-4000660-1004.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 304835}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_19.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3824213-4000660-1005.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 257726}], 'current_year_diff': 5, 'age_in_months': 65, 'make_model': 'bmw x3', 'sanitized_make': 'bmw', 'odometer_in_km': 207318}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 65,
     'auction_title': '',
     'c_o_2_emission_value': 53,
     'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_expert_report_file_a9e63c42-e51c-458d-8d19-d8371f9f0020.pdf',
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0003824213-01978293-001.pdf',
     'color': 'blue',
     'currency': 'gbp',
     'current_year_diff': 5,
     'engine': '2.0l',
     'expiration_date': '2025-12-10t09:00:00z',
     'fuel_type': 'petrol/hybrid',
     'id': 'f877e35c-ec00-5047-a2f9-57204ecd5f7f',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'fl20vuj',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/bmw/x3?id=3824213',
     'listing': 'directbuy',
     'location': 'leeds',
     'make': 'bmw',
     'make_model': 'bmw x3',
     'model': 'x3',
     'odometer': 128822,
     'odometer_in_km': 207318,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 30,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 221678,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_ext_7.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 221678,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_ext_7.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 243251,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_ext_6.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 191989,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_ext_1.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 199276,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_5.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 221354,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_4.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 209773,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_11.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 229446,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_10.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 246159,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_9.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 301958,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_ext_2.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 218614,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_ext_5.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 230575,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_ext_3.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 178521,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_ext_4.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 361417,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3824213-4000660-13.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 338694,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3824213-4000660-1000.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_15.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 329311,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3824213-4000660-1001.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_16.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 291992,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3824213-4000660-1002.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_17.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 234297,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3824213-4000660-1003.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_18.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 304835,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3824213-4000660-1004.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_19.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 257726,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3824213-4000660-1005.jpg',
                 'Width': 1333}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2020-06-30',
     'sanitized_make': 'bmw',
     'seller_name': 'lloyd motor group',
     'title': 'bmw x3 xdrive 30e m sport 5dr auto',
     'transmission': 'automatic',
     'trim': 'xdrive 30e m sport 5dr auto',
     'year': 2020}
2025-12-05 06:05:11 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: f877e35c-ec00-5047-a2f9-57204ecd5f7f spider: manheim.gb
2025-12-05 06:05:11 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: f877e35c-ec00-5047-a2f9-57204ecd5f7f due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 30, 'seller_name': 'lloyd motor group', 'price_includes_vat': False, 'title': 'bmw x3 xdrive 30e m sport 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'bmw', 'model': 'x3', 'transmission': 'automatic', 'engine': '2.0l', 'fuel_type': 'petrol/hybrid', 'odometer': 128822, 'odometer_reading_unit': 'mi', 'registration_date': '2020-06-30', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/bmw/x3?id=3824213', 'location': 'leeds', 'origin_country_code': 'gb', 'trim': 'xdrive 30e m sport 5dr auto', 'license_plate': 'fl20vuj', 'year': 2020, 'listing': 'directbuy', 'c_o_2_emission_value': 53, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0003824213-01978293-001.pdf', 'expiration_date': '2025-12-10t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': 'f877e35c-ec00-5047-a2f9-57204ecd5f7f', 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_expert_report_file_a9e63c42-e51c-458d-8d19-d8371f9f0020.pdf', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_0.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_ext_7.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 221678}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_1.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_ext_7.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 221678}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_2.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_ext_6.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 243251}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_3.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_ext_1.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 191989}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_4.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 199276}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_5.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 221354}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_6.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_11.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 209773}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_7.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_10.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 229446}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_8.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_9.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 246159}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_9.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_ext_2.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 301958}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_10.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_ext_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 218614}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_11.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_ext_3.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 230575}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_12.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_ext_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 178521}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_13.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3824213-4000660-13.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 361417}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_14.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3824213-4000660-1000.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 338694}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_15.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3824213-4000660-1001.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 329311}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_16.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3824213-4000660-1002.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 291992}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_17.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3824213-4000660-1003.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 234297}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_18.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3824213-4000660-1004.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 304835}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_19.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3824213-4000660-1005.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 257726}], 'current_year_diff': 5, 'age_in_months': 65, 'make_model': 'bmw x3', 'sanitized_make': 'bmw', 'odometer_in_km': 207318}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 65,
     'auction_title': '',
     'c_o_2_emission_value': 53,
     'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_expert_report_file_a9e63c42-e51c-458d-8d19-d8371f9f0020.pdf',
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0003824213-01978293-001.pdf',
     'color': 'blue',
     'currency': 'gbp',
     'current_year_diff': 5,
     'engine': '2.0l',
     'expiration_date': '2025-12-10t09:00:00z',
     'fuel_type': 'petrol/hybrid',
     'id': 'f877e35c-ec00-5047-a2f9-57204ecd5f7f',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'fl20vuj',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/bmw/x3?id=3824213',
     'listing': 'directbuy',
     'location': 'leeds',
     'make': 'bmw',
     'make_model': 'bmw x3',
     'model': 'x3',
     'odometer': 128822,
     'odometer_in_km': 207318,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 30,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 221678,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_ext_7.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 221678,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_ext_7.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 243251,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_ext_6.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 191989,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_ext_1.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 199276,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_5.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 221354,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_4.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 209773,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_11.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 229446,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_10.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 246159,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_9.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 301958,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_ext_2.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 218614,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_ext_5.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 230575,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_ext_3.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 178521,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_ext_4.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 361417,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3824213-4000660-13.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 338694,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3824213-4000660-1000.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_15.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 329311,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3824213-4000660-1001.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_16.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 291992,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3824213-4000660-1002.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_17.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 234297,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3824213-4000660-1003.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_18.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 304835,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3824213-4000660-1004.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_19.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 257726,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3824213-4000660-1005.jpg',
                 'Width': 1333}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2020-06-30',
     'sanitized_make': 'bmw',
     'seller_name': 'lloyd motor group',
     'title': 'bmw x3 xdrive 30e m sport 5dr auto',
     'transmission': 'automatic',
     'trim': 'xdrive 30e m sport 5dr auto',
     'year': 2020}
{'auction_title': '',
 'c_o_2_emission_value': 53,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_expert_report_file_a9e63c42-e51c-458d-8d19-d8371f9f0020.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003824213-01978293-001.pdf',
 'color': 'BLUE',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': '2025-12-10T09:00:00Z',
 'fuel_type': 'Petrol/Hybrid',
 'id': 'f877e35c-ec00-5047-a2f9-57204ecd5f7f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'FL20VUJ',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/BMW/X3?id=3824213',
 'listing': 'directbuy',
 'location': 'Leeds',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 128822,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 30,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 221678,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 221678,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 243251,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 191989,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 199276,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 221354,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 209773,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 229446,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 246159,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 301958,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 218614,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 230575,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 178521,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c56a8903-6ffb-4568-bd07-6c623cf256da_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 361417,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3824213-4000660-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 338694,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3824213-4000660-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329311,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3824213-4000660-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 291992,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3824213-4000660-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 234297,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3824213-4000660-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 304835,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3824213-4000660-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f877e35c-ec00-5047-a2f9-57204ecd5f7f/f877e35c-ec00-5047-a2f9-57204ecd5f7f_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257726,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3824213-4000660-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-30',
 'seller_name': 'Lloyd Motor Group',
 'title': 'BMW X3 xDrive 30e M Sport 5dr Auto',
 'transmission': 'automatic',
 'trim': 'xDrive 30e M Sport 5dr Auto',
 'year': 2020}
2025-12-05 06:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273824213%27 HTTP/1.1" 200 None
2025-12-05 06:05:11 [manheim.gb] INFO: Saving data for 3824213: {'created_time': 1764914711.890557, 'last_price_update_time': 1764914711.890571, 'auction_closing_time': 1765357200.0}
2025-12-05 06:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3824213') HTTP/1.1" 204 0
2025-12-05 06:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/fb737c6f-c492-4fae-8d44-7d2b06025fc2_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003826448-01984349-004.pdf)
2025-12-05 06:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/fb737c6f-c492-4fae-8d44-7d2b06025fc2_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003826448-01984349-004.pdf)
2025-12-05 06:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/fb737c6f-c492-4fae-8d44-7d2b06025fc2_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003826448-01984349-004.pdf)
2025-12-05 06:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/fb737c6f-c492-4fae-8d44-7d2b06025fc2_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003826448-01984349-004.pdf)
2025-12-05 06:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/fb737c6f-c492-4fae-8d44-7d2b06025fc2_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003826448-01984349-004.pdf)
2025-12-05 06:05:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234269e150>
2025-12-05 06:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e58c8e76-2ff4-56cf-8cad-2de624eaaf51/e58c8e76-2ff4-56cf-8cad-2de624eaaf51_image_7.jpg HTTP/1.1" 201 0
2025-12-05 06:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ffb737c6f-c492-4fae-8d44-7d2b06025fc2_10.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fb737c6f-c492-4fae-8d44-7d2b06025fc2_10.jpg saved to cache
2025-12-05 06:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e58c8e76-2ff4-56cf-8cad-2de624eaaf51
2025-12-05 06:05:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342563a90>
2025-12-05 06:05:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e58c8e76-2ff4-56cf-8cad-2de624eaaf51/e58c8e76-2ff4-56cf-8cad-2de624eaaf51_image_6.jpg HTTP/1.1" 201 0
2025-12-05 06:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ffb737c6f-c492-4fae-8d44-7d2b06025fc2_11.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fb737c6f-c492-4fae-8d44-7d2b06025fc2_11.jpg saved to cache
2025-12-05 06:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e58c8e76-2ff4-56cf-8cad-2de624eaaf51
2025-12-05 06:05:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342510150>
2025-12-05 06:05:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e58c8e76-2ff4-56cf-8cad-2de624eaaf51/e58c8e76-2ff4-56cf-8cad-2de624eaaf51_image_3.jpg HTTP/1.1" 201 0
2025-12-05 06:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ffb737c6f-c492-4fae-8d44-7d2b06025fc2_ext_1.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fb737c6f-c492-4fae-8d44-7d2b06025fc2_ext_1.jpg saved to cache
2025-12-05 06:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e58c8e76-2ff4-56cf-8cad-2de624eaaf51
2025-12-05 06:05:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425f8050>
2025-12-05 06:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e58c8e76-2ff4-56cf-8cad-2de624eaaf51/e58c8e76-2ff4-56cf-8cad-2de624eaaf51_image_5.jpg HTTP/1.1" 201 0
2025-12-05 06:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ffb737c6f-c492-4fae-8d44-7d2b06025fc2_4.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fb737c6f-c492-4fae-8d44-7d2b06025fc2_4.jpg saved to cache
2025-12-05 06:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e58c8e76-2ff4-56cf-8cad-2de624eaaf51
2025-12-05 06:05:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342810d50>
2025-12-05 06:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e58c8e76-2ff4-56cf-8cad-2de624eaaf51/e58c8e76-2ff4-56cf-8cad-2de624eaaf51_image_4.jpg HTTP/1.1" 201 0
2025-12-05 06:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ffb737c6f-c492-4fae-8d44-7d2b06025fc2_5.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fb737c6f-c492-4fae-8d44-7d2b06025fc2_5.jpg saved to cache
2025-12-05 06:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e58c8e76-2ff4-56cf-8cad-2de624eaaf51
2025-12-05 06:05:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342929150>
2025-12-05 06:05:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e58c8e76-2ff4-56cf-8cad-2de624eaaf51/e58c8e76-2ff4-56cf-8cad-2de624eaaf51_image_2.jpg HTTP/1.1" 201 0
2025-12-05 06:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ffb737c6f-c492-4fae-8d44-7d2b06025fc2_ext_6.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fb737c6f-c492-4fae-8d44-7d2b06025fc2_ext_6.jpg saved to cache
2025-12-05 06:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e58c8e76-2ff4-56cf-8cad-2de624eaaf51
2025-12-05 06:05:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234250b550>
2025-12-05 06:05:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e58c8e76-2ff4-56cf-8cad-2de624eaaf51/e58c8e76-2ff4-56cf-8cad-2de624eaaf51_image_1.jpg HTTP/1.1" 201 0
2025-12-05 06:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ffb737c6f-c492-4fae-8d44-7d2b06025fc2_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/fb737c6f-c492-4fae-8d44-7d2b06025fc2_ext_7.jpg saved to cache
2025-12-05 06:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e58c8e76-2ff4-56cf-8cad-2de624eaaf51
2025-12-05 06:05:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e58c8e76-2ff4-56cf-8cad-2de624eaaf51, skipping ID generation
2025-12-05 06:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e58c8e76-2ff4-56cf-8cad-2de624eaaf51 from tracking dictionaries
2025-12-05 06:05:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e58c8e76-2ff4-56cf-8cad-2de624eaaf51 sending to next pipeline
2025-12-05 06:05:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: e58c8e76-2ff4-56cf-8cad-2de624eaaf51, identifier: 3826448
2025-12-05 06:05:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: e58c8e76-2ff4-56cf-8cad-2de624eaaf51 with identifier: 3826448
2025-12-05 06:05:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: e58c8e76-2ff4-56cf-8cad-2de624eaaf51 with identifier: 3826448
2025-12-05 06:05:14 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 144021 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    144021
2025-12-05 06:05:14 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: e58c8e76-2ff4-56cf-8cad-2de624eaaf51 spider: manheim.gb
2025-12-05 06:05:15 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: e58c8e76-2ff4-56cf-8cad-2de624eaaf51 due to rule: high_mileage_for_make.json, error: 144021 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    144021
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e58c8e76-2ff4-56cf-8cad-2de624eaaf51/e58c8e76-2ff4-56cf-8cad-2de624eaaf51_expert_report_file_512f24d2-e87f-4cdc-87c9-1c01f00a8065.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003826448-01984349-004.pdf',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'e58c8e76-2ff4-56cf-8cad-2de624eaaf51',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'FY19KVH',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/LAND%20ROVER/RANGE%20ROVER%20EVOQUE?id=3826448',
 'listing': 'auction',
 'location': 'Birmingham',
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER EVOQUE',
 'odometer': 89491,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 25,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e58c8e76-2ff4-56cf-8cad-2de624eaaf51/e58c8e76-2ff4-56cf-8cad-2de624eaaf51_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 203952,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/fb737c6f-c492-4fae-8d44-7d2b06025fc2_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e58c8e76-2ff4-56cf-8cad-2de624eaaf51/e58c8e76-2ff4-56cf-8cad-2de624eaaf51_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 203952,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/fb737c6f-c492-4fae-8d44-7d2b06025fc2_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e58c8e76-2ff4-56cf-8cad-2de624eaaf51/e58c8e76-2ff4-56cf-8cad-2de624eaaf51_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 198641,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/fb737c6f-c492-4fae-8d44-7d2b06025fc2_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e58c8e76-2ff4-56cf-8cad-2de624eaaf51/e58c8e76-2ff4-56cf-8cad-2de624eaaf51_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 151603,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/fb737c6f-c492-4fae-8d44-7d2b06025fc2_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e58c8e76-2ff4-56cf-8cad-2de624eaaf51/e58c8e76-2ff4-56cf-8cad-2de624eaaf51_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 204831,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/fb737c6f-c492-4fae-8d44-7d2b06025fc2_5.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e58c8e76-2ff4-56cf-8cad-2de624eaaf51/e58c8e76-2ff4-56cf-8cad-2de624eaaf51_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 205657,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/fb737c6f-c492-4fae-8d44-7d2b06025fc2_4.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e58c8e76-2ff4-56cf-8cad-2de624eaaf51/e58c8e76-2ff4-56cf-8cad-2de624eaaf51_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 199331,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/fb737c6f-c492-4fae-8d44-7d2b06025fc2_11.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e58c8e76-2ff4-56cf-8cad-2de624eaaf51/e58c8e76-2ff4-56cf-8cad-2de624eaaf51_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 211087,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/fb737c6f-c492-4fae-8d44-7d2b06025fc2_10.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e58c8e76-2ff4-56cf-8cad-2de624eaaf51/e58c8e76-2ff4-56cf-8cad-2de624eaaf51_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 221685,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/fb737c6f-c492-4fae-8d44-7d2b06025fc2_9.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e58c8e76-2ff4-56cf-8cad-2de624eaaf51/e58c8e76-2ff4-56cf-8cad-2de624eaaf51_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 247869,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/fb737c6f-c492-4fae-8d44-7d2b06025fc2_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e58c8e76-2ff4-56cf-8cad-2de624eaaf51/e58c8e76-2ff4-56cf-8cad-2de624eaaf51_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 208036,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/fb737c6f-c492-4fae-8d44-7d2b06025fc2_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e58c8e76-2ff4-56cf-8cad-2de624eaaf51/e58c8e76-2ff4-56cf-8cad-2de624eaaf51_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 219992,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/fb737c6f-c492-4fae-8d44-7d2b06025fc2_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e58c8e76-2ff4-56cf-8cad-2de624eaaf51/e58c8e76-2ff4-56cf-8cad-2de624eaaf51_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 203879,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/fb737c6f-c492-4fae-8d44-7d2b06025fc2_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e58c8e76-2ff4-56cf-8cad-2de624eaaf51/e58c8e76-2ff4-56cf-8cad-2de624eaaf51_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 284354,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3826448-4003120-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e58c8e76-2ff4-56cf-8cad-2de624eaaf51/e58c8e76-2ff4-56cf-8cad-2de624eaaf51_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 252731,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3826448-4003120-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e58c8e76-2ff4-56cf-8cad-2de624eaaf51/e58c8e76-2ff4-56cf-8cad-2de624eaaf51_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 251688,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3826448-4003120-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e58c8e76-2ff4-56cf-8cad-2de624eaaf51/e58c8e76-2ff4-56cf-8cad-2de624eaaf51_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 226542,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3826448-4003120-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e58c8e76-2ff4-56cf-8cad-2de624eaaf51/e58c8e76-2ff4-56cf-8cad-2de624eaaf51_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102401,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3826448-4003120-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e58c8e76-2ff4-56cf-8cad-2de624eaaf51/e58c8e76-2ff4-56cf-8cad-2de624eaaf51_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 191128,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3826448-4003120-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e58c8e76-2ff4-56cf-8cad-2de624eaaf51/e58c8e76-2ff4-56cf-8cad-2de624eaaf51_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 179971,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3826448-4003120-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-11',
 'seller_name': 'Van National',
 'title': 'LAND ROVER RANGE ROVER EVOQUE 2.0 D180 First Edition 5dr Auto',
 'transmission': 'automatic',
 'trim': '2.0 D180 First Edition 5dr Auto',
 'year': 2019}
2025-12-05 06:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273826448%27 HTTP/1.1" 200 None
2025-12-05 06:05:15 [manheim.gb] INFO: Saving data for 3826448: {'created_time': 1764914715.175009, 'last_price_update_time': 1764914715.175024, 'auction_closing_time': 1765184400.0}
2025-12-05 06:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3826448') HTTP/1.1" 204 0
2025-12-05 06:05:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VAUXHALL/CORSA?id=3805780&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233805780&indx=308> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:05:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VAUXHALL/CORSA?id=3805781&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233805781&indx=309> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:05:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:05:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:05:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8f3caae0-90d7-4ece-971c-baf294ce6d68_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002408993-01992203-003.pdf)
2025-12-05 06:05:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003823672-01964529-003.pdf> (referer: None)
2025-12-05 06:05:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003809067-01979539-004.pdf> (referer: None)
2025-12-05 06:05:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003813190-01943283-003.pdf> (referer: None)
2025-12-05 06:05:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003817425-01803035-007.pdf> (referer: None)
2025-12-05 06:05:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93cd6882-73c5-537b-81f0-b25d161c1962 with identifier: 3805780
2025-12-05 06:05:15 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 93cd6882-73c5-537b-81f0-b25d161c1962
2025-12-05 06:05:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af206730-ce81-5a8d-a5c0-55195b37ece3 with identifier: 3805781
2025-12-05 06:05:15 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item af206730-ce81-5a8d-a5c0-55195b37ece3
2025-12-05 06:05:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23423a98d0>
2025-12-05 06:05:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 06:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827/5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827_image_2.jpg HTTP/1.1" 201 0
2025-12-05 06:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8f3caae0-90d7-4ece-971c-baf294ce6d68_ext_6.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8f3caae0-90d7-4ece-971c-baf294ce6d68_ext_6.jpg saved to cache
2025-12-05 06:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827
2025-12-05 06:05:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234267f450>
2025-12-05 06:05:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e7b446d-32b9-5f4d-b8c9-277d3bd70f39/3e7b446d-32b9-5f4d-b8c9-277d3bd70f39_expert_report_file_8b9b79dd-7081-4df1-bb59-18b9fe921da1.pdf HTTP/1.1" 201 0
2025-12-05 06:05:16 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 3e7b446d-32b9-5f4d-b8c9-277d3bd70f39
2025-12-05 06:05:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3e7b446d-32b9-5f4d-b8c9-277d3bd70f39, skipping ID generation
2025-12-05 06:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 3e7b446d-32b9-5f4d-b8c9-277d3bd70f39
2025-12-05 06:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0ce15cdc-c8f8-4ed1-b822-fe0b12c1e27a_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0ce15cdc-c8f8-4ed1-b822-fe0b12c1e27a_ext_7.jpg already downloaded
2025-12-05 06:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0ce15cdc-c8f8-4ed1-b822-fe0b12c1e27a_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0ce15cdc-c8f8-4ed1-b822-fe0b12c1e27a_ext_7.jpg already downloaded
2025-12-05 06:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0ce15cdc-c8f8-4ed1-b822-fe0b12c1e27a_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0ce15cdc-c8f8-4ed1-b822-fe0b12c1e27a_ext_6.jpg already downloaded
2025-12-05 06:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0ce15cdc-c8f8-4ed1-b822-fe0b12c1e27a_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0ce15cdc-c8f8-4ed1-b822-fe0b12c1e27a_ext_1.jpg already downloaded
2025-12-05 06:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0ce15cdc-c8f8-4ed1-b822-fe0b12c1e27a_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0ce15cdc-c8f8-4ed1-b822-fe0b12c1e27a_5.jpg already downloaded
2025-12-05 06:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0ce15cdc-c8f8-4ed1-b822-fe0b12c1e27a_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0ce15cdc-c8f8-4ed1-b822-fe0b12c1e27a_4.jpg already downloaded
2025-12-05 06:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0ce15cdc-c8f8-4ed1-b822-fe0b12c1e27a_11.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0ce15cdc-c8f8-4ed1-b822-fe0b12c1e27a_11.jpg already downloaded
2025-12-05 06:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0ce15cdc-c8f8-4ed1-b822-fe0b12c1e27a_10.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0ce15cdc-c8f8-4ed1-b822-fe0b12c1e27a_10.jpg already downloaded
2025-12-05 06:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0ce15cdc-c8f8-4ed1-b822-fe0b12c1e27a_9.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0ce15cdc-c8f8-4ed1-b822-fe0b12c1e27a_9.jpg already downloaded
2025-12-05 06:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0ce15cdc-c8f8-4ed1-b822-fe0b12c1e27a_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0ce15cdc-c8f8-4ed1-b822-fe0b12c1e27a_ext_2.jpg already downloaded
2025-12-05 06:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0ce15cdc-c8f8-4ed1-b822-fe0b12c1e27a_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0ce15cdc-c8f8-4ed1-b822-fe0b12c1e27a_ext_5.jpg already downloaded
2025-12-05 06:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0ce15cdc-c8f8-4ed1-b822-fe0b12c1e27a_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0ce15cdc-c8f8-4ed1-b822-fe0b12c1e27a_ext_3.jpg already downloaded
2025-12-05 06:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0ce15cdc-c8f8-4ed1-b822-fe0b12c1e27a_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0ce15cdc-c8f8-4ed1-b822-fe0b12c1e27a_ext_4.jpg already downloaded
2025-12-05 06:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3823672-3991265-13.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3823672-3991265-13.jpg already downloaded
2025-12-05 06:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3823672-3991265-1000.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3823672-3991265-1000.jpg already downloaded
2025-12-05 06:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3823672-3991265-1001.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3823672-3991265-1001.jpg already downloaded
2025-12-05 06:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3823672-3991265-1002.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3823672-3991265-1002.jpg already downloaded
2025-12-05 06:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3823672-3991265-1003.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3823672-3991265-1003.jpg already downloaded
2025-12-05 06:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3823672-3991265-1004.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3823672-3991265-1004.jpg already downloaded
2025-12-05 06:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3823672-3991265-1005.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3823672-3991265-1005.jpg already downloaded
2025-12-05 06:05:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 3e7b446d-32b9-5f4d-b8c9-277d3bd70f39, identifier: 3823672
2025-12-05 06:05:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341ea0610>
2025-12-05 06:05:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_033c781b-dda1-5929-8ccb-625fce7cc686/033c781b-dda1-5929-8ccb-625fce7cc686_expert_report_file_83a38934-8830-457d-afb2-6153a1a3688c.pdf HTTP/1.1" 201 0
2025-12-05 06:05:16 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 033c781b-dda1-5929-8ccb-625fce7cc686
2025-12-05 06:05:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 033c781b-dda1-5929-8ccb-625fce7cc686, skipping ID generation
2025-12-05 06:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 17 photos for item 033c781b-dda1-5929-8ccb-625fce7cc686
2025-12-05 06:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbb6328e-9caa-4dcb-9c5b-704520ccd1c9_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbb6328e-9caa-4dcb-9c5b-704520ccd1c9_ext_7.jpg not downloaded yet
2025-12-05 06:05:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425d77d0>
2025-12-05 06:05:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22b951ae-4a77-5890-87b1-2bbcd3929ff0/22b951ae-4a77-5890-87b1-2bbcd3929ff0_expert_report_file_a4d30ba9-adb3-4b6f-ae7e-551230ccdfaf.pdf HTTP/1.1" 201 0
2025-12-05 06:05:17 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 22b951ae-4a77-5890-87b1-2bbcd3929ff0
2025-12-05 06:05:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 22b951ae-4a77-5890-87b1-2bbcd3929ff0, skipping ID generation
2025-12-05 06:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 22b951ae-4a77-5890-87b1-2bbcd3929ff0
2025-12-05 06:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4374cd77-4fee-4363-8ecc-046251b41099_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4374cd77-4fee-4363-8ecc-046251b41099_ext_7.jpg already downloaded
2025-12-05 06:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4374cd77-4fee-4363-8ecc-046251b41099_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4374cd77-4fee-4363-8ecc-046251b41099_ext_7.jpg already downloaded
2025-12-05 06:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4374cd77-4fee-4363-8ecc-046251b41099_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4374cd77-4fee-4363-8ecc-046251b41099_ext_6.jpg already downloaded
2025-12-05 06:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4374cd77-4fee-4363-8ecc-046251b41099_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4374cd77-4fee-4363-8ecc-046251b41099_ext_1.jpg already downloaded
2025-12-05 06:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4374cd77-4fee-4363-8ecc-046251b41099_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4374cd77-4fee-4363-8ecc-046251b41099_5.jpg already downloaded
2025-12-05 06:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4374cd77-4fee-4363-8ecc-046251b41099_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4374cd77-4fee-4363-8ecc-046251b41099_4.jpg already downloaded
2025-12-05 06:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4374cd77-4fee-4363-8ecc-046251b41099_11.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4374cd77-4fee-4363-8ecc-046251b41099_11.jpg already downloaded
2025-12-05 06:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4374cd77-4fee-4363-8ecc-046251b41099_10.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4374cd77-4fee-4363-8ecc-046251b41099_10.jpg already downloaded
2025-12-05 06:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4374cd77-4fee-4363-8ecc-046251b41099_9.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4374cd77-4fee-4363-8ecc-046251b41099_9.jpg already downloaded
2025-12-05 06:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4374cd77-4fee-4363-8ecc-046251b41099_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4374cd77-4fee-4363-8ecc-046251b41099_ext_2.jpg already downloaded
2025-12-05 06:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4374cd77-4fee-4363-8ecc-046251b41099_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4374cd77-4fee-4363-8ecc-046251b41099_ext_5.jpg already downloaded
2025-12-05 06:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4374cd77-4fee-4363-8ecc-046251b41099_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4374cd77-4fee-4363-8ecc-046251b41099_ext_3.jpg already downloaded
2025-12-05 06:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4374cd77-4fee-4363-8ecc-046251b41099_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4374cd77-4fee-4363-8ecc-046251b41099_ext_4.jpg already downloaded
2025-12-05 06:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3813190-3949088-13.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3813190-3949088-13.jpg already downloaded
2025-12-05 06:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3813190-3949088-1000.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3813190-3949088-1000.jpg already downloaded
2025-12-05 06:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3813190-3949088-1001.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3813190-3949088-1001.jpg already downloaded
2025-12-05 06:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3813190-3949088-1002.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3813190-3949088-1002.jpg already downloaded
2025-12-05 06:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3813190-3949088-1003.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3813190-3949088-1003.jpg already downloaded
2025-12-05 06:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3813190-3949088-1004.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3813190-3949088-1004.jpg already downloaded
2025-12-05 06:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3813190-3949088-1005.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3813190-3949088-1005.jpg already downloaded
2025-12-05 06:05:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 22b951ae-4a77-5890-87b1-2bbcd3929ff0, identifier: 3813190
2025-12-05 06:05:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23415f8f50>
2025-12-05 06:05:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3a5ec65-b2dd-5298-b0b2-31410f732030/f3a5ec65-b2dd-5298-b0b2-31410f732030_expert_report_file_87d84d6d-2a98-4c82-8b6e-644ccbfb0988.pdf HTTP/1.1" 201 0
2025-12-05 06:05:18 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item f3a5ec65-b2dd-5298-b0b2-31410f732030
2025-12-05 06:05:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f3a5ec65-b2dd-5298-b0b2-31410f732030, skipping ID generation
2025-12-05 06:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item f3a5ec65-b2dd-5298-b0b2-31410f732030
2025-12-05 06:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3817425-9999999-338140133-004.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3817425-9999999-338140133-004.jpg not downloaded yet
2025-12-05 06:05:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 3e7b446d-32b9-5f4d-b8c9-277d3bd70f39 with identifier: 3823672
2025-12-05 06:05:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 3e7b446d-32b9-5f4d-b8c9-277d3bd70f39 with identifier: 3823672
2025-12-05 06:05:18 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 3e7b446d-32b9-5f4d-b8c9-277d3bd70f39 with identifier: 3823672 to the API
2025-12-05 06:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 06:05:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 06:05:18 [scrapy.core.scraper] DEBUG: Scraped from <200 http://ecr.manheim.co.uk/pdf/MOL-0003823672-01964529-003.pdf>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e7b446d-32b9-5f4d-b8c9-277d3bd70f39/3e7b446d-32b9-5f4d-b8c9-277d3bd70f39_expert_report_file_8b9b79dd-7081-4df1-bb59-18b9fe921da1.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003823672-01964529-003.pdf',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '1.3L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Petrol/Hybrid',
 'id': '3e7b446d-32b9-5f4d-b8c9-277d3bd70f39',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'DV72VTF',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=3823672',
 'listing': 'auction',
 'location': 'Leeds',
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 35079,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 27,
 'photo_urls': ['http://images.manheim.co.uk/images/units/zoom/0ce15cdc-c8f8-4ed1-b822-fe0b12c1e27a_ext_7.jpg',
                'http://images.manheim.co.uk/images/units/zoom/0ce15cdc-c8f8-4ed1-b822-fe0b12c1e27a_ext_7.jpg',
                'http://images.manheim.co.uk/images/units/zoom/0ce15cdc-c8f8-4ed1-b822-fe0b12c1e27a_ext_6.jpg',
                'http://images.manheim.co.uk/images/units/zoom/0ce15cdc-c8f8-4ed1-b822-fe0b12c1e27a_ext_1.jpg',
                'http://images.manheim.co.uk/images/units/zoom/0ce15cdc-c8f8-4ed1-b822-fe0b12c1e27a_5.jpg',
                'http://images.manheim.co.uk/images/units/zoom/0ce15cdc-c8f8-4ed1-b822-fe0b12c1e27a_4.jpg',
                'http://images.manheim.co.uk/images/units/zoom/0ce15cdc-c8f8-4ed1-b822-fe0b12c1e27a_11.jpg',
                'http://images.manheim.co.uk/images/units/zoom/0ce15cdc-c8f8-4ed1-b822-fe0b12c1e27a_10.jpg',
                'http://images.manheim.co.uk/images/units/zoom/0ce15cdc-c8f8-4ed1-b822-fe0b12c1e27a_9.jpg',
                'http://images.manheim.co.uk/images/units/zoom/0ce15cdc-c8f8-4ed1-b822-fe0b12c1e27a_ext_2.jpg',
                'http://images.manheim.co.uk/images/units/zoom/0ce15cdc-c8f8-4ed1-b822-fe0b12c1e27a_ext_5.jpg',
                'http://images.manheim.co.uk/images/units/zoom/0ce15cdc-c8f8-4ed1-b822-fe0b12c1e27a_ext_3.jpg',
                'http://images.manheim.co.uk/images/units/zoom/0ce15cdc-c8f8-4ed1-b822-fe0b12c1e27a_ext_4.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3823672-3991265-13.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3823672-3991265-1000.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3823672-3991265-1001.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3823672-3991265-1002.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3823672-3991265-1003.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3823672-3991265-1004.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3823672-3991265-1005.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e7b446d-32b9-5f4d-b8c9-277d3bd70f39/3e7b446d-32b9-5f4d-b8c9-277d3bd70f39_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 199913,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0ce15cdc-c8f8-4ed1-b822-fe0b12c1e27a_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e7b446d-32b9-5f4d-b8c9-277d3bd70f39/3e7b446d-32b9-5f4d-b8c9-277d3bd70f39_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 199913,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0ce15cdc-c8f8-4ed1-b822-fe0b12c1e27a_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e7b446d-32b9-5f4d-b8c9-277d3bd70f39/3e7b446d-32b9-5f4d-b8c9-277d3bd70f39_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 192319,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0ce15cdc-c8f8-4ed1-b822-fe0b12c1e27a_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e7b446d-32b9-5f4d-b8c9-277d3bd70f39/3e7b446d-32b9-5f4d-b8c9-277d3bd70f39_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 149040,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0ce15cdc-c8f8-4ed1-b822-fe0b12c1e27a_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e7b446d-32b9-5f4d-b8c9-277d3bd70f39/3e7b446d-32b9-5f4d-b8c9-277d3bd70f39_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 205974,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0ce15cdc-c8f8-4ed1-b822-fe0b12c1e27a_5.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e7b446d-32b9-5f4d-b8c9-277d3bd70f39/3e7b446d-32b9-5f4d-b8c9-277d3bd70f39_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 197071,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0ce15cdc-c8f8-4ed1-b822-fe0b12c1e27a_4.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e7b446d-32b9-5f4d-b8c9-277d3bd70f39/3e7b446d-32b9-5f4d-b8c9-277d3bd70f39_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 198663,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0ce15cdc-c8f8-4ed1-b822-fe0b12c1e27a_11.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e7b446d-32b9-5f4d-b8c9-277d3bd70f39/3e7b446d-32b9-5f4d-b8c9-277d3bd70f39_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 187436,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0ce15cdc-c8f8-4ed1-b822-fe0b12c1e27a_10.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e7b446d-32b9-5f4d-b8c9-277d3bd70f39/3e7b446d-32b9-5f4d-b8c9-277d3bd70f39_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 200864,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0ce15cdc-c8f8-4ed1-b822-fe0b12c1e27a_9.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e7b446d-32b9-5f4d-b8c9-277d3bd70f39/3e7b446d-32b9-5f4d-b8c9-277d3bd70f39_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 166504,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0ce15cdc-c8f8-4ed1-b822-fe0b12c1e27a_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e7b446d-32b9-5f4d-b8c9-277d3bd70f39/3e7b446d-32b9-5f4d-b8c9-277d3bd70f39_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 165897,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0ce15cdc-c8f8-4ed1-b822-fe0b12c1e27a_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e7b446d-32b9-5f4d-b8c9-277d3bd70f39/3e7b446d-32b9-5f4d-b8c9-277d3bd70f39_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 123018,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0ce15cdc-c8f8-4ed1-b822-fe0b12c1e27a_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e7b446d-32b9-5f4d-b8c9-277d3bd70f39/3e7b446d-32b9-5f4d-b8c9-277d3bd70f39_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 175965,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0ce15cdc-c8f8-4ed1-b822-fe0b12c1e27a_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e7b446d-32b9-5f4d-b8c9-277d3bd70f39/3e7b446d-32b9-5f4d-b8c9-277d3bd70f39_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 412305,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3823672-3991265-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e7b446d-32b9-5f4d-b8c9-277d3bd70f39/3e7b446d-32b9-5f4d-b8c9-277d3bd70f39_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 365206,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3823672-3991265-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e7b446d-32b9-5f4d-b8c9-277d3bd70f39/3e7b446d-32b9-5f4d-b8c9-277d3bd70f39_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 268547,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3823672-3991265-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e7b446d-32b9-5f4d-b8c9-277d3bd70f39/3e7b446d-32b9-5f4d-b8c9-277d3bd70f39_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 205239,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3823672-3991265-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e7b446d-32b9-5f4d-b8c9-277d3bd70f39/3e7b446d-32b9-5f4d-b8c9-277d3bd70f39_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 134852,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3823672-3991265-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e7b446d-32b9-5f4d-b8c9-277d3bd70f39/3e7b446d-32b9-5f4d-b8c9-277d3bd70f39_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 293366,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3823672-3991265-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e7b446d-32b9-5f4d-b8c9-277d3bd70f39/3e7b446d-32b9-5f4d-b8c9-277d3bd70f39_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 124369,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3823672-3991265-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-30',
 'seller_name': 'Leasys',
 'title': 'NISSAN QASHQAI 1.3 DiG-T MH 158 Tekna 5dr Xtronic',
 'transmission': 'automatic',
 'trim': '1.3 DiG-T MH 158 Tekna 5dr Xtronic',
 'year': 2022}
2025-12-05 06:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273823672%27 HTTP/1.1" 200 None
2025-12-05 06:05:18 [manheim.gb] INFO: Saving data for 3823672: {'created_time': 1764914718.578448, 'last_price_update_time': 1764914718.578459, 'auction_closing_time': 1765184400.0}
2025-12-05 06:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3823672') HTTP/1.1" 204 0
2025-12-05 06:05:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 22b951ae-4a77-5890-87b1-2bbcd3929ff0 with identifier: 3813190
2025-12-05 06:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 06:05:18 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Elixir+Red HTTP/1.1" 200 None
2025-12-05 06:05:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 06:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 06:05:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 22b951ae-4a77-5890-87b1-2bbcd3929ff0 with identifier: 3813190
2025-12-05 06:05:18 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 22b951ae-4a77-5890-87b1-2bbcd3929ff0 with identifier: 3813190 to the API
2025-12-05 06:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 06:05:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 06:05:19 [scrapy.core.scraper] DEBUG: Scraped from <200 http://ecr.manheim.co.uk/pdf/MOL-0003813190-01943283-003.pdf>
{'auction_title': '',
 'c_o_2_emission_value': 25,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22b951ae-4a77-5890-87b1-2bbcd3929ff0/22b951ae-4a77-5890-87b1-2bbcd3929ff0_expert_report_file_a4d30ba9-adb3-4b6f-ae7e-551230ccdfaf.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003813190-01943283-003.pdf',
 'color': 'Elixir Red',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Petrol/Hybrid',
 'id': '22b951ae-4a77-5890-87b1-2bbcd3929ff0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'GL22MWJ',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/PEUGEOT/308?id=3813190',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'PEUGEOT',
 'model': '308',
 'odometer': 63778,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 36,
 'photo_urls': ['http://images.manheim.co.uk/images/units/zoom/4374cd77-4fee-4363-8ecc-046251b41099_ext_7.jpg',
                'http://images.manheim.co.uk/images/units/zoom/4374cd77-4fee-4363-8ecc-046251b41099_ext_7.jpg',
                'http://images.manheim.co.uk/images/units/zoom/4374cd77-4fee-4363-8ecc-046251b41099_ext_6.jpg',
                'http://images.manheim.co.uk/images/units/zoom/4374cd77-4fee-4363-8ecc-046251b41099_ext_1.jpg',
                'http://images.manheim.co.uk/images/units/zoom/4374cd77-4fee-4363-8ecc-046251b41099_5.jpg',
                'http://images.manheim.co.uk/images/units/zoom/4374cd77-4fee-4363-8ecc-046251b41099_4.jpg',
                'http://images.manheim.co.uk/images/units/zoom/4374cd77-4fee-4363-8ecc-046251b41099_11.jpg',
                'http://images.manheim.co.uk/images/units/zoom/4374cd77-4fee-4363-8ecc-046251b41099_10.jpg',
                'http://images.manheim.co.uk/images/units/zoom/4374cd77-4fee-4363-8ecc-046251b41099_9.jpg',
                'http://images.manheim.co.uk/images/units/zoom/4374cd77-4fee-4363-8ecc-046251b41099_ext_2.jpg',
                'http://images.manheim.co.uk/images/units/zoom/4374cd77-4fee-4363-8ecc-046251b41099_ext_5.jpg',
                'http://images.manheim.co.uk/images/units/zoom/4374cd77-4fee-4363-8ecc-046251b41099_ext_3.jpg',
                'http://images.manheim.co.uk/images/units/zoom/4374cd77-4fee-4363-8ecc-046251b41099_ext_4.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3813190-3949088-13.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3813190-3949088-1000.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3813190-3949088-1001.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3813190-3949088-1002.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3813190-3949088-1003.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3813190-3949088-1004.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3813190-3949088-1005.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22b951ae-4a77-5890-87b1-2bbcd3929ff0/22b951ae-4a77-5890-87b1-2bbcd3929ff0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 126822,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4374cd77-4fee-4363-8ecc-046251b41099_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22b951ae-4a77-5890-87b1-2bbcd3929ff0/22b951ae-4a77-5890-87b1-2bbcd3929ff0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 126822,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4374cd77-4fee-4363-8ecc-046251b41099_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22b951ae-4a77-5890-87b1-2bbcd3929ff0/22b951ae-4a77-5890-87b1-2bbcd3929ff0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 303671,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4374cd77-4fee-4363-8ecc-046251b41099_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22b951ae-4a77-5890-87b1-2bbcd3929ff0/22b951ae-4a77-5890-87b1-2bbcd3929ff0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 154421,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4374cd77-4fee-4363-8ecc-046251b41099_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22b951ae-4a77-5890-87b1-2bbcd3929ff0/22b951ae-4a77-5890-87b1-2bbcd3929ff0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 124661,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4374cd77-4fee-4363-8ecc-046251b41099_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22b951ae-4a77-5890-87b1-2bbcd3929ff0/22b951ae-4a77-5890-87b1-2bbcd3929ff0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 123679,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4374cd77-4fee-4363-8ecc-046251b41099_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22b951ae-4a77-5890-87b1-2bbcd3929ff0/22b951ae-4a77-5890-87b1-2bbcd3929ff0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 126374,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4374cd77-4fee-4363-8ecc-046251b41099_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22b951ae-4a77-5890-87b1-2bbcd3929ff0/22b951ae-4a77-5890-87b1-2bbcd3929ff0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 123647,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4374cd77-4fee-4363-8ecc-046251b41099_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22b951ae-4a77-5890-87b1-2bbcd3929ff0/22b951ae-4a77-5890-87b1-2bbcd3929ff0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 127448,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4374cd77-4fee-4363-8ecc-046251b41099_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22b951ae-4a77-5890-87b1-2bbcd3929ff0/22b951ae-4a77-5890-87b1-2bbcd3929ff0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 297956,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4374cd77-4fee-4363-8ecc-046251b41099_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22b951ae-4a77-5890-87b1-2bbcd3929ff0/22b951ae-4a77-5890-87b1-2bbcd3929ff0_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 284887,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4374cd77-4fee-4363-8ecc-046251b41099_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22b951ae-4a77-5890-87b1-2bbcd3929ff0/22b951ae-4a77-5890-87b1-2bbcd3929ff0_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 266592,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4374cd77-4fee-4363-8ecc-046251b41099_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22b951ae-4a77-5890-87b1-2bbcd3929ff0/22b951ae-4a77-5890-87b1-2bbcd3929ff0_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 250770,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4374cd77-4fee-4363-8ecc-046251b41099_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22b951ae-4a77-5890-87b1-2bbcd3929ff0/22b951ae-4a77-5890-87b1-2bbcd3929ff0_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 385055,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3813190-3949088-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22b951ae-4a77-5890-87b1-2bbcd3929ff0/22b951ae-4a77-5890-87b1-2bbcd3929ff0_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 271022,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3813190-3949088-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22b951ae-4a77-5890-87b1-2bbcd3929ff0/22b951ae-4a77-5890-87b1-2bbcd3929ff0_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 433190,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3813190-3949088-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22b951ae-4a77-5890-87b1-2bbcd3929ff0/22b951ae-4a77-5890-87b1-2bbcd3929ff0_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 278416,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3813190-3949088-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22b951ae-4a77-5890-87b1-2bbcd3929ff0/22b951ae-4a77-5890-87b1-2bbcd3929ff0_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 465629,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3813190-3949088-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22b951ae-4a77-5890-87b1-2bbcd3929ff0/22b951ae-4a77-5890-87b1-2bbcd3929ff0_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 378484,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3813190-3949088-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22b951ae-4a77-5890-87b1-2bbcd3929ff0/22b951ae-4a77-5890-87b1-2bbcd3929ff0_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 435843,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3813190-3949088-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-20',
 'seller_name': 'Peugeot',
 'title': 'PEUGEOT 308 1.6 Plug-in Hybrid Allure Premium 5dr e-EAT8',
 'transmission': 'automatic',
 'trim': '1.6 Plug-in Hybrid Allure Premium 5dr e-EAT8',
 'year': 2022}
2025-12-05 06:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273813190%27 HTTP/1.1" 200 None
2025-12-05 06:05:19 [manheim.gb] INFO: Saving data for 3813190: {'created_time': 1764914719.167312, 'last_price_update_time': 1764914719.167323, 'auction_closing_time': 1765184400.0}
2025-12-05 06:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3813190') HTTP/1.1" 204 0
2025-12-05 06:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbb6328e-9caa-4dcb-9c5b-704520ccd1c9_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbb6328e-9caa-4dcb-9c5b-704520ccd1c9_ext_7.jpg not downloaded yet
2025-12-05 06:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3817425-9999999-338140133-008.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3817425-9999999-338140133-008.jpg not downloaded yet
2025-12-05 06:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbb6328e-9caa-4dcb-9c5b-704520ccd1c9_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbb6328e-9caa-4dcb-9c5b-704520ccd1c9_ext_6.jpg not downloaded yet
2025-12-05 06:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3817425-9999999-338140133-001.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3817425-9999999-338140133-001.jpg not downloaded yet
2025-12-05 06:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8f3caae0-90d7-4ece-971c-baf294ce6d68_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002408993-01992203-003.pdf)
2025-12-05 06:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/8f3caae0-90d7-4ece-971c-baf294ce6d68_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002408993-01992203-003.pdf)
2025-12-05 06:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbb6328e-9caa-4dcb-9c5b-704520ccd1c9_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbb6328e-9caa-4dcb-9c5b-704520ccd1c9_ext_1.jpg not downloaded yet
2025-12-05 06:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3817425-9999999-338140133-002.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3817425-9999999-338140133-002.jpg not downloaded yet
2025-12-05 06:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbb6328e-9caa-4dcb-9c5b-704520ccd1c9_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbb6328e-9caa-4dcb-9c5b-704520ccd1c9_5.jpg not downloaded yet
2025-12-05 06:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3817425-9999999-338140133-003.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3817425-9999999-338140133-003.jpg not downloaded yet
2025-12-05 06:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbb6328e-9caa-4dcb-9c5b-704520ccd1c9_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbb6328e-9caa-4dcb-9c5b-704520ccd1c9_4.jpg not downloaded yet
2025-12-05 06:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3817425-9999999-338140133-005.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3817425-9999999-338140133-005.jpg not downloaded yet
2025-12-05 06:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbb6328e-9caa-4dcb-9c5b-704520ccd1c9_11.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbb6328e-9caa-4dcb-9c5b-704520ccd1c9_11.jpg not downloaded yet
2025-12-05 06:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3817425-9999999-338140133-006.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3817425-9999999-338140133-006.jpg not downloaded yet
2025-12-05 06:05:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425084d0>
2025-12-05 06:05:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827/5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827_image_1.jpg HTTP/1.1" 201 0
2025-12-05 06:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8f3caae0-90d7-4ece-971c-baf294ce6d68_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8f3caae0-90d7-4ece-971c-baf294ce6d68_ext_7.jpg saved to cache
2025-12-05 06:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827
2025-12-05 06:05:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342604710>
2025-12-05 06:05:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827/5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827_image_0.jpg HTTP/1.1" 201 0
2025-12-05 06:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F8f3caae0-90d7-4ece-971c-baf294ce6d68_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/8f3caae0-90d7-4ece-971c-baf294ce6d68_ext_7.jpg saved to cache
2025-12-05 06:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827
2025-12-05 06:05:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827, skipping ID generation
2025-12-05 06:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827 from tracking dictionaries
2025-12-05 06:05:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827 sending to next pipeline
2025-12-05 06:05:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827, identifier: 2408993
2025-12-05 06:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbb6328e-9caa-4dcb-9c5b-704520ccd1c9_10.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbb6328e-9caa-4dcb-9c5b-704520ccd1c9_10.jpg not downloaded yet
2025-12-05 06:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3817425-9999999-338140133-007.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3817425-9999999-338140133-007.jpg not downloaded yet
2025-12-05 06:05:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827 with identifier: 2408993
2025-12-05 06:05:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827 with identifier: 2408993
2025-12-05 06:05:20 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827 with identifier: 2408993 to the API
2025-12-05 06:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 06:05:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 06:05:20 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/8f3caae0-90d7-4ece-971c-baf294ce6d68_ext_7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827/5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827_expert_report_file_994a5e2f-89ff-4522-b585-4971f576ddd7.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002408993-01992203-003.pdf',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '1.4L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'DT17YTY',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FIAT/500X?id=2408993',
 'listing': 'auction',
 'location': 'Northampton',
 'make': 'FIAT',
 'model': '500X',
 'odometer': 47075,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 28,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827/5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 199533,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8f3caae0-90d7-4ece-971c-baf294ce6d68_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827/5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 199533,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8f3caae0-90d7-4ece-971c-baf294ce6d68_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827/5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 250774,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8f3caae0-90d7-4ece-971c-baf294ce6d68_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827/5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 188898,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8f3caae0-90d7-4ece-971c-baf294ce6d68_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827/5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 215457,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8f3caae0-90d7-4ece-971c-baf294ce6d68_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827/5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 205980,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8f3caae0-90d7-4ece-971c-baf294ce6d68_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827/5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 186090,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8f3caae0-90d7-4ece-971c-baf294ce6d68_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827/5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 208421,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8f3caae0-90d7-4ece-971c-baf294ce6d68_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827/5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 209778,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8f3caae0-90d7-4ece-971c-baf294ce6d68_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827/5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 268436,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8f3caae0-90d7-4ece-971c-baf294ce6d68_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827/5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 218111,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8f3caae0-90d7-4ece-971c-baf294ce6d68_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827/5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 227808,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8f3caae0-90d7-4ece-971c-baf294ce6d68_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827/5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 176557,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/8f3caae0-90d7-4ece-971c-baf294ce6d68_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827/5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 283977,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2408993-4008436-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827/5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 220442,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2408993-4008436-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827/5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 160893,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2408993-4008436-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827/5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 221268,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2408993-4008436-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827/5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 212128,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2408993-4008436-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827/5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 203416,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2408993-4008436-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827/5dd0cd3d-17ae-56ed-901e-8b5bd5c9f827_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 264364,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2408993-4008436-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-22',
 'seller_name': 'Perrys',
 'title': 'FIAT 500X 1.4 Multiair Pop Star 5dr DCT',
 'transmission': 'automatic',
 'trim': '1.4 Multiair Pop Star 5dr DCT',
 'year': 2017}
2025-12-05 06:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272408993%27 HTTP/1.1" 200 None
2025-12-05 06:05:20 [manheim.gb] INFO: Saving data for 2408993: {'created_time': 1764914720.583101, 'last_price_update_time': 1764914720.583112, 'auction_closing_time': 1765270800.0}
2025-12-05 06:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2408993') HTTP/1.1" 204 0
2025-12-05 06:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbb6328e-9caa-4dcb-9c5b-704520ccd1c9_9.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbb6328e-9caa-4dcb-9c5b-704520ccd1c9_9.jpg not downloaded yet
2025-12-05 06:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3817425-9999999-338140133-009.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3817425-9999999-338140133-009.jpg not downloaded yet
2025-12-05 06:05:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bbb6328e-9caa-4dcb-9c5b-704520ccd1c9_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003809067-01979539-004.pdf)
2025-12-05 06:05:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3817425-9999999-338140133-008.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003817425-01803035-007.pdf)
2025-12-05 06:05:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3817425-9999999-338140133-001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003817425-01803035-007.pdf)
2025-12-05 06:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbb6328e-9caa-4dcb-9c5b-704520ccd1c9_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbb6328e-9caa-4dcb-9c5b-704520ccd1c9_ext_2.jpg not downloaded yet
2025-12-05 06:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3817425-9999999-338140133-010.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3817425-9999999-338140133-010.jpg not downloaded yet
2025-12-05 06:05:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bbb6328e-9caa-4dcb-9c5b-704520ccd1c9_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003809067-01979539-004.pdf)
2025-12-05 06:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbb6328e-9caa-4dcb-9c5b-704520ccd1c9_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbb6328e-9caa-4dcb-9c5b-704520ccd1c9_ext_5.jpg not downloaded yet
2025-12-05 06:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3817425-9999999-338140133-011.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3817425-9999999-338140133-011.jpg not downloaded yet
2025-12-05 06:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbb6328e-9caa-4dcb-9c5b-704520ccd1c9_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbb6328e-9caa-4dcb-9c5b-704520ccd1c9_ext_3.jpg not downloaded yet
2025-12-05 06:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3817425-9999999-338140133-012.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3817425-9999999-338140133-012.jpg not downloaded yet
2025-12-05 06:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbb6328e-9caa-4dcb-9c5b-704520ccd1c9_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbb6328e-9caa-4dcb-9c5b-704520ccd1c9_ext_4.jpg not downloaded yet
2025-12-05 06:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3817425-4008169-13.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3817425-4008169-13.jpg not downloaded yet
2025-12-05 06:05:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2343cee0d0>
2025-12-05 06:05:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_033c781b-dda1-5929-8ccb-625fce7cc686/033c781b-dda1-5929-8ccb-625fce7cc686_image_1.jpg HTTP/1.1" 201 0
2025-12-05 06:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbb6328e-9caa-4dcb-9c5b-704520ccd1c9_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbb6328e-9caa-4dcb-9c5b-704520ccd1c9_ext_7.jpg saved to cache
2025-12-05 06:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 033c781b-dda1-5929-8ccb-625fce7cc686
2025-12-05 06:05:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234244c350>
2025-12-05 06:05:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3a5ec65-b2dd-5298-b0b2-31410f732030/f3a5ec65-b2dd-5298-b0b2-31410f732030_image_1.jpg HTTP/1.1" 201 0
2025-12-05 06:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3817425-9999999-338140133-008.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3817425-9999999-338140133-008.jpg saved to cache
2025-12-05 06:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f3a5ec65-b2dd-5298-b0b2-31410f732030
2025-12-05 06:05:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23427f4cd0>
2025-12-05 06:05:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3a5ec65-b2dd-5298-b0b2-31410f732030/f3a5ec65-b2dd-5298-b0b2-31410f732030_image_2.jpg HTTP/1.1" 201 0
2025-12-05 06:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3817425-9999999-338140133-001.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3817425-9999999-338140133-001.jpg saved to cache
2025-12-05 06:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f3a5ec65-b2dd-5298-b0b2-31410f732030
2025-12-05 06:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3809067-3995807-13.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3809067-3995807-13.jpg not downloaded yet
2025-12-05 06:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3817425-4008169-1000.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3817425-4008169-1000.jpg not downloaded yet
2025-12-05 06:05:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342777850>
2025-12-05 06:05:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_033c781b-dda1-5929-8ccb-625fce7cc686/033c781b-dda1-5929-8ccb-625fce7cc686_image_2.jpg HTTP/1.1" 201 0
2025-12-05 06:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbb6328e-9caa-4dcb-9c5b-704520ccd1c9_ext_6.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbb6328e-9caa-4dcb-9c5b-704520ccd1c9_ext_6.jpg saved to cache
2025-12-05 06:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 033c781b-dda1-5929-8ccb-625fce7cc686
2025-12-05 06:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3809067-3995807-1000.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3809067-3995807-1000.jpg not downloaded yet
2025-12-05 06:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3817425-4008169-1001.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3817425-4008169-1001.jpg not downloaded yet
2025-12-05 06:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bbb6328e-9caa-4dcb-9c5b-704520ccd1c9_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003809067-01979539-004.pdf)
2025-12-05 06:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3817425-9999999-338140133-009.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003817425-01803035-007.pdf)
2025-12-05 06:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3817425-9999999-338140133-010.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003817425-01803035-007.pdf)
2025-12-05 06:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3817425-9999999-338140133-007.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003817425-01803035-007.pdf)
2025-12-05 06:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3809067-3995807-1001.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3809067-3995807-1001.jpg not downloaded yet
2025-12-05 06:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3817425-4008169-1002.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3817425-4008169-1002.jpg not downloaded yet
2025-12-05 06:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3809067-3995807-1002.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3809067-3995807-1002.jpg not downloaded yet
2025-12-05 06:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3817425-4008169-1003.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3817425-4008169-1003.jpg not downloaded yet
2025-12-05 06:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3817425-4008169-1004.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3817425-4008169-1004.jpg not downloaded yet
2025-12-05 06:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3817425-4008169-1005.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3817425-4008169-1005.jpg not downloaded yet
2025-12-05 06:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3817425-4008169-1006.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3817425-4008169-1006.jpg not downloaded yet
2025-12-05 06:05:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234253e7d0>
2025-12-05 06:05:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_033c781b-dda1-5929-8ccb-625fce7cc686/033c781b-dda1-5929-8ccb-625fce7cc686_image_8.jpg HTTP/1.1" 201 0
2025-12-05 06:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbb6328e-9caa-4dcb-9c5b-704520ccd1c9_9.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbb6328e-9caa-4dcb-9c5b-704520ccd1c9_9.jpg saved to cache
2025-12-05 06:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 033c781b-dda1-5929-8ccb-625fce7cc686
2025-12-05 06:05:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425d7b50>
2025-12-05 06:05:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3a5ec65-b2dd-5298-b0b2-31410f732030/f3a5ec65-b2dd-5298-b0b2-31410f732030_image_8.jpg HTTP/1.1" 201 0
2025-12-05 06:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3817425-9999999-338140133-009.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3817425-9999999-338140133-009.jpg saved to cache
2025-12-05 06:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f3a5ec65-b2dd-5298-b0b2-31410f732030
2025-12-05 06:05:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234269dad0>
2025-12-05 06:05:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 06:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3a5ec65-b2dd-5298-b0b2-31410f732030/f3a5ec65-b2dd-5298-b0b2-31410f732030_image_9.jpg HTTP/1.1" 201 0
2025-12-05 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3817425-9999999-338140133-010.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3817425-9999999-338140133-010.jpg saved to cache
2025-12-05 06:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f3a5ec65-b2dd-5298-b0b2-31410f732030
2025-12-05 06:05:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341ea91d0>
2025-12-05 06:05:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3a5ec65-b2dd-5298-b0b2-31410f732030/f3a5ec65-b2dd-5298-b0b2-31410f732030_image_7.jpg HTTP/1.1" 201 0
2025-12-05 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3817425-9999999-338140133-007.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3817425-9999999-338140133-007.jpg saved to cache
2025-12-05 06:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f3a5ec65-b2dd-5298-b0b2-31410f732030
2025-12-05 06:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3809067-3995807-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003809067-01979539-004.pdf)
2025-12-05 06:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3817425-4008169-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003817425-01803035-007.pdf)
2025-12-05 06:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3809067-3995807-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003809067-01979539-004.pdf)
2025-12-05 06:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3817425-4008169-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003817425-01803035-007.pdf)
2025-12-05 06:05:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2343c39e90>
2025-12-05 06:05:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_033c781b-dda1-5929-8ccb-625fce7cc686/033c781b-dda1-5929-8ccb-625fce7cc686_image_13.jpg HTTP/1.1" 201 0
2025-12-05 06:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3809067-3995807-13.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3809067-3995807-13.jpg saved to cache
2025-12-05 06:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 033c781b-dda1-5929-8ccb-625fce7cc686
2025-12-05 06:05:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341ecb810>
2025-12-05 06:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3a5ec65-b2dd-5298-b0b2-31410f732030/f3a5ec65-b2dd-5298-b0b2-31410f732030_image_13.jpg HTTP/1.1" 201 0
2025-12-05 06:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3817425-4008169-1000.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3817425-4008169-1000.jpg saved to cache
2025-12-05 06:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item f3a5ec65-b2dd-5298-b0b2-31410f732030
2025-12-05 06:05:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2343cef250>
2025-12-05 06:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_033c781b-dda1-5929-8ccb-625fce7cc686/033c781b-dda1-5929-8ccb-625fce7cc686_image_14.jpg HTTP/1.1" 201 0
2025-12-05 06:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3809067-3995807-1000.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3809067-3995807-1000.jpg saved to cache
2025-12-05 06:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 033c781b-dda1-5929-8ccb-625fce7cc686
2025-12-05 06:05:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342756810>
2025-12-05 06:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3a5ec65-b2dd-5298-b0b2-31410f732030/f3a5ec65-b2dd-5298-b0b2-31410f732030_image_14.jpg HTTP/1.1" 201 0
2025-12-05 06:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3817425-4008169-1001.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3817425-4008169-1001.jpg saved to cache
2025-12-05 06:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item f3a5ec65-b2dd-5298-b0b2-31410f732030
2025-12-05 06:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3817425-4008169-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003817425-01803035-007.pdf)
2025-12-05 06:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3817425-4008169-1006.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003817425-01803035-007.pdf)
2025-12-05 06:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3817425-4008169-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003817425-01803035-007.pdf)
2025-12-05 06:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3817425-4008169-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003817425-01803035-007.pdf)
2025-12-05 06:05:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23424e6990>
2025-12-05 06:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3a5ec65-b2dd-5298-b0b2-31410f732030/f3a5ec65-b2dd-5298-b0b2-31410f732030_image_18.jpg HTTP/1.1" 201 0
2025-12-05 06:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3817425-4008169-1005.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3817425-4008169-1005.jpg saved to cache
2025-12-05 06:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item f3a5ec65-b2dd-5298-b0b2-31410f732030
2025-12-05 06:05:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342560cd0>
2025-12-05 06:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3a5ec65-b2dd-5298-b0b2-31410f732030/f3a5ec65-b2dd-5298-b0b2-31410f732030_image_19.jpg HTTP/1.1" 201 0
2025-12-05 06:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3817425-4008169-1006.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3817425-4008169-1006.jpg saved to cache
2025-12-05 06:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item f3a5ec65-b2dd-5298-b0b2-31410f732030
2025-12-05 06:05:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342673d90>
2025-12-05 06:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3a5ec65-b2dd-5298-b0b2-31410f732030/f3a5ec65-b2dd-5298-b0b2-31410f732030_image_17.jpg HTTP/1.1" 201 0
2025-12-05 06:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3817425-4008169-1004.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3817425-4008169-1004.jpg saved to cache
2025-12-05 06:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item f3a5ec65-b2dd-5298-b0b2-31410f732030
2025-12-05 06:05:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23427c1410>
2025-12-05 06:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3a5ec65-b2dd-5298-b0b2-31410f732030/f3a5ec65-b2dd-5298-b0b2-31410f732030_image_16.jpg HTTP/1.1" 201 0
2025-12-05 06:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3817425-4008169-1003.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3817425-4008169-1003.jpg saved to cache
2025-12-05 06:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item f3a5ec65-b2dd-5298-b0b2-31410f732030
2025-12-05 06:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3809067-3995807-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003809067-01979539-004.pdf)
2025-12-05 06:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3809067-3995807-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003809067-01979539-004.pdf)
2025-12-05 06:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3817425-4008169-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003817425-01803035-007.pdf)
2025-12-05 06:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3817425-4008169-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003817425-01803035-007.pdf)
2025-12-05 06:05:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342661210>
2025-12-05 06:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_033c781b-dda1-5929-8ccb-625fce7cc686/033c781b-dda1-5929-8ccb-625fce7cc686_image_15.jpg HTTP/1.1" 201 0
2025-12-05 06:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3809067-3995807-1001.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3809067-3995807-1001.jpg saved to cache
2025-12-05 06:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 033c781b-dda1-5929-8ccb-625fce7cc686
2025-12-05 06:05:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23427b3690>
2025-12-05 06:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_033c781b-dda1-5929-8ccb-625fce7cc686/033c781b-dda1-5929-8ccb-625fce7cc686_image_16.jpg HTTP/1.1" 201 0
2025-12-05 06:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3809067-3995807-1002.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3809067-3995807-1002.jpg saved to cache
2025-12-05 06:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 033c781b-dda1-5929-8ccb-625fce7cc686
2025-12-05 06:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3817425-9999999-338140133-012.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003817425-01803035-007.pdf)
2025-12-05 06:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bbb6328e-9caa-4dcb-9c5b-704520ccd1c9_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003809067-01979539-004.pdf)
2025-12-05 06:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bbb6328e-9caa-4dcb-9c5b-704520ccd1c9_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003809067-01979539-004.pdf)
2025-12-05 06:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3817425-9999999-338140133-011.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003817425-01803035-007.pdf)
2025-12-05 06:05:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341edb390>
2025-12-05 06:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3a5ec65-b2dd-5298-b0b2-31410f732030/f3a5ec65-b2dd-5298-b0b2-31410f732030_image_15.jpg HTTP/1.1" 201 0
2025-12-05 06:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3817425-4008169-1002.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3817425-4008169-1002.jpg saved to cache
2025-12-05 06:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item f3a5ec65-b2dd-5298-b0b2-31410f732030
2025-12-05 06:05:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342828a10>
2025-12-05 06:05:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3a5ec65-b2dd-5298-b0b2-31410f732030/f3a5ec65-b2dd-5298-b0b2-31410f732030_image_12.jpg HTTP/1.1" 201 0
2025-12-05 06:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3817425-4008169-13.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3817425-4008169-13.jpg saved to cache
2025-12-05 06:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item f3a5ec65-b2dd-5298-b0b2-31410f732030
2025-12-05 06:05:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342511850>
2025-12-05 06:05:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3a5ec65-b2dd-5298-b0b2-31410f732030/f3a5ec65-b2dd-5298-b0b2-31410f732030_image_11.jpg HTTP/1.1" 201 0
2025-12-05 06:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3817425-9999999-338140133-012.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3817425-9999999-338140133-012.jpg saved to cache
2025-12-05 06:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item f3a5ec65-b2dd-5298-b0b2-31410f732030
2025-12-05 06:05:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23426ff1d0>
2025-12-05 06:05:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_033c781b-dda1-5929-8ccb-625fce7cc686/033c781b-dda1-5929-8ccb-625fce7cc686_image_12.jpg HTTP/1.1" 201 0
2025-12-05 06:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbb6328e-9caa-4dcb-9c5b-704520ccd1c9_ext_4.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbb6328e-9caa-4dcb-9c5b-704520ccd1c9_ext_4.jpg saved to cache
2025-12-05 06:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 033c781b-dda1-5929-8ccb-625fce7cc686
2025-12-05 06:05:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23426ad210>
2025-12-05 06:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_033c781b-dda1-5929-8ccb-625fce7cc686/033c781b-dda1-5929-8ccb-625fce7cc686_image_11.jpg HTTP/1.1" 201 0
2025-12-05 06:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbb6328e-9caa-4dcb-9c5b-704520ccd1c9_ext_3.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbb6328e-9caa-4dcb-9c5b-704520ccd1c9_ext_3.jpg saved to cache
2025-12-05 06:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 033c781b-dda1-5929-8ccb-625fce7cc686
2025-12-05 06:05:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23424978d0>
2025-12-05 06:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3a5ec65-b2dd-5298-b0b2-31410f732030/f3a5ec65-b2dd-5298-b0b2-31410f732030_image_10.jpg HTTP/1.1" 201 0
2025-12-05 06:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3817425-9999999-338140133-011.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3817425-9999999-338140133-011.jpg saved to cache
2025-12-05 06:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item f3a5ec65-b2dd-5298-b0b2-31410f732030
2025-12-05 06:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bbb6328e-9caa-4dcb-9c5b-704520ccd1c9_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003809067-01979539-004.pdf)
2025-12-05 06:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3817425-9999999-338140133-006.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003817425-01803035-007.pdf)
2025-12-05 06:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bbb6328e-9caa-4dcb-9c5b-704520ccd1c9_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003809067-01979539-004.pdf)
2025-12-05 06:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bbb6328e-9caa-4dcb-9c5b-704520ccd1c9_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003809067-01979539-004.pdf)
2025-12-05 06:05:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425d45d0>
2025-12-05 06:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_033c781b-dda1-5929-8ccb-625fce7cc686/033c781b-dda1-5929-8ccb-625fce7cc686_image_7.jpg HTTP/1.1" 201 0
2025-12-05 06:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbb6328e-9caa-4dcb-9c5b-704520ccd1c9_10.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbb6328e-9caa-4dcb-9c5b-704520ccd1c9_10.jpg saved to cache
2025-12-05 06:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 033c781b-dda1-5929-8ccb-625fce7cc686
2025-12-05 06:05:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23427b8ed0>
2025-12-05 06:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3a5ec65-b2dd-5298-b0b2-31410f732030/f3a5ec65-b2dd-5298-b0b2-31410f732030_image_6.jpg HTTP/1.1" 201 0
2025-12-05 06:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3817425-9999999-338140133-006.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3817425-9999999-338140133-006.jpg saved to cache
2025-12-05 06:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f3a5ec65-b2dd-5298-b0b2-31410f732030
2025-12-05 06:05:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341545d90>
2025-12-05 06:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_033c781b-dda1-5929-8ccb-625fce7cc686/033c781b-dda1-5929-8ccb-625fce7cc686_image_10.jpg HTTP/1.1" 201 0
2025-12-05 06:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbb6328e-9caa-4dcb-9c5b-704520ccd1c9_ext_5.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbb6328e-9caa-4dcb-9c5b-704520ccd1c9_ext_5.jpg saved to cache
2025-12-05 06:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 033c781b-dda1-5929-8ccb-625fce7cc686
2025-12-05 06:05:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341544690>
2025-12-05 06:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_033c781b-dda1-5929-8ccb-625fce7cc686/033c781b-dda1-5929-8ccb-625fce7cc686_image_9.jpg HTTP/1.1" 201 0
2025-12-05 06:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbb6328e-9caa-4dcb-9c5b-704520ccd1c9_ext_2.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbb6328e-9caa-4dcb-9c5b-704520ccd1c9_ext_2.jpg saved to cache
2025-12-05 06:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 033c781b-dda1-5929-8ccb-625fce7cc686
2025-12-05 06:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bbb6328e-9caa-4dcb-9c5b-704520ccd1c9_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003809067-01979539-004.pdf)
2025-12-05 06:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bbb6328e-9caa-4dcb-9c5b-704520ccd1c9_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003809067-01979539-004.pdf)
2025-12-05 06:05:29 [scrapy.extensions.logstats] INFO: Crawled 91 pages (at 13 pages/min), scraped 25 items (at 8 items/min)
2025-12-05 06:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3817425-9999999-338140133-003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003817425-01803035-007.pdf)
2025-12-05 06:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3817425-9999999-338140133-005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003817425-01803035-007.pdf)
2025-12-05 06:05:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342366090>
2025-12-05 06:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_033c781b-dda1-5929-8ccb-625fce7cc686/033c781b-dda1-5929-8ccb-625fce7cc686_image_6.jpg HTTP/1.1" 201 0
2025-12-05 06:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbb6328e-9caa-4dcb-9c5b-704520ccd1c9_11.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbb6328e-9caa-4dcb-9c5b-704520ccd1c9_11.jpg saved to cache
2025-12-05 06:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 033c781b-dda1-5929-8ccb-625fce7cc686
2025-12-05 06:05:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342479290>
2025-12-05 06:05:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_033c781b-dda1-5929-8ccb-625fce7cc686/033c781b-dda1-5929-8ccb-625fce7cc686_image_5.jpg HTTP/1.1" 201 0
2025-12-05 06:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbb6328e-9caa-4dcb-9c5b-704520ccd1c9_4.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbb6328e-9caa-4dcb-9c5b-704520ccd1c9_4.jpg saved to cache
2025-12-05 06:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 033c781b-dda1-5929-8ccb-625fce7cc686
2025-12-05 06:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bbb6328e-9caa-4dcb-9c5b-704520ccd1c9_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003809067-01979539-004.pdf)
2025-12-05 06:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bbb6328e-9caa-4dcb-9c5b-704520ccd1c9_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003809067-01979539-004.pdf)
2025-12-05 06:05:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425b3650>
2025-12-05 06:05:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 06:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3a5ec65-b2dd-5298-b0b2-31410f732030/f3a5ec65-b2dd-5298-b0b2-31410f732030_image_4.jpg HTTP/1.1" 201 0
2025-12-05 06:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3817425-9999999-338140133-003.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3817425-9999999-338140133-003.jpg saved to cache
2025-12-05 06:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f3a5ec65-b2dd-5298-b0b2-31410f732030
2025-12-05 06:05:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23424cf6d0>
2025-12-05 06:05:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3a5ec65-b2dd-5298-b0b2-31410f732030/f3a5ec65-b2dd-5298-b0b2-31410f732030_image_5.jpg HTTP/1.1" 201 0
2025-12-05 06:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3817425-9999999-338140133-005.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3817425-9999999-338140133-005.jpg saved to cache
2025-12-05 06:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f3a5ec65-b2dd-5298-b0b2-31410f732030
2025-12-05 06:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3817425-9999999-338140133-004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003817425-01803035-007.pdf)
2025-12-05 06:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3817425-9999999-338140133-002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003817425-01803035-007.pdf)
2025-12-05 06:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bbb6328e-9caa-4dcb-9c5b-704520ccd1c9_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003809067-01979539-004.pdf)
2025-12-05 06:05:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234157f350>
2025-12-05 06:05:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_033c781b-dda1-5929-8ccb-625fce7cc686/033c781b-dda1-5929-8ccb-625fce7cc686_image_3.jpg HTTP/1.1" 201 0
2025-12-05 06:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbb6328e-9caa-4dcb-9c5b-704520ccd1c9_ext_1.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbb6328e-9caa-4dcb-9c5b-704520ccd1c9_ext_1.jpg saved to cache
2025-12-05 06:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 033c781b-dda1-5929-8ccb-625fce7cc686
2025-12-05 06:05:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234292a390>
2025-12-05 06:05:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_033c781b-dda1-5929-8ccb-625fce7cc686/033c781b-dda1-5929-8ccb-625fce7cc686_image_4.jpg HTTP/1.1" 201 0
2025-12-05 06:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbb6328e-9caa-4dcb-9c5b-704520ccd1c9_5.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbb6328e-9caa-4dcb-9c5b-704520ccd1c9_5.jpg saved to cache
2025-12-05 06:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 033c781b-dda1-5929-8ccb-625fce7cc686
2025-12-05 06:05:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425c5d90>
2025-12-05 06:05:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3a5ec65-b2dd-5298-b0b2-31410f732030/f3a5ec65-b2dd-5298-b0b2-31410f732030_image_0.jpg HTTP/1.1" 201 0
2025-12-05 06:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3817425-9999999-338140133-004.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3817425-9999999-338140133-004.jpg saved to cache
2025-12-05 06:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f3a5ec65-b2dd-5298-b0b2-31410f732030
2025-12-05 06:05:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23423d1890>
2025-12-05 06:05:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 06:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3a5ec65-b2dd-5298-b0b2-31410f732030/f3a5ec65-b2dd-5298-b0b2-31410f732030_image_3.jpg HTTP/1.1" 201 0
2025-12-05 06:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3817425-9999999-338140133-002.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3817425-9999999-338140133-002.jpg saved to cache
2025-12-05 06:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f3a5ec65-b2dd-5298-b0b2-31410f732030
2025-12-05 06:05:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f3a5ec65-b2dd-5298-b0b2-31410f732030, skipping ID generation
2025-12-05 06:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Removing item f3a5ec65-b2dd-5298-b0b2-31410f732030 from tracking dictionaries
2025-12-05 06:05:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f3a5ec65-b2dd-5298-b0b2-31410f732030 sending to next pipeline
2025-12-05 06:05:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: f3a5ec65-b2dd-5298-b0b2-31410f732030, identifier: 3817425
2025-12-05 06:05:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341ede610>
2025-12-05 06:05:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_033c781b-dda1-5929-8ccb-625fce7cc686/033c781b-dda1-5929-8ccb-625fce7cc686_image_0.jpg HTTP/1.1" 201 0
2025-12-05 06:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbb6328e-9caa-4dcb-9c5b-704520ccd1c9_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbb6328e-9caa-4dcb-9c5b-704520ccd1c9_ext_7.jpg saved to cache
2025-12-05 06:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 033c781b-dda1-5929-8ccb-625fce7cc686
2025-12-05 06:05:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 033c781b-dda1-5929-8ccb-625fce7cc686, skipping ID generation
2025-12-05 06:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 033c781b-dda1-5929-8ccb-625fce7cc686 from tracking dictionaries
2025-12-05 06:05:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 033c781b-dda1-5929-8ccb-625fce7cc686 sending to next pipeline
2025-12-05 06:05:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 033c781b-dda1-5929-8ccb-625fce7cc686, identifier: 3809067
2025-12-05 06:05:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: f3a5ec65-b2dd-5298-b0b2-31410f732030 with identifier: 3817425
2025-12-05 06:05:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: f3a5ec65-b2dd-5298-b0b2-31410f732030 with identifier: 3817425
2025-12-05 06:05:33 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: f3a5ec65-b2dd-5298-b0b2-31410f732030 with identifier: 3817425 to the API
2025-12-05 06:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 06:05:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 06:05:33 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/3817425-9999999-338140133-002.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3a5ec65-b2dd-5298-b0b2-31410f732030/f3a5ec65-b2dd-5298-b0b2-31410f732030_expert_report_file_87d84d6d-2a98-4c82-8b6e-644ccbfb0988.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003817425-01803035-007.pdf',
 'color': 'BLUE',
 'currency': 'GBP',
 'engine': '1.5L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'f3a5ec65-b2dd-5298-b0b2-31410f732030',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'MA68ERV',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/PEUGEOT/3008?id=3817425',
 'listing': 'auction',
 'location': 'Washington',
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 67105,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 32,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3a5ec65-b2dd-5298-b0b2-31410f732030/f3a5ec65-b2dd-5298-b0b2-31410f732030_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 314875,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3817425-9999999-338140133-004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3a5ec65-b2dd-5298-b0b2-31410f732030/f3a5ec65-b2dd-5298-b0b2-31410f732030_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 190022,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3817425-9999999-338140133-008.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3a5ec65-b2dd-5298-b0b2-31410f732030/f3a5ec65-b2dd-5298-b0b2-31410f732030_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 223873,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3817425-9999999-338140133-001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3a5ec65-b2dd-5298-b0b2-31410f732030/f3a5ec65-b2dd-5298-b0b2-31410f732030_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 275432,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3817425-9999999-338140133-002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3a5ec65-b2dd-5298-b0b2-31410f732030/f3a5ec65-b2dd-5298-b0b2-31410f732030_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 296501,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3817425-9999999-338140133-003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3a5ec65-b2dd-5298-b0b2-31410f732030/f3a5ec65-b2dd-5298-b0b2-31410f732030_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 291649,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3817425-9999999-338140133-005.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3a5ec65-b2dd-5298-b0b2-31410f732030/f3a5ec65-b2dd-5298-b0b2-31410f732030_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 250316,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3817425-9999999-338140133-006.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3a5ec65-b2dd-5298-b0b2-31410f732030/f3a5ec65-b2dd-5298-b0b2-31410f732030_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257474,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3817425-9999999-338140133-007.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3a5ec65-b2dd-5298-b0b2-31410f732030/f3a5ec65-b2dd-5298-b0b2-31410f732030_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 258172,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3817425-9999999-338140133-009.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3a5ec65-b2dd-5298-b0b2-31410f732030/f3a5ec65-b2dd-5298-b0b2-31410f732030_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 206606,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3817425-9999999-338140133-010.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3a5ec65-b2dd-5298-b0b2-31410f732030/f3a5ec65-b2dd-5298-b0b2-31410f732030_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 207726,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3817425-9999999-338140133-011.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3a5ec65-b2dd-5298-b0b2-31410f732030/f3a5ec65-b2dd-5298-b0b2-31410f732030_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 171758,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3817425-9999999-338140133-012.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3a5ec65-b2dd-5298-b0b2-31410f732030/f3a5ec65-b2dd-5298-b0b2-31410f732030_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 395732,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3817425-4008169-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3a5ec65-b2dd-5298-b0b2-31410f732030/f3a5ec65-b2dd-5298-b0b2-31410f732030_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 331602,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3817425-4008169-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3a5ec65-b2dd-5298-b0b2-31410f732030/f3a5ec65-b2dd-5298-b0b2-31410f732030_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347258,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3817425-4008169-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3a5ec65-b2dd-5298-b0b2-31410f732030/f3a5ec65-b2dd-5298-b0b2-31410f732030_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 438673,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3817425-4008169-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3a5ec65-b2dd-5298-b0b2-31410f732030/f3a5ec65-b2dd-5298-b0b2-31410f732030_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 430339,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3817425-4008169-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3a5ec65-b2dd-5298-b0b2-31410f732030/f3a5ec65-b2dd-5298-b0b2-31410f732030_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 291584,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3817425-4008169-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3a5ec65-b2dd-5298-b0b2-31410f732030/f3a5ec65-b2dd-5298-b0b2-31410f732030_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 242434,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3817425-4008169-1005.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3a5ec65-b2dd-5298-b0b2-31410f732030/f3a5ec65-b2dd-5298-b0b2-31410f732030_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 226525,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3817425-4008169-1006.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-25',
 'seller_name': 'MotoNovo Finance',
 'title': 'PEUGEOT 3008 1.5 BlueHDi GT Line Premium 5dr',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi GT Line Premium 5dr',
 'year': 2018}
2025-12-05 06:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273817425%27 HTTP/1.1" 200 None
2025-12-05 06:05:33 [manheim.gb] INFO: Saving data for 3817425: {'created_time': 1764914733.463538, 'last_price_update_time': 1764914733.46355, 'auction_closing_time': 1765184400.0}
2025-12-05 06:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3817425') HTTP/1.1" 204 0
2025-12-05 06:05:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 033c781b-dda1-5929-8ccb-625fce7cc686 with identifier: 3809067
2025-12-05 06:05:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 033c781b-dda1-5929-8ccb-625fce7cc686 with identifier: 3809067
2025-12-05 06:05:33 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 033c781b-dda1-5929-8ccb-625fce7cc686 with identifier: 3809067 to the API
2025-12-05 06:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 06:05:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 06:05:33 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/bbb6328e-9caa-4dcb-9c5b-704520ccd1c9_ext_7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_033c781b-dda1-5929-8ccb-625fce7cc686/033c781b-dda1-5929-8ccb-625fce7cc686_expert_report_file_83a38934-8830-457d-afb2-6153a1a3688c.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003809067-01979539-004.pdf',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '033c781b-dda1-5929-8ccb-625fce7cc686',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'GY24FRJ',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/PEUGEOT/2008?id=3809067',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 10847,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_033c781b-dda1-5929-8ccb-625fce7cc686/033c781b-dda1-5929-8ccb-625fce7cc686_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 157928,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbb6328e-9caa-4dcb-9c5b-704520ccd1c9_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_033c781b-dda1-5929-8ccb-625fce7cc686/033c781b-dda1-5929-8ccb-625fce7cc686_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 157928,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbb6328e-9caa-4dcb-9c5b-704520ccd1c9_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_033c781b-dda1-5929-8ccb-625fce7cc686/033c781b-dda1-5929-8ccb-625fce7cc686_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 266482,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbb6328e-9caa-4dcb-9c5b-704520ccd1c9_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_033c781b-dda1-5929-8ccb-625fce7cc686/033c781b-dda1-5929-8ccb-625fce7cc686_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 129265,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbb6328e-9caa-4dcb-9c5b-704520ccd1c9_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_033c781b-dda1-5929-8ccb-625fce7cc686/033c781b-dda1-5929-8ccb-625fce7cc686_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 151119,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbb6328e-9caa-4dcb-9c5b-704520ccd1c9_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_033c781b-dda1-5929-8ccb-625fce7cc686/033c781b-dda1-5929-8ccb-625fce7cc686_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 149742,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbb6328e-9caa-4dcb-9c5b-704520ccd1c9_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_033c781b-dda1-5929-8ccb-625fce7cc686/033c781b-dda1-5929-8ccb-625fce7cc686_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 138122,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbb6328e-9caa-4dcb-9c5b-704520ccd1c9_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_033c781b-dda1-5929-8ccb-625fce7cc686/033c781b-dda1-5929-8ccb-625fce7cc686_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 140691,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbb6328e-9caa-4dcb-9c5b-704520ccd1c9_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_033c781b-dda1-5929-8ccb-625fce7cc686/033c781b-dda1-5929-8ccb-625fce7cc686_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 143555,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbb6328e-9caa-4dcb-9c5b-704520ccd1c9_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_033c781b-dda1-5929-8ccb-625fce7cc686/033c781b-dda1-5929-8ccb-625fce7cc686_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 309251,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbb6328e-9caa-4dcb-9c5b-704520ccd1c9_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_033c781b-dda1-5929-8ccb-625fce7cc686/033c781b-dda1-5929-8ccb-625fce7cc686_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 219539,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbb6328e-9caa-4dcb-9c5b-704520ccd1c9_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_033c781b-dda1-5929-8ccb-625fce7cc686/033c781b-dda1-5929-8ccb-625fce7cc686_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 217545,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbb6328e-9caa-4dcb-9c5b-704520ccd1c9_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_033c781b-dda1-5929-8ccb-625fce7cc686/033c781b-dda1-5929-8ccb-625fce7cc686_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 205602,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbb6328e-9caa-4dcb-9c5b-704520ccd1c9_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_033c781b-dda1-5929-8ccb-625fce7cc686/033c781b-dda1-5929-8ccb-625fce7cc686_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 309141,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3809067-3995807-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_033c781b-dda1-5929-8ccb-625fce7cc686/033c781b-dda1-5929-8ccb-625fce7cc686_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 348907,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3809067-3995807-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_033c781b-dda1-5929-8ccb-625fce7cc686/033c781b-dda1-5929-8ccb-625fce7cc686_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 260476,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3809067-3995807-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_033c781b-dda1-5929-8ccb-625fce7cc686/033c781b-dda1-5929-8ccb-625fce7cc686_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 295964,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3809067-3995807-1002.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-06-11',
 'seller_name': 'Leasys',
 'title': 'PEUGEOT 2008 1.2 PureTech 130 Allure 5dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech 130 Allure 5dr',
 'year': 2024}
2025-12-05 06:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273809067%27 HTTP/1.1" 200 None
2025-12-05 06:05:33 [manheim.gb] INFO: Saving data for 3809067: {'created_time': 1764914733.856458, 'last_price_update_time': 1764914733.856472, 'auction_closing_time': 1765270800.0}
2025-12-05 06:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3809067') HTTP/1.1" 204 0
2025-12-05 06:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003805781-01983875-002.pdf> (referer: None)
2025-12-05 06:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003805780-01983849-002.pdf> (referer: None)
2025-12-05 06:05:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2343b62650>
2025-12-05 06:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af206730-ce81-5a8d-a5c0-55195b37ece3/af206730-ce81-5a8d-a5c0-55195b37ece3_expert_report_file_44b17684-9741-43c0-b7b7-9d7f62f30a92.pdf HTTP/1.1" 201 0
2025-12-05 06:05:34 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item af206730-ce81-5a8d-a5c0-55195b37ece3
2025-12-05 06:05:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: af206730-ce81-5a8d-a5c0-55195b37ece3, skipping ID generation
2025-12-05 06:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item af206730-ce81-5a8d-a5c0-55195b37ece3
2025-12-05 06:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe38b8d11-ab3a-4a6b-8cb1-33754a090158_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e38b8d11-ab3a-4a6b-8cb1-33754a090158_ext_7.jpg not downloaded yet
2025-12-05 06:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe38b8d11-ab3a-4a6b-8cb1-33754a090158_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e38b8d11-ab3a-4a6b-8cb1-33754a090158_ext_7.jpg not downloaded yet
2025-12-05 06:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/PEUGEOT/2008?id=3805802&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233805802&indx=310> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe38b8d11-ab3a-4a6b-8cb1-33754a090158_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e38b8d11-ab3a-4a6b-8cb1-33754a090158_ext_6.jpg not downloaded yet
2025-12-05 06:05:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:05:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342694b90>
2025-12-05 06:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93cd6882-73c5-537b-81f0-b25d161c1962/93cd6882-73c5-537b-81f0-b25d161c1962_expert_report_file_23c23a7c-4921-4152-afd8-e761d700a9cf.pdf HTTP/1.1" 201 0
2025-12-05 06:05:34 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 93cd6882-73c5-537b-81f0-b25d161c1962
2025-12-05 06:05:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 93cd6882-73c5-537b-81f0-b25d161c1962, skipping ID generation
2025-12-05 06:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 93cd6882-73c5-537b-81f0-b25d161c1962
2025-12-05 06:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7d630588-8108-4ffd-b12a-2f8326b77e27_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7d630588-8108-4ffd-b12a-2f8326b77e27_ext_7.jpg not downloaded yet
2025-12-05 06:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe38b8d11-ab3a-4a6b-8cb1-33754a090158_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e38b8d11-ab3a-4a6b-8cb1-33754a090158_ext_1.jpg not downloaded yet
2025-12-05 06:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7d630588-8108-4ffd-b12a-2f8326b77e27_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7d630588-8108-4ffd-b12a-2f8326b77e27_ext_7.jpg not downloaded yet
2025-12-05 06:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe38b8d11-ab3a-4a6b-8cb1-33754a090158_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e38b8d11-ab3a-4a6b-8cb1-33754a090158_5.jpg not downloaded yet
2025-12-05 06:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7d630588-8108-4ffd-b12a-2f8326b77e27_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7d630588-8108-4ffd-b12a-2f8326b77e27_ext_6.jpg not downloaded yet
2025-12-05 06:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe38b8d11-ab3a-4a6b-8cb1-33754a090158_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e38b8d11-ab3a-4a6b-8cb1-33754a090158_4.jpg not downloaded yet
2025-12-05 06:05:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 041c8cec-8167-5084-8ad7-2c260146c6b5 with identifier: 3805802
2025-12-05 06:05:34 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 041c8cec-8167-5084-8ad7-2c260146c6b5
2025-12-05 06:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7d630588-8108-4ffd-b12a-2f8326b77e27_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7d630588-8108-4ffd-b12a-2f8326b77e27_ext_1.jpg not downloaded yet
2025-12-05 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe38b8d11-ab3a-4a6b-8cb1-33754a090158_11.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e38b8d11-ab3a-4a6b-8cb1-33754a090158_11.jpg not downloaded yet
2025-12-05 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7d630588-8108-4ffd-b12a-2f8326b77e27_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7d630588-8108-4ffd-b12a-2f8326b77e27_5.jpg not downloaded yet
2025-12-05 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe38b8d11-ab3a-4a6b-8cb1-33754a090158_10.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e38b8d11-ab3a-4a6b-8cb1-33754a090158_10.jpg not downloaded yet
2025-12-05 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7d630588-8108-4ffd-b12a-2f8326b77e27_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7d630588-8108-4ffd-b12a-2f8326b77e27_4.jpg not downloaded yet
2025-12-05 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe38b8d11-ab3a-4a6b-8cb1-33754a090158_9.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e38b8d11-ab3a-4a6b-8cb1-33754a090158_9.jpg not downloaded yet
2025-12-05 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7d630588-8108-4ffd-b12a-2f8326b77e27_11.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7d630588-8108-4ffd-b12a-2f8326b77e27_11.jpg not downloaded yet
2025-12-05 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe38b8d11-ab3a-4a6b-8cb1-33754a090158_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e38b8d11-ab3a-4a6b-8cb1-33754a090158_ext_2.jpg not downloaded yet
2025-12-05 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7d630588-8108-4ffd-b12a-2f8326b77e27_10.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7d630588-8108-4ffd-b12a-2f8326b77e27_10.jpg not downloaded yet
2025-12-05 06:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e38b8d11-ab3a-4a6b-8cb1-33754a090158_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003805781-01983875-002.pdf)
2025-12-05 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe38b8d11-ab3a-4a6b-8cb1-33754a090158_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e38b8d11-ab3a-4a6b-8cb1-33754a090158_ext_5.jpg not downloaded yet
2025-12-05 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7d630588-8108-4ffd-b12a-2f8326b77e27_9.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7d630588-8108-4ffd-b12a-2f8326b77e27_9.jpg not downloaded yet
2025-12-05 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe38b8d11-ab3a-4a6b-8cb1-33754a090158_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e38b8d11-ab3a-4a6b-8cb1-33754a090158_ext_3.jpg not downloaded yet
2025-12-05 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7d630588-8108-4ffd-b12a-2f8326b77e27_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7d630588-8108-4ffd-b12a-2f8326b77e27_ext_2.jpg not downloaded yet
2025-12-05 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe38b8d11-ab3a-4a6b-8cb1-33754a090158_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e38b8d11-ab3a-4a6b-8cb1-33754a090158_ext_4.jpg not downloaded yet
2025-12-05 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7d630588-8108-4ffd-b12a-2f8326b77e27_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7d630588-8108-4ffd-b12a-2f8326b77e27_ext_5.jpg not downloaded yet
2025-12-05 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3805781-4004883-13.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3805781-4004883-13.jpg not downloaded yet
2025-12-05 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7d630588-8108-4ffd-b12a-2f8326b77e27_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7d630588-8108-4ffd-b12a-2f8326b77e27_ext_3.jpg not downloaded yet
2025-12-05 06:05:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341ed8390>
2025-12-05 06:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af206730-ce81-5a8d-a5c0-55195b37ece3/af206730-ce81-5a8d-a5c0-55195b37ece3_image_1.jpg HTTP/1.1" 201 0
2025-12-05 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe38b8d11-ab3a-4a6b-8cb1-33754a090158_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e38b8d11-ab3a-4a6b-8cb1-33754a090158_ext_7.jpg saved to cache
2025-12-05 06:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item af206730-ce81-5a8d-a5c0-55195b37ece3
2025-12-05 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3805781-4004883-1000.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3805781-4004883-1000.jpg not downloaded yet
2025-12-05 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7d630588-8108-4ffd-b12a-2f8326b77e27_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7d630588-8108-4ffd-b12a-2f8326b77e27_ext_4.jpg not downloaded yet
2025-12-05 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3805781-4004883-1001.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3805781-4004883-1001.jpg not downloaded yet
2025-12-05 06:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7d630588-8108-4ffd-b12a-2f8326b77e27_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003805780-01983849-002.pdf)
2025-12-05 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3805780-4004239-13.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3805780-4004239-13.jpg not downloaded yet
2025-12-05 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3805781-4004883-1002.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3805781-4004883-1002.jpg not downloaded yet
2025-12-05 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3805780-4004239-1000.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3805780-4004239-1000.jpg not downloaded yet
2025-12-05 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3805781-4004883-1003.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3805781-4004883-1003.jpg not downloaded yet
2025-12-05 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3805780-4004239-1001.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3805780-4004239-1001.jpg not downloaded yet
2025-12-05 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3805781-4004883-1004.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3805781-4004883-1004.jpg not downloaded yet
2025-12-05 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3805780-4004239-1002.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3805780-4004239-1002.jpg not downloaded yet
2025-12-05 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3805781-4004883-1005.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3805781-4004883-1005.jpg not downloaded yet
2025-12-05 06:05:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341ee4650>
2025-12-05 06:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 06:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93cd6882-73c5-537b-81f0-b25d161c1962/93cd6882-73c5-537b-81f0-b25d161c1962_image_7.jpg HTTP/1.1" 201 0
2025-12-05 06:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7d630588-8108-4ffd-b12a-2f8326b77e27_10.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7d630588-8108-4ffd-b12a-2f8326b77e27_10.jpg saved to cache
2025-12-05 06:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 93cd6882-73c5-537b-81f0-b25d161c1962
2025-12-05 06:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3805780-4004239-1003.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3805780-4004239-1003.jpg not downloaded yet
2025-12-05 06:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3805780-4004239-1004.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3805780-4004239-1004.jpg not downloaded yet
2025-12-05 06:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3805781-4004883-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003805781-01983875-002.pdf)
2025-12-05 06:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3805780-4004239-1005.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3805780-4004239-1005.jpg not downloaded yet
2025-12-05 06:05:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23424cef50>
2025-12-05 06:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af206730-ce81-5a8d-a5c0-55195b37ece3/af206730-ce81-5a8d-a5c0-55195b37ece3_image_15.jpg HTTP/1.1" 201 0
2025-12-05 06:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3805781-4004883-1001.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3805781-4004883-1001.jpg saved to cache
2025-12-05 06:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item af206730-ce81-5a8d-a5c0-55195b37ece3
2025-12-05 06:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3805780-4004239-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003805780-01983849-002.pdf)
2025-12-05 06:05:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23415c4490>
2025-12-05 06:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93cd6882-73c5-537b-81f0-b25d161c1962/93cd6882-73c5-537b-81f0-b25d161c1962_image_18.jpg HTTP/1.1" 201 0
2025-12-05 06:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3805780-4004239-1004.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3805780-4004239-1004.jpg saved to cache
2025-12-05 06:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 93cd6882-73c5-537b-81f0-b25d161c1962
2025-12-05 06:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3805780-4004239-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003805780-01983849-002.pdf)
2025-12-05 06:05:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23426afc90>
2025-12-05 06:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93cd6882-73c5-537b-81f0-b25d161c1962/93cd6882-73c5-537b-81f0-b25d161c1962_image_19.jpg HTTP/1.1" 201 0
2025-12-05 06:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3805780-4004239-1005.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3805780-4004239-1005.jpg saved to cache
2025-12-05 06:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 93cd6882-73c5-537b-81f0-b25d161c1962
2025-12-05 06:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3805780-4004239-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003805780-01983849-002.pdf)
2025-12-05 06:05:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2343cf0150>
2025-12-05 06:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93cd6882-73c5-537b-81f0-b25d161c1962/93cd6882-73c5-537b-81f0-b25d161c1962_image_17.jpg HTTP/1.1" 201 0
2025-12-05 06:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3805780-4004239-1003.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3805780-4004239-1003.jpg saved to cache
2025-12-05 06:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 93cd6882-73c5-537b-81f0-b25d161c1962
2025-12-05 06:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3805781-4004883-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003805781-01983875-002.pdf)
2025-12-05 06:05:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23426ac250>
2025-12-05 06:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af206730-ce81-5a8d-a5c0-55195b37ece3/af206730-ce81-5a8d-a5c0-55195b37ece3_image_19.jpg HTTP/1.1" 201 0
2025-12-05 06:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3805781-4004883-1005.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3805781-4004883-1005.jpg saved to cache
2025-12-05 06:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item af206730-ce81-5a8d-a5c0-55195b37ece3
2025-12-05 06:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3805780-4004239-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003805780-01983849-002.pdf)
2025-12-05 06:05:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23424e6250>
2025-12-05 06:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93cd6882-73c5-537b-81f0-b25d161c1962/93cd6882-73c5-537b-81f0-b25d161c1962_image_16.jpg HTTP/1.1" 201 0
2025-12-05 06:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3805780-4004239-1002.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3805780-4004239-1002.jpg saved to cache
2025-12-05 06:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 93cd6882-73c5-537b-81f0-b25d161c1962
2025-12-05 06:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3805781-4004883-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003805781-01983875-002.pdf)
2025-12-05 06:05:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234239a1d0>
2025-12-05 06:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af206730-ce81-5a8d-a5c0-55195b37ece3/af206730-ce81-5a8d-a5c0-55195b37ece3_image_18.jpg HTTP/1.1" 201 0
2025-12-05 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3805781-4004883-1004.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3805781-4004883-1004.jpg saved to cache
2025-12-05 06:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item af206730-ce81-5a8d-a5c0-55195b37ece3
2025-12-05 06:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3805780-4004239-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003805780-01983849-002.pdf)
2025-12-05 06:05:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342840990>
2025-12-05 06:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 06:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93cd6882-73c5-537b-81f0-b25d161c1962/93cd6882-73c5-537b-81f0-b25d161c1962_image_15.jpg HTTP/1.1" 201 0
2025-12-05 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3805780-4004239-1001.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3805780-4004239-1001.jpg saved to cache
2025-12-05 06:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 93cd6882-73c5-537b-81f0-b25d161c1962
2025-12-05 06:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/RENAULT/CAPTUR?id=3795778&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233795778&indx=307> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:05:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3805781-4004883-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003805781-01983875-002.pdf)
2025-12-05 06:05:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d5697d4-5e7b-5beb-8c99-df92e90e2163 with identifier: 3795778
2025-12-05 06:05:39 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 5d5697d4-5e7b-5beb-8c99-df92e90e2163
2025-12-05 06:05:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234264fc90>
2025-12-05 06:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af206730-ce81-5a8d-a5c0-55195b37ece3/af206730-ce81-5a8d-a5c0-55195b37ece3_image_17.jpg HTTP/1.1" 201 0
2025-12-05 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3805781-4004883-1003.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3805781-4004883-1003.jpg saved to cache
2025-12-05 06:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item af206730-ce81-5a8d-a5c0-55195b37ece3
2025-12-05 06:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3805780-4004239-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003805780-01983849-002.pdf)
2025-12-05 06:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3805781-4004883-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003805781-01983875-002.pdf)
2025-12-05 06:05:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23426fc750>
2025-12-05 06:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93cd6882-73c5-537b-81f0-b25d161c1962/93cd6882-73c5-537b-81f0-b25d161c1962_image_14.jpg HTTP/1.1" 201 0
2025-12-05 06:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3805780-4004239-1000.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3805780-4004239-1000.jpg saved to cache
2025-12-05 06:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 93cd6882-73c5-537b-81f0-b25d161c1962
2025-12-05 06:05:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341e9f3d0>
2025-12-05 06:05:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af206730-ce81-5a8d-a5c0-55195b37ece3/af206730-ce81-5a8d-a5c0-55195b37ece3_image_16.jpg HTTP/1.1" 201 0
2025-12-05 06:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3805781-4004883-1002.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3805781-4004883-1002.jpg saved to cache
2025-12-05 06:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item af206730-ce81-5a8d-a5c0-55195b37ece3
2025-12-05 06:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3805780-4004239-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003805780-01983849-002.pdf)
2025-12-05 06:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003795778-01954574-003.pdf> (referer: None)
2025-12-05 06:05:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342502250>
2025-12-05 06:05:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93cd6882-73c5-537b-81f0-b25d161c1962/93cd6882-73c5-537b-81f0-b25d161c1962_image_13.jpg HTTP/1.1" 201 0
2025-12-05 06:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3805780-4004239-13.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3805780-4004239-13.jpg saved to cache
2025-12-05 06:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 93cd6882-73c5-537b-81f0-b25d161c1962
2025-12-05 06:05:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342668b90>
2025-12-05 06:05:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d5697d4-5e7b-5beb-8c99-df92e90e2163/5d5697d4-5e7b-5beb-8c99-df92e90e2163_expert_report_file_86ac5298-48e3-4808-9f82-5d485aa90ce7.pdf HTTP/1.1" 201 0
2025-12-05 06:05:41 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 5d5697d4-5e7b-5beb-8c99-df92e90e2163
2025-12-05 06:05:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5d5697d4-5e7b-5beb-8c99-df92e90e2163, skipping ID generation
2025-12-05 06:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 5d5697d4-5e7b-5beb-8c99-df92e90e2163
2025-12-05 06:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F48ec59ca-91c2-45f8-b0ac-6429e014a6c8_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/48ec59ca-91c2-45f8-b0ac-6429e014a6c8_ext_7.jpg already downloaded
2025-12-05 06:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F48ec59ca-91c2-45f8-b0ac-6429e014a6c8_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/48ec59ca-91c2-45f8-b0ac-6429e014a6c8_ext_7.jpg already downloaded
2025-12-05 06:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F48ec59ca-91c2-45f8-b0ac-6429e014a6c8_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/48ec59ca-91c2-45f8-b0ac-6429e014a6c8_ext_6.jpg already downloaded
2025-12-05 06:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F48ec59ca-91c2-45f8-b0ac-6429e014a6c8_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/48ec59ca-91c2-45f8-b0ac-6429e014a6c8_ext_1.jpg already downloaded
2025-12-05 06:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F48ec59ca-91c2-45f8-b0ac-6429e014a6c8_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/48ec59ca-91c2-45f8-b0ac-6429e014a6c8_5.jpg already downloaded
2025-12-05 06:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F48ec59ca-91c2-45f8-b0ac-6429e014a6c8_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/48ec59ca-91c2-45f8-b0ac-6429e014a6c8_4.jpg already downloaded
2025-12-05 06:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F48ec59ca-91c2-45f8-b0ac-6429e014a6c8_11.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/48ec59ca-91c2-45f8-b0ac-6429e014a6c8_11.jpg already downloaded
2025-12-05 06:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F48ec59ca-91c2-45f8-b0ac-6429e014a6c8_10.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/48ec59ca-91c2-45f8-b0ac-6429e014a6c8_10.jpg already downloaded
2025-12-05 06:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F48ec59ca-91c2-45f8-b0ac-6429e014a6c8_9.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/48ec59ca-91c2-45f8-b0ac-6429e014a6c8_9.jpg already downloaded
2025-12-05 06:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F48ec59ca-91c2-45f8-b0ac-6429e014a6c8_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/48ec59ca-91c2-45f8-b0ac-6429e014a6c8_ext_2.jpg already downloaded
2025-12-05 06:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F48ec59ca-91c2-45f8-b0ac-6429e014a6c8_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/48ec59ca-91c2-45f8-b0ac-6429e014a6c8_ext_5.jpg already downloaded
2025-12-05 06:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F48ec59ca-91c2-45f8-b0ac-6429e014a6c8_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/48ec59ca-91c2-45f8-b0ac-6429e014a6c8_ext_3.jpg already downloaded
2025-12-05 06:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F48ec59ca-91c2-45f8-b0ac-6429e014a6c8_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/48ec59ca-91c2-45f8-b0ac-6429e014a6c8_ext_4.jpg already downloaded
2025-12-05 06:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3795778-3960889-13.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3795778-3960889-13.jpg already downloaded
2025-12-05 06:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3795778-3960889-1000.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3795778-3960889-1000.jpg already downloaded
2025-12-05 06:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3795778-3960889-1001.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3795778-3960889-1001.jpg already downloaded
2025-12-05 06:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3795778-3960889-1002.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3795778-3960889-1002.jpg already downloaded
2025-12-05 06:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3795778-3960889-1003.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3795778-3960889-1003.jpg already downloaded
2025-12-05 06:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3795778-3960889-1004.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3795778-3960889-1004.jpg already downloaded
2025-12-05 06:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3795778-3960889-1005.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3795778-3960889-1005.jpg already downloaded
2025-12-05 06:05:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 5d5697d4-5e7b-5beb-8c99-df92e90e2163, identifier: 3795778
2025-12-05 06:05:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 5d5697d4-5e7b-5beb-8c99-df92e90e2163 with identifier: 3795778
2025-12-05 06:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 06:05:42 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=WHITE+AND+BLACK HTTP/1.1" 200 None
2025-12-05 06:05:42 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 06:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 06:05:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 5d5697d4-5e7b-5beb-8c99-df92e90e2163 with identifier: 3795778
2025-12-05 06:05:42 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 5d5697d4-5e7b-5beb-8c99-df92e90e2163 with identifier: 3795778 to the API
2025-12-05 06:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 06:05:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 06:05:42 [scrapy.core.scraper] DEBUG: Scraped from <200 http://ecr.manheim.co.uk/pdf/MOL-0003795778-01954574-003.pdf>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d5697d4-5e7b-5beb-8c99-df92e90e2163/5d5697d4-5e7b-5beb-8c99-df92e90e2163_expert_report_file_86ac5298-48e3-4808-9f82-5d485aa90ce7.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003795778-01954574-003.pdf',
 'color': 'WHITE AND BLACK',
 'currency': 'GBP',
 'engine': '1.3L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '5d5697d4-5e7b-5beb-8c99-df92e90e2163',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'SH71LPF',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/RENAULT/CAPTUR?id=3795778',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'RENAULT',
 'model': 'CAPTUR',
 'odometer': 47855,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 31,
 'photo_urls': ['http://images.manheim.co.uk/images/units/zoom/48ec59ca-91c2-45f8-b0ac-6429e014a6c8_ext_7.jpg',
                'http://images.manheim.co.uk/images/units/zoom/48ec59ca-91c2-45f8-b0ac-6429e014a6c8_ext_7.jpg',
                'http://images.manheim.co.uk/images/units/zoom/48ec59ca-91c2-45f8-b0ac-6429e014a6c8_ext_6.jpg',
                'http://images.manheim.co.uk/images/units/zoom/48ec59ca-91c2-45f8-b0ac-6429e014a6c8_ext_1.jpg',
                'http://images.manheim.co.uk/images/units/zoom/48ec59ca-91c2-45f8-b0ac-6429e014a6c8_5.jpg',
                'http://images.manheim.co.uk/images/units/zoom/48ec59ca-91c2-45f8-b0ac-6429e014a6c8_4.jpg',
                'http://images.manheim.co.uk/images/units/zoom/48ec59ca-91c2-45f8-b0ac-6429e014a6c8_11.jpg',
                'http://images.manheim.co.uk/images/units/zoom/48ec59ca-91c2-45f8-b0ac-6429e014a6c8_10.jpg',
                'http://images.manheim.co.uk/images/units/zoom/48ec59ca-91c2-45f8-b0ac-6429e014a6c8_9.jpg',
                'http://images.manheim.co.uk/images/units/zoom/48ec59ca-91c2-45f8-b0ac-6429e014a6c8_ext_2.jpg',
                'http://images.manheim.co.uk/images/units/zoom/48ec59ca-91c2-45f8-b0ac-6429e014a6c8_ext_5.jpg',
                'http://images.manheim.co.uk/images/units/zoom/48ec59ca-91c2-45f8-b0ac-6429e014a6c8_ext_3.jpg',
                'http://images.manheim.co.uk/images/units/zoom/48ec59ca-91c2-45f8-b0ac-6429e014a6c8_ext_4.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3795778-3960889-13.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3795778-3960889-1000.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3795778-3960889-1001.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3795778-3960889-1002.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3795778-3960889-1003.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3795778-3960889-1004.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3795778-3960889-1005.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d5697d4-5e7b-5beb-8c99-df92e90e2163/5d5697d4-5e7b-5beb-8c99-df92e90e2163_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 234412,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/48ec59ca-91c2-45f8-b0ac-6429e014a6c8_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d5697d4-5e7b-5beb-8c99-df92e90e2163/5d5697d4-5e7b-5beb-8c99-df92e90e2163_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 234412,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/48ec59ca-91c2-45f8-b0ac-6429e014a6c8_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d5697d4-5e7b-5beb-8c99-df92e90e2163/5d5697d4-5e7b-5beb-8c99-df92e90e2163_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 209708,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/48ec59ca-91c2-45f8-b0ac-6429e014a6c8_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d5697d4-5e7b-5beb-8c99-df92e90e2163/5d5697d4-5e7b-5beb-8c99-df92e90e2163_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121766,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/48ec59ca-91c2-45f8-b0ac-6429e014a6c8_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d5697d4-5e7b-5beb-8c99-df92e90e2163/5d5697d4-5e7b-5beb-8c99-df92e90e2163_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 214191,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/48ec59ca-91c2-45f8-b0ac-6429e014a6c8_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d5697d4-5e7b-5beb-8c99-df92e90e2163/5d5697d4-5e7b-5beb-8c99-df92e90e2163_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 184297,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/48ec59ca-91c2-45f8-b0ac-6429e014a6c8_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d5697d4-5e7b-5beb-8c99-df92e90e2163/5d5697d4-5e7b-5beb-8c99-df92e90e2163_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 192731,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/48ec59ca-91c2-45f8-b0ac-6429e014a6c8_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d5697d4-5e7b-5beb-8c99-df92e90e2163/5d5697d4-5e7b-5beb-8c99-df92e90e2163_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 196486,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/48ec59ca-91c2-45f8-b0ac-6429e014a6c8_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d5697d4-5e7b-5beb-8c99-df92e90e2163/5d5697d4-5e7b-5beb-8c99-df92e90e2163_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 212564,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/48ec59ca-91c2-45f8-b0ac-6429e014a6c8_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d5697d4-5e7b-5beb-8c99-df92e90e2163/5d5697d4-5e7b-5beb-8c99-df92e90e2163_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 237554,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/48ec59ca-91c2-45f8-b0ac-6429e014a6c8_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d5697d4-5e7b-5beb-8c99-df92e90e2163/5d5697d4-5e7b-5beb-8c99-df92e90e2163_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 193033,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/48ec59ca-91c2-45f8-b0ac-6429e014a6c8_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d5697d4-5e7b-5beb-8c99-df92e90e2163/5d5697d4-5e7b-5beb-8c99-df92e90e2163_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 203838,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/48ec59ca-91c2-45f8-b0ac-6429e014a6c8_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d5697d4-5e7b-5beb-8c99-df92e90e2163/5d5697d4-5e7b-5beb-8c99-df92e90e2163_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 196634,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/48ec59ca-91c2-45f8-b0ac-6429e014a6c8_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d5697d4-5e7b-5beb-8c99-df92e90e2163/5d5697d4-5e7b-5beb-8c99-df92e90e2163_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 267685,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3795778-3960889-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d5697d4-5e7b-5beb-8c99-df92e90e2163/5d5697d4-5e7b-5beb-8c99-df92e90e2163_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 447141,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3795778-3960889-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d5697d4-5e7b-5beb-8c99-df92e90e2163/5d5697d4-5e7b-5beb-8c99-df92e90e2163_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 245832,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3795778-3960889-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d5697d4-5e7b-5beb-8c99-df92e90e2163/5d5697d4-5e7b-5beb-8c99-df92e90e2163_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 244251,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3795778-3960889-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d5697d4-5e7b-5beb-8c99-df92e90e2163/5d5697d4-5e7b-5beb-8c99-df92e90e2163_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 238924,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3795778-3960889-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d5697d4-5e7b-5beb-8c99-df92e90e2163/5d5697d4-5e7b-5beb-8c99-df92e90e2163_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 289127,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3795778-3960889-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d5697d4-5e7b-5beb-8c99-df92e90e2163/5d5697d4-5e7b-5beb-8c99-df92e90e2163_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 151916,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3795778-3960889-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-07',
 'seller_name': 'John Banks',
 'title': 'RENAULT CAPTUR 1.3 Mild hybrid 140 R.S. Line 5dr',
 'transmission': 'manual',
 'trim': '1.3 Mild hybrid 140 R.S. Line 5dr',
 'year': 2022}
2025-12-05 06:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273795778%27 HTTP/1.1" 200 None
2025-12-05 06:05:42 [manheim.gb] INFO: Saving data for 3795778: {'created_time': 1764914742.580065, 'last_price_update_time': 1764914742.580077, 'auction_closing_time': 1765270800.0}
2025-12-05 06:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3795778') HTTP/1.1" 204 0
2025-12-05 06:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7d630588-8108-4ffd-b12a-2f8326b77e27_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003805780-01983849-002.pdf)
2025-12-05 06:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3805781-4004883-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003805781-01983875-002.pdf)
2025-12-05 06:05:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341e9e010>
2025-12-05 06:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 06:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93cd6882-73c5-537b-81f0-b25d161c1962/93cd6882-73c5-537b-81f0-b25d161c1962_image_12.jpg HTTP/1.1" 201 0
2025-12-05 06:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7d630588-8108-4ffd-b12a-2f8326b77e27_ext_4.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7d630588-8108-4ffd-b12a-2f8326b77e27_ext_4.jpg saved to cache
2025-12-05 06:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 93cd6882-73c5-537b-81f0-b25d161c1962
2025-12-05 06:05:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23415f8890>
2025-12-05 06:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af206730-ce81-5a8d-a5c0-55195b37ece3/af206730-ce81-5a8d-a5c0-55195b37ece3_image_14.jpg HTTP/1.1" 201 0
2025-12-05 06:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3805781-4004883-1000.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3805781-4004883-1000.jpg saved to cache
2025-12-05 06:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item af206730-ce81-5a8d-a5c0-55195b37ece3
2025-12-05 06:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7d630588-8108-4ffd-b12a-2f8326b77e27_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003805780-01983849-002.pdf)
2025-12-05 06:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3805781-4004883-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003805781-01983875-002.pdf)
2025-12-05 06:05:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23424e5510>
2025-12-05 06:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93cd6882-73c5-537b-81f0-b25d161c1962/93cd6882-73c5-537b-81f0-b25d161c1962_image_11.jpg HTTP/1.1" 201 0
2025-12-05 06:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7d630588-8108-4ffd-b12a-2f8326b77e27_ext_3.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7d630588-8108-4ffd-b12a-2f8326b77e27_ext_3.jpg saved to cache
2025-12-05 06:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 93cd6882-73c5-537b-81f0-b25d161c1962
2025-12-05 06:05:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23415464d0>
2025-12-05 06:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af206730-ce81-5a8d-a5c0-55195b37ece3/af206730-ce81-5a8d-a5c0-55195b37ece3_image_13.jpg HTTP/1.1" 201 0
2025-12-05 06:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3805781-4004883-13.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3805781-4004883-13.jpg saved to cache
2025-12-05 06:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item af206730-ce81-5a8d-a5c0-55195b37ece3
2025-12-05 06:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7d630588-8108-4ffd-b12a-2f8326b77e27_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003805780-01983849-002.pdf)
2025-12-05 06:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e38b8d11-ab3a-4a6b-8cb1-33754a090158_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003805781-01983875-002.pdf)
2025-12-05 06:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/PEUGEOT/3008?id=3794180&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233794180&indx=306> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=3787909&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233787909&indx=303> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:05:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:05:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:05:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23427e40d0>
2025-12-05 06:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93cd6882-73c5-537b-81f0-b25d161c1962/93cd6882-73c5-537b-81f0-b25d161c1962_image_10.jpg HTTP/1.1" 201 0
2025-12-05 06:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7d630588-8108-4ffd-b12a-2f8326b77e27_ext_5.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7d630588-8108-4ffd-b12a-2f8326b77e27_ext_5.jpg saved to cache
2025-12-05 06:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 93cd6882-73c5-537b-81f0-b25d161c1962
2025-12-05 06:05:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342840ad0>
2025-12-05 06:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af206730-ce81-5a8d-a5c0-55195b37ece3/af206730-ce81-5a8d-a5c0-55195b37ece3_image_12.jpg HTTP/1.1" 201 0
2025-12-05 06:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe38b8d11-ab3a-4a6b-8cb1-33754a090158_ext_4.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e38b8d11-ab3a-4a6b-8cb1-33754a090158_ext_4.jpg saved to cache
2025-12-05 06:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item af206730-ce81-5a8d-a5c0-55195b37ece3
2025-12-05 06:05:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 179fc562-a6f2-5445-a27d-e74322b881ba with identifier: 3794180
2025-12-05 06:05:45 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 179fc562-a6f2-5445-a27d-e74322b881ba
2025-12-05 06:05:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81ff3b9d-7da0-5b8a-a49c-6e2dea14306a with identifier: 3787909
2025-12-05 06:05:45 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 81ff3b9d-7da0-5b8a-a49c-6e2dea14306a
2025-12-05 06:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e38b8d11-ab3a-4a6b-8cb1-33754a090158_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003805781-01983875-002.pdf)
2025-12-05 06:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7d630588-8108-4ffd-b12a-2f8326b77e27_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003805780-01983849-002.pdf)
2025-12-05 06:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e38b8d11-ab3a-4a6b-8cb1-33754a090158_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003805781-01983875-002.pdf)
2025-12-05 06:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7d630588-8108-4ffd-b12a-2f8326b77e27_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003805780-01983849-002.pdf)
2025-12-05 06:05:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23427e54d0>
2025-12-05 06:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 06:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af206730-ce81-5a8d-a5c0-55195b37ece3/af206730-ce81-5a8d-a5c0-55195b37ece3_image_11.jpg HTTP/1.1" 201 0
2025-12-05 06:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe38b8d11-ab3a-4a6b-8cb1-33754a090158_ext_3.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e38b8d11-ab3a-4a6b-8cb1-33754a090158_ext_3.jpg saved to cache
2025-12-05 06:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item af206730-ce81-5a8d-a5c0-55195b37ece3
2025-12-05 06:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7d630588-8108-4ffd-b12a-2f8326b77e27_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003805780-01983849-002.pdf)
2025-12-05 06:05:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342669b10>
2025-12-05 06:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93cd6882-73c5-537b-81f0-b25d161c1962/93cd6882-73c5-537b-81f0-b25d161c1962_image_8.jpg HTTP/1.1" 201 0
2025-12-05 06:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7d630588-8108-4ffd-b12a-2f8326b77e27_9.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7d630588-8108-4ffd-b12a-2f8326b77e27_9.jpg saved to cache
2025-12-05 06:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 93cd6882-73c5-537b-81f0-b25d161c1962
2025-12-05 06:05:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341f26450>
2025-12-05 06:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af206730-ce81-5a8d-a5c0-55195b37ece3/af206730-ce81-5a8d-a5c0-55195b37ece3_image_10.jpg HTTP/1.1" 201 0
2025-12-05 06:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe38b8d11-ab3a-4a6b-8cb1-33754a090158_ext_5.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e38b8d11-ab3a-4a6b-8cb1-33754a090158_ext_5.jpg saved to cache
2025-12-05 06:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item af206730-ce81-5a8d-a5c0-55195b37ece3
2025-12-05 06:05:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425f8ad0>
2025-12-05 06:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93cd6882-73c5-537b-81f0-b25d161c1962/93cd6882-73c5-537b-81f0-b25d161c1962_image_9.jpg HTTP/1.1" 201 0
2025-12-05 06:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7d630588-8108-4ffd-b12a-2f8326b77e27_ext_2.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7d630588-8108-4ffd-b12a-2f8326b77e27_ext_2.jpg saved to cache
2025-12-05 06:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 93cd6882-73c5-537b-81f0-b25d161c1962
2025-12-05 06:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e38b8d11-ab3a-4a6b-8cb1-33754a090158_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003805781-01983875-002.pdf)
2025-12-05 06:05:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342696ad0>
2025-12-05 06:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93cd6882-73c5-537b-81f0-b25d161c1962/93cd6882-73c5-537b-81f0-b25d161c1962_image_6.jpg HTTP/1.1" 201 0
2025-12-05 06:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7d630588-8108-4ffd-b12a-2f8326b77e27_11.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7d630588-8108-4ffd-b12a-2f8326b77e27_11.jpg saved to cache
2025-12-05 06:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 93cd6882-73c5-537b-81f0-b25d161c1962
2025-12-05 06:05:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23424955d0>
2025-12-05 06:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 06:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af206730-ce81-5a8d-a5c0-55195b37ece3/af206730-ce81-5a8d-a5c0-55195b37ece3_image_9.jpg HTTP/1.1" 201 0
2025-12-05 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe38b8d11-ab3a-4a6b-8cb1-33754a090158_ext_2.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e38b8d11-ab3a-4a6b-8cb1-33754a090158_ext_2.jpg saved to cache
2025-12-05 06:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item af206730-ce81-5a8d-a5c0-55195b37ece3
2025-12-05 06:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e38b8d11-ab3a-4a6b-8cb1-33754a090158_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003805781-01983875-002.pdf)
2025-12-05 06:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7d630588-8108-4ffd-b12a-2f8326b77e27_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003805780-01983849-002.pdf)
2025-12-05 06:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003794180-01983300-003.pdf> (referer: None)
2025-12-05 06:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003787909-01957651-002.pdf> (referer: None)
2025-12-05 06:05:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234270dad0>
2025-12-05 06:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af206730-ce81-5a8d-a5c0-55195b37ece3/af206730-ce81-5a8d-a5c0-55195b37ece3_image_8.jpg HTTP/1.1" 201 0
2025-12-05 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe38b8d11-ab3a-4a6b-8cb1-33754a090158_9.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e38b8d11-ab3a-4a6b-8cb1-33754a090158_9.jpg saved to cache
2025-12-05 06:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item af206730-ce81-5a8d-a5c0-55195b37ece3
2025-12-05 06:05:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342a25d90>
2025-12-05 06:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93cd6882-73c5-537b-81f0-b25d161c1962/93cd6882-73c5-537b-81f0-b25d161c1962_image_5.jpg HTTP/1.1" 201 0
2025-12-05 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7d630588-8108-4ffd-b12a-2f8326b77e27_4.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7d630588-8108-4ffd-b12a-2f8326b77e27_4.jpg saved to cache
2025-12-05 06:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 93cd6882-73c5-537b-81f0-b25d161c1962
2025-12-05 06:05:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342496bd0>
2025-12-05 06:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_179fc562-a6f2-5445-a27d-e74322b881ba/179fc562-a6f2-5445-a27d-e74322b881ba_expert_report_file_2db248a3-6653-4b3d-9b84-e07c9718d835.pdf HTTP/1.1" 201 0
2025-12-05 06:05:47 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 179fc562-a6f2-5445-a27d-e74322b881ba
2025-12-05 06:05:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 179fc562-a6f2-5445-a27d-e74322b881ba, skipping ID generation
2025-12-05 06:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 179fc562-a6f2-5445-a27d-e74322b881ba
2025-12-05 06:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb030e6f4-9391-4de0-8fec-af2207dbb9e8_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b030e6f4-9391-4de0-8fec-af2207dbb9e8_ext_7.jpg not downloaded yet
2025-12-05 06:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e38b8d11-ab3a-4a6b-8cb1-33754a090158_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003805781-01983875-002.pdf)
2025-12-05 06:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7d630588-8108-4ffd-b12a-2f8326b77e27_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003805780-01983849-002.pdf)
2025-12-05 06:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb030e6f4-9391-4de0-8fec-af2207dbb9e8_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b030e6f4-9391-4de0-8fec-af2207dbb9e8_ext_7.jpg not downloaded yet
2025-12-05 06:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/AUDI/A3?id=3791288&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233791288&indx=305> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e38b8d11-ab3a-4a6b-8cb1-33754a090158_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003805781-01983875-002.pdf)
2025-12-05 06:05:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:05:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342810950>
2025-12-05 06:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81ff3b9d-7da0-5b8a-a49c-6e2dea14306a/81ff3b9d-7da0-5b8a-a49c-6e2dea14306a_expert_report_file_6c6b96a6-6c8f-40c7-a56d-56fd7b4705f1.pdf HTTP/1.1" 201 0
2025-12-05 06:05:48 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 81ff3b9d-7da0-5b8a-a49c-6e2dea14306a
2025-12-05 06:05:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 81ff3b9d-7da0-5b8a-a49c-6e2dea14306a, skipping ID generation
2025-12-05 06:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 81ff3b9d-7da0-5b8a-a49c-6e2dea14306a
2025-12-05 06:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fed3e38ce-5da8-483d-83b7-077a743405c8_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ed3e38ce-5da8-483d-83b7-077a743405c8_ext_7.jpg already downloaded
2025-12-05 06:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fed3e38ce-5da8-483d-83b7-077a743405c8_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ed3e38ce-5da8-483d-83b7-077a743405c8_ext_7.jpg already downloaded
2025-12-05 06:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fed3e38ce-5da8-483d-83b7-077a743405c8_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ed3e38ce-5da8-483d-83b7-077a743405c8_ext_6.jpg already downloaded
2025-12-05 06:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fed3e38ce-5da8-483d-83b7-077a743405c8_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ed3e38ce-5da8-483d-83b7-077a743405c8_ext_1.jpg already downloaded
2025-12-05 06:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fed3e38ce-5da8-483d-83b7-077a743405c8_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ed3e38ce-5da8-483d-83b7-077a743405c8_5.jpg already downloaded
2025-12-05 06:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fed3e38ce-5da8-483d-83b7-077a743405c8_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ed3e38ce-5da8-483d-83b7-077a743405c8_4.jpg already downloaded
2025-12-05 06:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fed3e38ce-5da8-483d-83b7-077a743405c8_11.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ed3e38ce-5da8-483d-83b7-077a743405c8_11.jpg already downloaded
2025-12-05 06:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fed3e38ce-5da8-483d-83b7-077a743405c8_10.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ed3e38ce-5da8-483d-83b7-077a743405c8_10.jpg already downloaded
2025-12-05 06:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fed3e38ce-5da8-483d-83b7-077a743405c8_9.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ed3e38ce-5da8-483d-83b7-077a743405c8_9.jpg already downloaded
2025-12-05 06:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fed3e38ce-5da8-483d-83b7-077a743405c8_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ed3e38ce-5da8-483d-83b7-077a743405c8_ext_2.jpg already downloaded
2025-12-05 06:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fed3e38ce-5da8-483d-83b7-077a743405c8_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ed3e38ce-5da8-483d-83b7-077a743405c8_ext_5.jpg already downloaded
2025-12-05 06:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fed3e38ce-5da8-483d-83b7-077a743405c8_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ed3e38ce-5da8-483d-83b7-077a743405c8_ext_3.jpg already downloaded
2025-12-05 06:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fed3e38ce-5da8-483d-83b7-077a743405c8_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ed3e38ce-5da8-483d-83b7-077a743405c8_ext_4.jpg already downloaded
2025-12-05 06:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3787909-3983571-13.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3787909-3983571-13.jpg already downloaded
2025-12-05 06:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3787909-3983571-1000.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3787909-3983571-1000.jpg already downloaded
2025-12-05 06:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3787909-3983571-1001.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3787909-3983571-1001.jpg already downloaded
2025-12-05 06:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3787909-3983571-1002.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3787909-3983571-1002.jpg already downloaded
2025-12-05 06:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3787909-3983571-1003.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3787909-3983571-1003.jpg already downloaded
2025-12-05 06:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3787909-3983571-1004.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3787909-3983571-1004.jpg already downloaded
2025-12-05 06:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3787909-3983571-1005.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3787909-3983571-1005.jpg already downloaded
2025-12-05 06:05:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 81ff3b9d-7da0-5b8a-a49c-6e2dea14306a, identifier: 3787909
2025-12-05 06:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb030e6f4-9391-4de0-8fec-af2207dbb9e8_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b030e6f4-9391-4de0-8fec-af2207dbb9e8_ext_6.jpg not downloaded yet
2025-12-05 06:05:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 81ff3b9d-7da0-5b8a-a49c-6e2dea14306a with identifier: 3787909
2025-12-05 06:05:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 81ff3b9d-7da0-5b8a-a49c-6e2dea14306a with identifier: 3787909
2025-12-05 06:05:49 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 81ff3b9d-7da0-5b8a-a49c-6e2dea14306a with identifier: 3787909 to the API
2025-12-05 06:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 06:05:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 06:05:49 [scrapy.core.scraper] DEBUG: Scraped from <200 http://ecr.manheim.co.uk/pdf/MOL-0003787909-01957651-002.pdf>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81ff3b9d-7da0-5b8a-a49c-6e2dea14306a/81ff3b9d-7da0-5b8a-a49c-6e2dea14306a_expert_report_file_6c6b96a6-6c8f-40c7-a56d-56fd7b4705f1.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003787909-01957651-002.pdf',
 'color': 'BLUE',
 'currency': 'GBP',
 'engine': '1.3L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Petrol/Hybrid',
 'id': '81ff3b9d-7da0-5b8a-a49c-6e2dea14306a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'DY22XLM',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=3787909',
 'listing': 'auction',
 'location': 'Bristol',
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 91324,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 53,
 'photo_urls': ['http://images.manheim.co.uk/images/units/zoom/ed3e38ce-5da8-483d-83b7-077a743405c8_ext_7.jpg',
                'http://images.manheim.co.uk/images/units/zoom/ed3e38ce-5da8-483d-83b7-077a743405c8_ext_7.jpg',
                'http://images.manheim.co.uk/images/units/zoom/ed3e38ce-5da8-483d-83b7-077a743405c8_ext_6.jpg',
                'http://images.manheim.co.uk/images/units/zoom/ed3e38ce-5da8-483d-83b7-077a743405c8_ext_1.jpg',
                'http://images.manheim.co.uk/images/units/zoom/ed3e38ce-5da8-483d-83b7-077a743405c8_5.jpg',
                'http://images.manheim.co.uk/images/units/zoom/ed3e38ce-5da8-483d-83b7-077a743405c8_4.jpg',
                'http://images.manheim.co.uk/images/units/zoom/ed3e38ce-5da8-483d-83b7-077a743405c8_11.jpg',
                'http://images.manheim.co.uk/images/units/zoom/ed3e38ce-5da8-483d-83b7-077a743405c8_10.jpg',
                'http://images.manheim.co.uk/images/units/zoom/ed3e38ce-5da8-483d-83b7-077a743405c8_9.jpg',
                'http://images.manheim.co.uk/images/units/zoom/ed3e38ce-5da8-483d-83b7-077a743405c8_ext_2.jpg',
                'http://images.manheim.co.uk/images/units/zoom/ed3e38ce-5da8-483d-83b7-077a743405c8_ext_5.jpg',
                'http://images.manheim.co.uk/images/units/zoom/ed3e38ce-5da8-483d-83b7-077a743405c8_ext_3.jpg',
                'http://images.manheim.co.uk/images/units/zoom/ed3e38ce-5da8-483d-83b7-077a743405c8_ext_4.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3787909-3983571-13.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3787909-3983571-1000.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3787909-3983571-1001.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3787909-3983571-1002.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3787909-3983571-1003.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3787909-3983571-1004.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3787909-3983571-1005.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81ff3b9d-7da0-5b8a-a49c-6e2dea14306a/81ff3b9d-7da0-5b8a-a49c-6e2dea14306a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 286955,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/ed3e38ce-5da8-483d-83b7-077a743405c8_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81ff3b9d-7da0-5b8a-a49c-6e2dea14306a/81ff3b9d-7da0-5b8a-a49c-6e2dea14306a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 286955,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/ed3e38ce-5da8-483d-83b7-077a743405c8_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81ff3b9d-7da0-5b8a-a49c-6e2dea14306a/81ff3b9d-7da0-5b8a-a49c-6e2dea14306a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 271208,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/ed3e38ce-5da8-483d-83b7-077a743405c8_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81ff3b9d-7da0-5b8a-a49c-6e2dea14306a/81ff3b9d-7da0-5b8a-a49c-6e2dea14306a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 167202,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/ed3e38ce-5da8-483d-83b7-077a743405c8_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81ff3b9d-7da0-5b8a-a49c-6e2dea14306a/81ff3b9d-7da0-5b8a-a49c-6e2dea14306a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 268354,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/ed3e38ce-5da8-483d-83b7-077a743405c8_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81ff3b9d-7da0-5b8a-a49c-6e2dea14306a/81ff3b9d-7da0-5b8a-a49c-6e2dea14306a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 267214,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/ed3e38ce-5da8-483d-83b7-077a743405c8_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81ff3b9d-7da0-5b8a-a49c-6e2dea14306a/81ff3b9d-7da0-5b8a-a49c-6e2dea14306a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 283586,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/ed3e38ce-5da8-483d-83b7-077a743405c8_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81ff3b9d-7da0-5b8a-a49c-6e2dea14306a/81ff3b9d-7da0-5b8a-a49c-6e2dea14306a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 259576,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/ed3e38ce-5da8-483d-83b7-077a743405c8_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81ff3b9d-7da0-5b8a-a49c-6e2dea14306a/81ff3b9d-7da0-5b8a-a49c-6e2dea14306a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 285218,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/ed3e38ce-5da8-483d-83b7-077a743405c8_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81ff3b9d-7da0-5b8a-a49c-6e2dea14306a/81ff3b9d-7da0-5b8a-a49c-6e2dea14306a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 254368,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/ed3e38ce-5da8-483d-83b7-077a743405c8_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81ff3b9d-7da0-5b8a-a49c-6e2dea14306a/81ff3b9d-7da0-5b8a-a49c-6e2dea14306a_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 262848,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/ed3e38ce-5da8-483d-83b7-077a743405c8_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81ff3b9d-7da0-5b8a-a49c-6e2dea14306a/81ff3b9d-7da0-5b8a-a49c-6e2dea14306a_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 255133,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/ed3e38ce-5da8-483d-83b7-077a743405c8_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81ff3b9d-7da0-5b8a-a49c-6e2dea14306a/81ff3b9d-7da0-5b8a-a49c-6e2dea14306a_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 191528,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/ed3e38ce-5da8-483d-83b7-077a743405c8_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81ff3b9d-7da0-5b8a-a49c-6e2dea14306a/81ff3b9d-7da0-5b8a-a49c-6e2dea14306a_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 281514,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3787909-3983571-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81ff3b9d-7da0-5b8a-a49c-6e2dea14306a/81ff3b9d-7da0-5b8a-a49c-6e2dea14306a_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 238702,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3787909-3983571-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81ff3b9d-7da0-5b8a-a49c-6e2dea14306a/81ff3b9d-7da0-5b8a-a49c-6e2dea14306a_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 215515,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3787909-3983571-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81ff3b9d-7da0-5b8a-a49c-6e2dea14306a/81ff3b9d-7da0-5b8a-a49c-6e2dea14306a_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 306700,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3787909-3983571-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81ff3b9d-7da0-5b8a-a49c-6e2dea14306a/81ff3b9d-7da0-5b8a-a49c-6e2dea14306a_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 221758,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3787909-3983571-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81ff3b9d-7da0-5b8a-a49c-6e2dea14306a/81ff3b9d-7da0-5b8a-a49c-6e2dea14306a_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 248980,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3787909-3983571-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81ff3b9d-7da0-5b8a-a49c-6e2dea14306a/81ff3b9d-7da0-5b8a-a49c-6e2dea14306a_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 261547,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3787909-3983571-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-21',
 'seller_name': 'Novuna Vehicle Solutions',
 'title': 'NISSAN QASHQAI 1.3 DiG-T MH 158 N-Connecta 5dr Xtronic',
 'transmission': 'automatic',
 'trim': '1.3 DiG-T MH 158 N-Connecta 5dr Xtronic',
 'year': 2022}
2025-12-05 06:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273787909%27 HTTP/1.1" 200 None
2025-12-05 06:05:49 [manheim.gb] INFO: Saving data for 3787909: {'created_time': 1764914749.362222, 'last_price_update_time': 1764914749.362233, 'auction_closing_time': 1765270800.0}
2025-12-05 06:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3787909') HTTP/1.1" 204 0
2025-12-05 06:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb030e6f4-9391-4de0-8fec-af2207dbb9e8_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b030e6f4-9391-4de0-8fec-af2207dbb9e8_ext_1.jpg not downloaded yet
2025-12-05 06:05:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234239b610>
2025-12-05 06:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af206730-ce81-5a8d-a5c0-55195b37ece3/af206730-ce81-5a8d-a5c0-55195b37ece3_image_7.jpg HTTP/1.1" 201 0
2025-12-05 06:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe38b8d11-ab3a-4a6b-8cb1-33754a090158_10.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e38b8d11-ab3a-4a6b-8cb1-33754a090158_10.jpg saved to cache
2025-12-05 06:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item af206730-ce81-5a8d-a5c0-55195b37ece3
2025-12-05 06:05:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23415c3b50>
2025-12-05 06:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93cd6882-73c5-537b-81f0-b25d161c1962/93cd6882-73c5-537b-81f0-b25d161c1962_image_4.jpg HTTP/1.1" 201 0
2025-12-05 06:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7d630588-8108-4ffd-b12a-2f8326b77e27_5.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7d630588-8108-4ffd-b12a-2f8326b77e27_5.jpg saved to cache
2025-12-05 06:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 93cd6882-73c5-537b-81f0-b25d161c1962
2025-12-05 06:05:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10b93c70-9ccd-5c79-bbc5-6fb60601b311 with identifier: 3791288
2025-12-05 06:05:49 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 10b93c70-9ccd-5c79-bbc5-6fb60601b311
2025-12-05 06:05:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234246ad10>
2025-12-05 06:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af206730-ce81-5a8d-a5c0-55195b37ece3/af206730-ce81-5a8d-a5c0-55195b37ece3_image_6.jpg HTTP/1.1" 201 0
2025-12-05 06:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe38b8d11-ab3a-4a6b-8cb1-33754a090158_11.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e38b8d11-ab3a-4a6b-8cb1-33754a090158_11.jpg saved to cache
2025-12-05 06:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item af206730-ce81-5a8d-a5c0-55195b37ece3
2025-12-05 06:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb030e6f4-9391-4de0-8fec-af2207dbb9e8_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b030e6f4-9391-4de0-8fec-af2207dbb9e8_5.jpg not downloaded yet
2025-12-05 06:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb030e6f4-9391-4de0-8fec-af2207dbb9e8_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b030e6f4-9391-4de0-8fec-af2207dbb9e8_4.jpg not downloaded yet
2025-12-05 06:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb030e6f4-9391-4de0-8fec-af2207dbb9e8_11.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b030e6f4-9391-4de0-8fec-af2207dbb9e8_11.jpg not downloaded yet
2025-12-05 06:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb030e6f4-9391-4de0-8fec-af2207dbb9e8_10.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b030e6f4-9391-4de0-8fec-af2207dbb9e8_10.jpg not downloaded yet
2025-12-05 06:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb030e6f4-9391-4de0-8fec-af2207dbb9e8_9.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b030e6f4-9391-4de0-8fec-af2207dbb9e8_9.jpg not downloaded yet
2025-12-05 06:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb030e6f4-9391-4de0-8fec-af2207dbb9e8_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b030e6f4-9391-4de0-8fec-af2207dbb9e8_ext_2.jpg not downloaded yet
2025-12-05 06:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb030e6f4-9391-4de0-8fec-af2207dbb9e8_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b030e6f4-9391-4de0-8fec-af2207dbb9e8_ext_5.jpg not downloaded yet
2025-12-05 06:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb030e6f4-9391-4de0-8fec-af2207dbb9e8_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b030e6f4-9391-4de0-8fec-af2207dbb9e8_ext_3.jpg not downloaded yet
2025-12-05 06:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb030e6f4-9391-4de0-8fec-af2207dbb9e8_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b030e6f4-9391-4de0-8fec-af2207dbb9e8_ext_4.jpg not downloaded yet
2025-12-05 06:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3794180-4003000-13.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3794180-4003000-13.jpg not downloaded yet
2025-12-05 06:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3794180-4003000-1000.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3794180-4003000-1000.jpg not downloaded yet
2025-12-05 06:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3794180-4003000-1001.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3794180-4003000-1001.jpg not downloaded yet
2025-12-05 06:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3794180-4003000-1002.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3794180-4003000-1002.jpg not downloaded yet
2025-12-05 06:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3794180-4003000-1003.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3794180-4003000-1003.jpg not downloaded yet
2025-12-05 06:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3794180-4003000-1004.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3794180-4003000-1004.jpg not downloaded yet
2025-12-05 06:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3794180-4003000-1005.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3794180-4003000-1005.jpg not downloaded yet
2025-12-05 06:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/b030e6f4-9391-4de0-8fec-af2207dbb9e8_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003794180-01983300-003.pdf)
2025-12-05 06:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/b030e6f4-9391-4de0-8fec-af2207dbb9e8_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003794180-01983300-003.pdf)
2025-12-05 06:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/b030e6f4-9391-4de0-8fec-af2207dbb9e8_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003794180-01983300-003.pdf)
2025-12-05 06:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7d630588-8108-4ffd-b12a-2f8326b77e27_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003805780-01983849-002.pdf)
2025-12-05 06:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/b030e6f4-9391-4de0-8fec-af2207dbb9e8_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003794180-01983300-003.pdf)
2025-12-05 06:05:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341ed5b10>
2025-12-05 06:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_179fc562-a6f2-5445-a27d-e74322b881ba/179fc562-a6f2-5445-a27d-e74322b881ba_image_3.jpg HTTP/1.1" 201 0
2025-12-05 06:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb030e6f4-9391-4de0-8fec-af2207dbb9e8_ext_1.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b030e6f4-9391-4de0-8fec-af2207dbb9e8_ext_1.jpg saved to cache
2025-12-05 06:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 179fc562-a6f2-5445-a27d-e74322b881ba
2025-12-05 06:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3794180-4003000-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003794180-01983300-003.pdf)
2025-12-05 06:05:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341f300d0>
2025-12-05 06:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_179fc562-a6f2-5445-a27d-e74322b881ba/179fc562-a6f2-5445-a27d-e74322b881ba_image_1.jpg HTTP/1.1" 201 0
2025-12-05 06:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb030e6f4-9391-4de0-8fec-af2207dbb9e8_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b030e6f4-9391-4de0-8fec-af2207dbb9e8_ext_7.jpg saved to cache
2025-12-05 06:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 179fc562-a6f2-5445-a27d-e74322b881ba
2025-12-05 06:05:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342510310>
2025-12-05 06:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_179fc562-a6f2-5445-a27d-e74322b881ba/179fc562-a6f2-5445-a27d-e74322b881ba_image_0.jpg HTTP/1.1" 201 0
2025-12-05 06:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb030e6f4-9391-4de0-8fec-af2207dbb9e8_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b030e6f4-9391-4de0-8fec-af2207dbb9e8_ext_7.jpg saved to cache
2025-12-05 06:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 179fc562-a6f2-5445-a27d-e74322b881ba
2025-12-05 06:05:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23426e6450>
2025-12-05 06:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93cd6882-73c5-537b-81f0-b25d161c1962/93cd6882-73c5-537b-81f0-b25d161c1962_image_3.jpg HTTP/1.1" 201 0
2025-12-05 06:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7d630588-8108-4ffd-b12a-2f8326b77e27_ext_1.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7d630588-8108-4ffd-b12a-2f8326b77e27_ext_1.jpg saved to cache
2025-12-05 06:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 93cd6882-73c5-537b-81f0-b25d161c1962
2025-12-05 06:05:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234270fb90>
2025-12-05 06:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_179fc562-a6f2-5445-a27d-e74322b881ba/179fc562-a6f2-5445-a27d-e74322b881ba_image_2.jpg HTTP/1.1" 201 0
2025-12-05 06:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb030e6f4-9391-4de0-8fec-af2207dbb9e8_ext_6.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b030e6f4-9391-4de0-8fec-af2207dbb9e8_ext_6.jpg saved to cache
2025-12-05 06:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 179fc562-a6f2-5445-a27d-e74322b881ba
2025-12-05 06:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3794180-4003000-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003794180-01983300-003.pdf)
2025-12-05 06:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3794180-4003000-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003794180-01983300-003.pdf)
2025-12-05 06:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3794180-4003000-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003794180-01983300-003.pdf)
2025-12-05 06:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VAUXHALL/GRANDLAND?id=3787547&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233787547&indx=302> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:05:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:05:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342562350>
2025-12-05 06:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_179fc562-a6f2-5445-a27d-e74322b881ba/179fc562-a6f2-5445-a27d-e74322b881ba_image_19.jpg HTTP/1.1" 201 0
2025-12-05 06:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3794180-4003000-1005.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3794180-4003000-1005.jpg saved to cache
2025-12-05 06:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 179fc562-a6f2-5445-a27d-e74322b881ba
2025-12-05 06:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3794180-4003000-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003794180-01983300-003.pdf)
2025-12-05 06:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/b030e6f4-9391-4de0-8fec-af2207dbb9e8_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003794180-01983300-003.pdf)
2025-12-05 06:05:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234247a490>
2025-12-05 06:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 06:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_179fc562-a6f2-5445-a27d-e74322b881ba/179fc562-a6f2-5445-a27d-e74322b881ba_image_18.jpg HTTP/1.1" 201 0
2025-12-05 06:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3794180-4003000-1004.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3794180-4003000-1004.jpg saved to cache
2025-12-05 06:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 179fc562-a6f2-5445-a27d-e74322b881ba
2025-12-05 06:05:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425b38d0>
2025-12-05 06:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_179fc562-a6f2-5445-a27d-e74322b881ba/179fc562-a6f2-5445-a27d-e74322b881ba_image_15.jpg HTTP/1.1" 201 0
2025-12-05 06:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3794180-4003000-1001.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3794180-4003000-1001.jpg saved to cache
2025-12-05 06:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 179fc562-a6f2-5445-a27d-e74322b881ba
2025-12-05 06:05:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234245da50>
2025-12-05 06:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_179fc562-a6f2-5445-a27d-e74322b881ba/179fc562-a6f2-5445-a27d-e74322b881ba_image_16.jpg HTTP/1.1" 201 0
2025-12-05 06:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3794180-4003000-1002.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3794180-4003000-1002.jpg saved to cache
2025-12-05 06:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 179fc562-a6f2-5445-a27d-e74322b881ba
2025-12-05 06:05:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 301a1c7b-dc57-5e53-a180-51a6be347921 with identifier: 3787547
2025-12-05 06:05:53 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 301a1c7b-dc57-5e53-a180-51a6be347921
2025-12-05 06:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3794180-4003000-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003794180-01983300-003.pdf)
2025-12-05 06:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3794180-4003000-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003794180-01983300-003.pdf)
2025-12-05 06:05:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234247b710>
2025-12-05 06:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_179fc562-a6f2-5445-a27d-e74322b881ba/179fc562-a6f2-5445-a27d-e74322b881ba_image_17.jpg HTTP/1.1" 201 0
2025-12-05 06:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3794180-4003000-1003.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3794180-4003000-1003.jpg saved to cache
2025-12-05 06:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 179fc562-a6f2-5445-a27d-e74322b881ba
2025-12-05 06:05:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234246a0d0>
2025-12-05 06:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_179fc562-a6f2-5445-a27d-e74322b881ba/179fc562-a6f2-5445-a27d-e74322b881ba_image_12.jpg HTTP/1.1" 201 0
2025-12-05 06:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb030e6f4-9391-4de0-8fec-af2207dbb9e8_ext_4.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b030e6f4-9391-4de0-8fec-af2207dbb9e8_ext_4.jpg saved to cache
2025-12-05 06:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 179fc562-a6f2-5445-a27d-e74322b881ba
2025-12-05 06:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/b030e6f4-9391-4de0-8fec-af2207dbb9e8_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003794180-01983300-003.pdf)
2025-12-05 06:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/b030e6f4-9391-4de0-8fec-af2207dbb9e8_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003794180-01983300-003.pdf)
2025-12-05 06:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/b030e6f4-9391-4de0-8fec-af2207dbb9e8_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003794180-01983300-003.pdf)
2025-12-05 06:05:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342741e10>
2025-12-05 06:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_179fc562-a6f2-5445-a27d-e74322b881ba/179fc562-a6f2-5445-a27d-e74322b881ba_image_14.jpg HTTP/1.1" 201 0
2025-12-05 06:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3794180-4003000-1000.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3794180-4003000-1000.jpg saved to cache
2025-12-05 06:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 179fc562-a6f2-5445-a27d-e74322b881ba
2025-12-05 06:05:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234257abd0>
2025-12-05 06:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_179fc562-a6f2-5445-a27d-e74322b881ba/179fc562-a6f2-5445-a27d-e74322b881ba_image_13.jpg HTTP/1.1" 201 0
2025-12-05 06:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3794180-4003000-13.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3794180-4003000-13.jpg saved to cache
2025-12-05 06:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 179fc562-a6f2-5445-a27d-e74322b881ba
2025-12-05 06:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/b030e6f4-9391-4de0-8fec-af2207dbb9e8_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003794180-01983300-003.pdf)
2025-12-05 06:05:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341f32550>
2025-12-05 06:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_179fc562-a6f2-5445-a27d-e74322b881ba/179fc562-a6f2-5445-a27d-e74322b881ba_image_10.jpg HTTP/1.1" 201 0
2025-12-05 06:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb030e6f4-9391-4de0-8fec-af2207dbb9e8_ext_5.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b030e6f4-9391-4de0-8fec-af2207dbb9e8_ext_5.jpg saved to cache
2025-12-05 06:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 179fc562-a6f2-5445-a27d-e74322b881ba
2025-12-05 06:05:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2343c39ed0>
2025-12-05 06:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_179fc562-a6f2-5445-a27d-e74322b881ba/179fc562-a6f2-5445-a27d-e74322b881ba_image_9.jpg HTTP/1.1" 201 0
2025-12-05 06:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb030e6f4-9391-4de0-8fec-af2207dbb9e8_ext_2.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b030e6f4-9391-4de0-8fec-af2207dbb9e8_ext_2.jpg saved to cache
2025-12-05 06:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 179fc562-a6f2-5445-a27d-e74322b881ba
2025-12-05 06:05:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341eb14d0>
2025-12-05 06:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_179fc562-a6f2-5445-a27d-e74322b881ba/179fc562-a6f2-5445-a27d-e74322b881ba_image_11.jpg HTTP/1.1" 201 0
2025-12-05 06:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb030e6f4-9391-4de0-8fec-af2207dbb9e8_ext_3.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b030e6f4-9391-4de0-8fec-af2207dbb9e8_ext_3.jpg saved to cache
2025-12-05 06:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 179fc562-a6f2-5445-a27d-e74322b881ba
2025-12-05 06:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/b030e6f4-9391-4de0-8fec-af2207dbb9e8_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003794180-01983300-003.pdf)
2025-12-05 06:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/b030e6f4-9391-4de0-8fec-af2207dbb9e8_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003794180-01983300-003.pdf)
2025-12-05 06:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/b030e6f4-9391-4de0-8fec-af2207dbb9e8_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003794180-01983300-003.pdf)
2025-12-05 06:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/b030e6f4-9391-4de0-8fec-af2207dbb9e8_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003794180-01983300-003.pdf)
2025-12-05 06:05:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23428c6b50>
2025-12-05 06:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_179fc562-a6f2-5445-a27d-e74322b881ba/179fc562-a6f2-5445-a27d-e74322b881ba_image_8.jpg HTTP/1.1" 201 0
2025-12-05 06:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb030e6f4-9391-4de0-8fec-af2207dbb9e8_9.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b030e6f4-9391-4de0-8fec-af2207dbb9e8_9.jpg saved to cache
2025-12-05 06:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 179fc562-a6f2-5445-a27d-e74322b881ba
2025-12-05 06:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e38b8d11-ab3a-4a6b-8cb1-33754a090158_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003805781-01983875-002.pdf)
2025-12-05 06:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e38b8d11-ab3a-4a6b-8cb1-33754a090158_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003805781-01983875-002.pdf)
2025-12-05 06:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7d630588-8108-4ffd-b12a-2f8326b77e27_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003805780-01983849-002.pdf)
2025-12-05 06:05:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234157fc90>
2025-12-05 06:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_179fc562-a6f2-5445-a27d-e74322b881ba/179fc562-a6f2-5445-a27d-e74322b881ba_image_5.jpg HTTP/1.1" 201 0
2025-12-05 06:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb030e6f4-9391-4de0-8fec-af2207dbb9e8_4.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b030e6f4-9391-4de0-8fec-af2207dbb9e8_4.jpg saved to cache
2025-12-05 06:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 179fc562-a6f2-5445-a27d-e74322b881ba
2025-12-05 06:05:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342374090>
2025-12-05 06:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_179fc562-a6f2-5445-a27d-e74322b881ba/179fc562-a6f2-5445-a27d-e74322b881ba_image_6.jpg HTTP/1.1" 201 0
2025-12-05 06:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb030e6f4-9391-4de0-8fec-af2207dbb9e8_11.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b030e6f4-9391-4de0-8fec-af2207dbb9e8_11.jpg saved to cache
2025-12-05 06:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 179fc562-a6f2-5445-a27d-e74322b881ba
2025-12-05 06:05:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23415a7390>
2025-12-05 06:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_179fc562-a6f2-5445-a27d-e74322b881ba/179fc562-a6f2-5445-a27d-e74322b881ba_image_4.jpg HTTP/1.1" 201 0
2025-12-05 06:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb030e6f4-9391-4de0-8fec-af2207dbb9e8_5.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b030e6f4-9391-4de0-8fec-af2207dbb9e8_5.jpg saved to cache
2025-12-05 06:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 179fc562-a6f2-5445-a27d-e74322b881ba
2025-12-05 06:05:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342496bd0>
2025-12-05 06:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_179fc562-a6f2-5445-a27d-e74322b881ba/179fc562-a6f2-5445-a27d-e74322b881ba_image_7.jpg HTTP/1.1" 201 0
2025-12-05 06:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb030e6f4-9391-4de0-8fec-af2207dbb9e8_10.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b030e6f4-9391-4de0-8fec-af2207dbb9e8_10.jpg saved to cache
2025-12-05 06:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 179fc562-a6f2-5445-a27d-e74322b881ba
2025-12-05 06:05:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 179fc562-a6f2-5445-a27d-e74322b881ba, skipping ID generation
2025-12-05 06:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 179fc562-a6f2-5445-a27d-e74322b881ba from tracking dictionaries
2025-12-05 06:05:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 179fc562-a6f2-5445-a27d-e74322b881ba sending to next pipeline
2025-12-05 06:05:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 179fc562-a6f2-5445-a27d-e74322b881ba, identifier: 3794180
2025-12-05 06:05:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 179fc562-a6f2-5445-a27d-e74322b881ba with identifier: 3794180
2025-12-05 06:05:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 179fc562-a6f2-5445-a27d-e74322b881ba with identifier: 3794180
2025-12-05 06:05:57 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 179fc562-a6f2-5445-a27d-e74322b881ba with identifier: 3794180 to the API
2025-12-05 06:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 06:05:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 06:05:57 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/b030e6f4-9391-4de0-8fec-af2207dbb9e8_10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 32,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_179fc562-a6f2-5445-a27d-e74322b881ba/179fc562-a6f2-5445-a27d-e74322b881ba_expert_report_file_2db248a3-6653-4b3d-9b84-e07c9718d835.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003794180-01983300-003.pdf',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Petrol/Hybrid',
 'id': '179fc562-a6f2-5445-a27d-e74322b881ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'MT22PYJ',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/PEUGEOT/3008?id=3794180',
 'listing': 'auction',
 'location': 'Bristol',
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 43244,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 35,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_179fc562-a6f2-5445-a27d-e74322b881ba/179fc562-a6f2-5445-a27d-e74322b881ba_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 275638,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b030e6f4-9391-4de0-8fec-af2207dbb9e8_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_179fc562-a6f2-5445-a27d-e74322b881ba/179fc562-a6f2-5445-a27d-e74322b881ba_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 275638,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b030e6f4-9391-4de0-8fec-af2207dbb9e8_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_179fc562-a6f2-5445-a27d-e74322b881ba/179fc562-a6f2-5445-a27d-e74322b881ba_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 212849,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b030e6f4-9391-4de0-8fec-af2207dbb9e8_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_179fc562-a6f2-5445-a27d-e74322b881ba/179fc562-a6f2-5445-a27d-e74322b881ba_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 166462,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b030e6f4-9391-4de0-8fec-af2207dbb9e8_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_179fc562-a6f2-5445-a27d-e74322b881ba/179fc562-a6f2-5445-a27d-e74322b881ba_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 259258,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b030e6f4-9391-4de0-8fec-af2207dbb9e8_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_179fc562-a6f2-5445-a27d-e74322b881ba/179fc562-a6f2-5445-a27d-e74322b881ba_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 248312,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b030e6f4-9391-4de0-8fec-af2207dbb9e8_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_179fc562-a6f2-5445-a27d-e74322b881ba/179fc562-a6f2-5445-a27d-e74322b881ba_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 250350,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b030e6f4-9391-4de0-8fec-af2207dbb9e8_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_179fc562-a6f2-5445-a27d-e74322b881ba/179fc562-a6f2-5445-a27d-e74322b881ba_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 210437,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b030e6f4-9391-4de0-8fec-af2207dbb9e8_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_179fc562-a6f2-5445-a27d-e74322b881ba/179fc562-a6f2-5445-a27d-e74322b881ba_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 248575,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b030e6f4-9391-4de0-8fec-af2207dbb9e8_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_179fc562-a6f2-5445-a27d-e74322b881ba/179fc562-a6f2-5445-a27d-e74322b881ba_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 230951,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b030e6f4-9391-4de0-8fec-af2207dbb9e8_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_179fc562-a6f2-5445-a27d-e74322b881ba/179fc562-a6f2-5445-a27d-e74322b881ba_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 201397,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b030e6f4-9391-4de0-8fec-af2207dbb9e8_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_179fc562-a6f2-5445-a27d-e74322b881ba/179fc562-a6f2-5445-a27d-e74322b881ba_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 197304,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b030e6f4-9391-4de0-8fec-af2207dbb9e8_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_179fc562-a6f2-5445-a27d-e74322b881ba/179fc562-a6f2-5445-a27d-e74322b881ba_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 146929,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b030e6f4-9391-4de0-8fec-af2207dbb9e8_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_179fc562-a6f2-5445-a27d-e74322b881ba/179fc562-a6f2-5445-a27d-e74322b881ba_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 401912,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3794180-4003000-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_179fc562-a6f2-5445-a27d-e74322b881ba/179fc562-a6f2-5445-a27d-e74322b881ba_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 283953,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3794180-4003000-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_179fc562-a6f2-5445-a27d-e74322b881ba/179fc562-a6f2-5445-a27d-e74322b881ba_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 391290,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3794180-4003000-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_179fc562-a6f2-5445-a27d-e74322b881ba/179fc562-a6f2-5445-a27d-e74322b881ba_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 229711,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3794180-4003000-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_179fc562-a6f2-5445-a27d-e74322b881ba/179fc562-a6f2-5445-a27d-e74322b881ba_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 423712,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3794180-4003000-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_179fc562-a6f2-5445-a27d-e74322b881ba/179fc562-a6f2-5445-a27d-e74322b881ba_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347193,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3794180-4003000-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_179fc562-a6f2-5445-a27d-e74322b881ba/179fc562-a6f2-5445-a27d-e74322b881ba_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 184417,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3794180-4003000-1005.jpg',
             'Width': 749}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-27',
 'seller_name': 'Novuna Vehicle Solutions',
 'title': 'PEUGEOT 3008 1.6 Hybrid 225 GT Premium 5dr e-EAT8',
 'transmission': 'automatic',
 'trim': '1.6 Hybrid 225 GT Premium 5dr e-EAT8',
 'year': 2022}
2025-12-05 06:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273794180%27 HTTP/1.1" 200 None
2025-12-05 06:05:57 [manheim.gb] INFO: Saving data for 3794180: {'created_time': 1764914757.648159, 'last_price_update_time': 1764914757.648169, 'auction_closing_time': 1765270800.0}
2025-12-05 06:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3794180') HTTP/1.1" 204 0
2025-12-05 06:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e38b8d11-ab3a-4a6b-8cb1-33754a090158_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003805781-01983875-002.pdf)
2025-12-05 06:05:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342756450>
2025-12-05 06:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af206730-ce81-5a8d-a5c0-55195b37ece3/af206730-ce81-5a8d-a5c0-55195b37ece3_image_4.jpg HTTP/1.1" 201 0
2025-12-05 06:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe38b8d11-ab3a-4a6b-8cb1-33754a090158_5.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e38b8d11-ab3a-4a6b-8cb1-33754a090158_5.jpg saved to cache
2025-12-05 06:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item af206730-ce81-5a8d-a5c0-55195b37ece3
2025-12-05 06:05:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23426ad950>
2025-12-05 06:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af206730-ce81-5a8d-a5c0-55195b37ece3/af206730-ce81-5a8d-a5c0-55195b37ece3_image_5.jpg HTTP/1.1" 201 0
2025-12-05 06:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe38b8d11-ab3a-4a6b-8cb1-33754a090158_4.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e38b8d11-ab3a-4a6b-8cb1-33754a090158_4.jpg saved to cache
2025-12-05 06:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item af206730-ce81-5a8d-a5c0-55195b37ece3
2025-12-05 06:05:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23415a0f50>
2025-12-05 06:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93cd6882-73c5-537b-81f0-b25d161c1962/93cd6882-73c5-537b-81f0-b25d161c1962_image_2.jpg HTTP/1.1" 201 0
2025-12-05 06:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7d630588-8108-4ffd-b12a-2f8326b77e27_ext_6.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7d630588-8108-4ffd-b12a-2f8326b77e27_ext_6.jpg saved to cache
2025-12-05 06:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 93cd6882-73c5-537b-81f0-b25d161c1962
2025-12-05 06:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7d630588-8108-4ffd-b12a-2f8326b77e27_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003805780-01983849-002.pdf)
2025-12-05 06:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7d630588-8108-4ffd-b12a-2f8326b77e27_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003805780-01983849-002.pdf)
2025-12-05 06:05:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341edc290>
2025-12-05 06:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af206730-ce81-5a8d-a5c0-55195b37ece3/af206730-ce81-5a8d-a5c0-55195b37ece3_image_3.jpg HTTP/1.1" 201 0
2025-12-05 06:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe38b8d11-ab3a-4a6b-8cb1-33754a090158_ext_1.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e38b8d11-ab3a-4a6b-8cb1-33754a090158_ext_1.jpg saved to cache
2025-12-05 06:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item af206730-ce81-5a8d-a5c0-55195b37ece3
2025-12-05 06:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e38b8d11-ab3a-4a6b-8cb1-33754a090158_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003805781-01983875-002.pdf)
2025-12-05 06:05:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342643b90>
2025-12-05 06:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93cd6882-73c5-537b-81f0-b25d161c1962/93cd6882-73c5-537b-81f0-b25d161c1962_image_1.jpg HTTP/1.1" 201 0
2025-12-05 06:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7d630588-8108-4ffd-b12a-2f8326b77e27_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7d630588-8108-4ffd-b12a-2f8326b77e27_ext_7.jpg saved to cache
2025-12-05 06:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 93cd6882-73c5-537b-81f0-b25d161c1962
2025-12-05 06:05:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234155c7d0>
2025-12-05 06:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:05:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93cd6882-73c5-537b-81f0-b25d161c1962/93cd6882-73c5-537b-81f0-b25d161c1962_image_0.jpg HTTP/1.1" 201 0
2025-12-05 06:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7d630588-8108-4ffd-b12a-2f8326b77e27_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 06:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7d630588-8108-4ffd-b12a-2f8326b77e27_ext_7.jpg saved to cache
2025-12-05 06:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 93cd6882-73c5-537b-81f0-b25d161c1962
2025-12-05 06:05:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 93cd6882-73c5-537b-81f0-b25d161c1962, skipping ID generation
2025-12-05 06:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 93cd6882-73c5-537b-81f0-b25d161c1962 from tracking dictionaries
2025-12-05 06:05:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 93cd6882-73c5-537b-81f0-b25d161c1962 sending to next pipeline
2025-12-05 06:05:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 93cd6882-73c5-537b-81f0-b25d161c1962, identifier: 3805780
2025-12-05 06:05:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 93cd6882-73c5-537b-81f0-b25d161c1962 with identifier: 3805780
2025-12-05 06:05:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 93cd6882-73c5-537b-81f0-b25d161c1962 with identifier: 3805780
2025-12-05 06:05:59 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 93cd6882-73c5-537b-81f0-b25d161c1962 with identifier: 3805780 to the API
2025-12-05 06:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 06:05:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 06:05:59 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/7d630588-8108-4ffd-b12a-2f8326b77e27_ext_7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93cd6882-73c5-537b-81f0-b25d161c1962/93cd6882-73c5-537b-81f0-b25d161c1962_expert_report_file_23c23a7c-4921-4152-afd8-e761d700a9cf.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003805780-01983849-002.pdf',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '93cd6882-73c5-537b-81f0-b25d161c1962',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'DS23PCF',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VAUXHALL/CORSA?id=3805780',
 'listing': 'auction',
 'location': 'Leeds',
 'make': 'VAUXHALL',
 'model': 'CORSA',
 'odometer': 23356,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 34,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93cd6882-73c5-537b-81f0-b25d161c1962/93cd6882-73c5-537b-81f0-b25d161c1962_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 218372,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7d630588-8108-4ffd-b12a-2f8326b77e27_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93cd6882-73c5-537b-81f0-b25d161c1962/93cd6882-73c5-537b-81f0-b25d161c1962_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 218372,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7d630588-8108-4ffd-b12a-2f8326b77e27_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93cd6882-73c5-537b-81f0-b25d161c1962/93cd6882-73c5-537b-81f0-b25d161c1962_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 208140,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7d630588-8108-4ffd-b12a-2f8326b77e27_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93cd6882-73c5-537b-81f0-b25d161c1962/93cd6882-73c5-537b-81f0-b25d161c1962_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93406,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7d630588-8108-4ffd-b12a-2f8326b77e27_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93cd6882-73c5-537b-81f0-b25d161c1962/93cd6882-73c5-537b-81f0-b25d161c1962_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 183478,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7d630588-8108-4ffd-b12a-2f8326b77e27_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93cd6882-73c5-537b-81f0-b25d161c1962/93cd6882-73c5-537b-81f0-b25d161c1962_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 184565,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7d630588-8108-4ffd-b12a-2f8326b77e27_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93cd6882-73c5-537b-81f0-b25d161c1962/93cd6882-73c5-537b-81f0-b25d161c1962_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 182987,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7d630588-8108-4ffd-b12a-2f8326b77e27_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93cd6882-73c5-537b-81f0-b25d161c1962/93cd6882-73c5-537b-81f0-b25d161c1962_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 162614,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7d630588-8108-4ffd-b12a-2f8326b77e27_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93cd6882-73c5-537b-81f0-b25d161c1962/93cd6882-73c5-537b-81f0-b25d161c1962_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 180194,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7d630588-8108-4ffd-b12a-2f8326b77e27_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93cd6882-73c5-537b-81f0-b25d161c1962/93cd6882-73c5-537b-81f0-b25d161c1962_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 312680,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7d630588-8108-4ffd-b12a-2f8326b77e27_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93cd6882-73c5-537b-81f0-b25d161c1962/93cd6882-73c5-537b-81f0-b25d161c1962_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 179663,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7d630588-8108-4ffd-b12a-2f8326b77e27_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93cd6882-73c5-537b-81f0-b25d161c1962/93cd6882-73c5-537b-81f0-b25d161c1962_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 235705,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7d630588-8108-4ffd-b12a-2f8326b77e27_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93cd6882-73c5-537b-81f0-b25d161c1962/93cd6882-73c5-537b-81f0-b25d161c1962_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 242734,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7d630588-8108-4ffd-b12a-2f8326b77e27_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93cd6882-73c5-537b-81f0-b25d161c1962/93cd6882-73c5-537b-81f0-b25d161c1962_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 493278,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3805780-4004239-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93cd6882-73c5-537b-81f0-b25d161c1962/93cd6882-73c5-537b-81f0-b25d161c1962_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 234851,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3805780-4004239-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93cd6882-73c5-537b-81f0-b25d161c1962/93cd6882-73c5-537b-81f0-b25d161c1962_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 411438,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3805780-4004239-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93cd6882-73c5-537b-81f0-b25d161c1962/93cd6882-73c5-537b-81f0-b25d161c1962_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 362640,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3805780-4004239-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93cd6882-73c5-537b-81f0-b25d161c1962/93cd6882-73c5-537b-81f0-b25d161c1962_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347817,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3805780-4004239-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93cd6882-73c5-537b-81f0-b25d161c1962/93cd6882-73c5-537b-81f0-b25d161c1962_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328694,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3805780-4004239-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93cd6882-73c5-537b-81f0-b25d161c1962/93cd6882-73c5-537b-81f0-b25d161c1962_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 344246,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3805780-4004239-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-30',
 'seller_name': 'Leasys',
 'title': 'VAUXHALL CORSA 1.2 Turbo Ultimate 5dr',
 'transmission': 'manual',
 'trim': '1.2 Turbo Ultimate 5dr',
 'year': 2023}
2025-12-05 06:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273805780%27 HTTP/1.1" 200 None
2025-12-05 06:05:59 [manheim.gb] INFO: Saving data for 3805780: {'created_time': 1764914759.871316, 'last_price_update_time': 1764914759.871331, 'auction_closing_time': 1765184400.0}
2025-12-05 06:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3805780') HTTP/1.1" 204 0
2025-12-05 06:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e38b8d11-ab3a-4a6b-8cb1-33754a090158_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003805781-01983875-002.pdf)
2025-12-05 06:05:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:05:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341598fd0>
2025-12-05 06:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af206730-ce81-5a8d-a5c0-55195b37ece3/af206730-ce81-5a8d-a5c0-55195b37ece3_image_0.jpg HTTP/1.1" 201 0
2025-12-05 06:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe38b8d11-ab3a-4a6b-8cb1-33754a090158_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e38b8d11-ab3a-4a6b-8cb1-33754a090158_ext_7.jpg saved to cache
2025-12-05 06:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item af206730-ce81-5a8d-a5c0-55195b37ece3
2025-12-05 06:06:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003805802-01952362-005.pdf> (referer: None)
2025-12-05 06:06:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2343d32650>
2025-12-05 06:06:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af206730-ce81-5a8d-a5c0-55195b37ece3/af206730-ce81-5a8d-a5c0-55195b37ece3_image_2.jpg HTTP/1.1" 201 0
2025-12-05 06:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe38b8d11-ab3a-4a6b-8cb1-33754a090158_ext_6.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e38b8d11-ab3a-4a6b-8cb1-33754a090158_ext_6.jpg saved to cache
2025-12-05 06:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item af206730-ce81-5a8d-a5c0-55195b37ece3
2025-12-05 06:06:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: af206730-ce81-5a8d-a5c0-55195b37ece3, skipping ID generation
2025-12-05 06:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Removing item af206730-ce81-5a8d-a5c0-55195b37ece3 from tracking dictionaries
2025-12-05 06:06:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item af206730-ce81-5a8d-a5c0-55195b37ece3 sending to next pipeline
2025-12-05 06:06:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: af206730-ce81-5a8d-a5c0-55195b37ece3, identifier: 3805781
2025-12-05 06:06:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: af206730-ce81-5a8d-a5c0-55195b37ece3 with identifier: 3805781
2025-12-05 06:06:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: af206730-ce81-5a8d-a5c0-55195b37ece3 with identifier: 3805781
2025-12-05 06:06:00 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: af206730-ce81-5a8d-a5c0-55195b37ece3 with identifier: 3805781 to the API
2025-12-05 06:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 06:06:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 06:06:01 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/e38b8d11-ab3a-4a6b-8cb1-33754a090158_ext_6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af206730-ce81-5a8d-a5c0-55195b37ece3/af206730-ce81-5a8d-a5c0-55195b37ece3_expert_report_file_44b17684-9741-43c0-b7b7-9d7f62f30a92.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003805781-01983875-002.pdf',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'af206730-ce81-5a8d-a5c0-55195b37ece3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'DS23PCU',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VAUXHALL/CORSA?id=3805781',
 'listing': 'auction',
 'location': 'Leeds',
 'make': 'VAUXHALL',
 'model': 'CORSA',
 'odometer': 25668,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af206730-ce81-5a8d-a5c0-55195b37ece3/af206730-ce81-5a8d-a5c0-55195b37ece3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 213299,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e38b8d11-ab3a-4a6b-8cb1-33754a090158_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af206730-ce81-5a8d-a5c0-55195b37ece3/af206730-ce81-5a8d-a5c0-55195b37ece3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 213299,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e38b8d11-ab3a-4a6b-8cb1-33754a090158_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af206730-ce81-5a8d-a5c0-55195b37ece3/af206730-ce81-5a8d-a5c0-55195b37ece3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 285794,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e38b8d11-ab3a-4a6b-8cb1-33754a090158_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af206730-ce81-5a8d-a5c0-55195b37ece3/af206730-ce81-5a8d-a5c0-55195b37ece3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 144454,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e38b8d11-ab3a-4a6b-8cb1-33754a090158_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af206730-ce81-5a8d-a5c0-55195b37ece3/af206730-ce81-5a8d-a5c0-55195b37ece3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 184152,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e38b8d11-ab3a-4a6b-8cb1-33754a090158_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af206730-ce81-5a8d-a5c0-55195b37ece3/af206730-ce81-5a8d-a5c0-55195b37ece3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 168380,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e38b8d11-ab3a-4a6b-8cb1-33754a090158_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af206730-ce81-5a8d-a5c0-55195b37ece3/af206730-ce81-5a8d-a5c0-55195b37ece3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 198008,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e38b8d11-ab3a-4a6b-8cb1-33754a090158_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af206730-ce81-5a8d-a5c0-55195b37ece3/af206730-ce81-5a8d-a5c0-55195b37ece3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 173065,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e38b8d11-ab3a-4a6b-8cb1-33754a090158_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af206730-ce81-5a8d-a5c0-55195b37ece3/af206730-ce81-5a8d-a5c0-55195b37ece3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 198372,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e38b8d11-ab3a-4a6b-8cb1-33754a090158_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af206730-ce81-5a8d-a5c0-55195b37ece3/af206730-ce81-5a8d-a5c0-55195b37ece3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 276712,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e38b8d11-ab3a-4a6b-8cb1-33754a090158_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af206730-ce81-5a8d-a5c0-55195b37ece3/af206730-ce81-5a8d-a5c0-55195b37ece3_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 270005,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e38b8d11-ab3a-4a6b-8cb1-33754a090158_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af206730-ce81-5a8d-a5c0-55195b37ece3/af206730-ce81-5a8d-a5c0-55195b37ece3_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 236403,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e38b8d11-ab3a-4a6b-8cb1-33754a090158_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af206730-ce81-5a8d-a5c0-55195b37ece3/af206730-ce81-5a8d-a5c0-55195b37ece3_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 187743,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e38b8d11-ab3a-4a6b-8cb1-33754a090158_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af206730-ce81-5a8d-a5c0-55195b37ece3/af206730-ce81-5a8d-a5c0-55195b37ece3_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 440169,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3805781-4004883-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af206730-ce81-5a8d-a5c0-55195b37ece3/af206730-ce81-5a8d-a5c0-55195b37ece3_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 316827,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3805781-4004883-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af206730-ce81-5a8d-a5c0-55195b37ece3/af206730-ce81-5a8d-a5c0-55195b37ece3_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 254035,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3805781-4004883-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af206730-ce81-5a8d-a5c0-55195b37ece3/af206730-ce81-5a8d-a5c0-55195b37ece3_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 264664,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3805781-4004883-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af206730-ce81-5a8d-a5c0-55195b37ece3/af206730-ce81-5a8d-a5c0-55195b37ece3_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 252754,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3805781-4004883-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af206730-ce81-5a8d-a5c0-55195b37ece3/af206730-ce81-5a8d-a5c0-55195b37ece3_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 241018,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3805781-4004883-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af206730-ce81-5a8d-a5c0-55195b37ece3/af206730-ce81-5a8d-a5c0-55195b37ece3_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 339835,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3805781-4004883-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-30',
 'seller_name': 'Leasys',
 'title': 'VAUXHALL CORSA 1.2 Turbo Ultimate 5dr',
 'transmission': 'manual',
 'trim': '1.2 Turbo Ultimate 5dr',
 'year': 2023}
2025-12-05 06:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273805781%27 HTTP/1.1" 200 None
2025-12-05 06:06:01 [manheim.gb] INFO: Saving data for 3805781: {'created_time': 1764914761.100978, 'last_price_update_time': 1764914761.100993, 'auction_closing_time': 1765184400.0}
2025-12-05 06:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3805781') HTTP/1.1" 204 0
2025-12-05 06:06:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23426e6a90>
2025-12-05 06:06:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_041c8cec-8167-5084-8ad7-2c260146c6b5/041c8cec-8167-5084-8ad7-2c260146c6b5_expert_report_file_684cbdb0-9b90-4556-a210-85fd0d54f2c9.pdf HTTP/1.1" 201 0
2025-12-05 06:06:01 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 041c8cec-8167-5084-8ad7-2c260146c6b5
2025-12-05 06:06:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 041c8cec-8167-5084-8ad7-2c260146c6b5, skipping ID generation
2025-12-05 06:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 041c8cec-8167-5084-8ad7-2c260146c6b5
2025-12-05 06:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F980fa3c0-35b7-4fa4-9b6e-282c462ec266_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/980fa3c0-35b7-4fa4-9b6e-282c462ec266_ext_7.jpg not downloaded yet
2025-12-05 06:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F980fa3c0-35b7-4fa4-9b6e-282c462ec266_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/980fa3c0-35b7-4fa4-9b6e-282c462ec266_ext_7.jpg not downloaded yet
2025-12-05 06:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F980fa3c0-35b7-4fa4-9b6e-282c462ec266_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/980fa3c0-35b7-4fa4-9b6e-282c462ec266_ext_6.jpg not downloaded yet
2025-12-05 06:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F980fa3c0-35b7-4fa4-9b6e-282c462ec266_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/980fa3c0-35b7-4fa4-9b6e-282c462ec266_ext_1.jpg not downloaded yet
2025-12-05 06:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F980fa3c0-35b7-4fa4-9b6e-282c462ec266_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/980fa3c0-35b7-4fa4-9b6e-282c462ec266_5.jpg not downloaded yet
2025-12-05 06:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F980fa3c0-35b7-4fa4-9b6e-282c462ec266_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/980fa3c0-35b7-4fa4-9b6e-282c462ec266_4.jpg not downloaded yet
2025-12-05 06:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F980fa3c0-35b7-4fa4-9b6e-282c462ec266_11.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/980fa3c0-35b7-4fa4-9b6e-282c462ec266_11.jpg not downloaded yet
2025-12-05 06:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F980fa3c0-35b7-4fa4-9b6e-282c462ec266_10.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/980fa3c0-35b7-4fa4-9b6e-282c462ec266_10.jpg not downloaded yet
2025-12-05 06:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F980fa3c0-35b7-4fa4-9b6e-282c462ec266_9.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/980fa3c0-35b7-4fa4-9b6e-282c462ec266_9.jpg not downloaded yet
2025-12-05 06:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F980fa3c0-35b7-4fa4-9b6e-282c462ec266_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/980fa3c0-35b7-4fa4-9b6e-282c462ec266_ext_2.jpg not downloaded yet
2025-12-05 06:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003787547-01969277-004.pdf> (referer: None)
2025-12-05 06:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F980fa3c0-35b7-4fa4-9b6e-282c462ec266_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/980fa3c0-35b7-4fa4-9b6e-282c462ec266_ext_5.jpg not downloaded yet
2025-12-05 06:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F980fa3c0-35b7-4fa4-9b6e-282c462ec266_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/980fa3c0-35b7-4fa4-9b6e-282c462ec266_ext_3.jpg not downloaded yet
2025-12-05 06:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F980fa3c0-35b7-4fa4-9b6e-282c462ec266_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/980fa3c0-35b7-4fa4-9b6e-282c462ec266_ext_4.jpg not downloaded yet
2025-12-05 06:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/PEUGEOT/2008?id=3786170&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233786170&indx=301> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3805802-3964370-13.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3805802-3964370-13.jpg not downloaded yet
2025-12-05 06:06:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3805802-3964370-1000.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3805802-3964370-1000.jpg not downloaded yet
2025-12-05 06:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3805802-3964370-1001.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3805802-3964370-1001.jpg not downloaded yet
2025-12-05 06:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3805802-3964370-1002.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3805802-3964370-1002.jpg not downloaded yet
2025-12-05 06:06:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234292b610>
2025-12-05 06:06:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_301a1c7b-dc57-5e53-a180-51a6be347921/301a1c7b-dc57-5e53-a180-51a6be347921_expert_report_file_803f5848-0e1d-432f-ad14-ba303cf32ebb.pdf HTTP/1.1" 201 0
2025-12-05 06:06:02 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 301a1c7b-dc57-5e53-a180-51a6be347921
2025-12-05 06:06:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 301a1c7b-dc57-5e53-a180-51a6be347921, skipping ID generation
2025-12-05 06:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 301a1c7b-dc57-5e53-a180-51a6be347921
2025-12-05 06:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fawaiting-image-002.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/awaiting-image-002.jpg already downloaded
2025-12-05 06:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fawaiting-image-002.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/awaiting-image-002.jpg already downloaded
2025-12-05 06:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3787547-3993510-3.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3787547-3993510-3.jpg not downloaded yet
2025-12-05 06:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3805802-3964370-1003.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3805802-3964370-1003.jpg not downloaded yet
2025-12-05 06:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3787547-3993510-13.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3787547-3993510-13.jpg not downloaded yet
2025-12-05 06:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/MULTIVAN?id=3790913&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233790913&indx=304> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3805802-3964370-1004.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3805802-3964370-1004.jpg not downloaded yet
2025-12-05 06:06:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3787547-3993510-1000.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3787547-3993510-1000.jpg not downloaded yet
2025-12-05 06:06:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7600c093-6896-50a1-a116-ece885625448 with identifier: 3786170
2025-12-05 06:06:02 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 7600c093-6896-50a1-a116-ece885625448
2025-12-05 06:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003791288-01777440-004.pdf> (referer: None)
2025-12-05 06:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3805802-3964370-1005.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3805802-3964370-1005.jpg not downloaded yet
2025-12-05 06:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3787547-3993510-1001.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3787547-3993510-1001.jpg not downloaded yet
2025-12-05 06:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3787547-3993510-1002.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3787547-3993510-1002.jpg not downloaded yet
2025-12-05 06:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3787547-3993510-1003.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3787547-3993510-1003.jpg not downloaded yet
2025-12-05 06:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3787547-3993510-1004.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3787547-3993510-1004.jpg not downloaded yet
2025-12-05 06:06:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 354bfc79-2afd-58f8-9caf-2a3bd656d429 with identifier: 3790913
2025-12-05 06:06:02 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 354bfc79-2afd-58f8-9caf-2a3bd656d429
2025-12-05 06:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3787547-3993510-1005.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3787547-3993510-1005.jpg not downloaded yet
2025-12-05 06:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3787547-3993510-1006.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3787547-3993510-1006.jpg not downloaded yet
2025-12-05 06:06:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23427b3190>
2025-12-05 06:06:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:06:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10b93c70-9ccd-5c79-bbc5-6fb60601b311/10b93c70-9ccd-5c79-bbc5-6fb60601b311_expert_report_file_2f8bb439-c01b-47d1-83f6-894de7b06808.pdf HTTP/1.1" 201 0
2025-12-05 06:06:02 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 10b93c70-9ccd-5c79-bbc5-6fb60601b311
2025-12-05 06:06:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 10b93c70-9ccd-5c79-bbc5-6fb60601b311, skipping ID generation
2025-12-05 06:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 10b93c70-9ccd-5c79-bbc5-6fb60601b311
2025-12-05 06:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb74107a6-143f-4b9b-b00f-d75d11547e4d_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b74107a6-143f-4b9b-b00f-d75d11547e4d_ext_7.jpg not downloaded yet
2025-12-05 06:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3787547-3993510-1007.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3787547-3993510-1007.jpg not downloaded yet
2025-12-05 06:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb74107a6-143f-4b9b-b00f-d75d11547e4d_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b74107a6-143f-4b9b-b00f-d75d11547e4d_ext_7.jpg not downloaded yet
2025-12-05 06:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3787547-3993510-1008.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3787547-3993510-1008.jpg not downloaded yet
2025-12-05 06:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb74107a6-143f-4b9b-b00f-d75d11547e4d_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b74107a6-143f-4b9b-b00f-d75d11547e4d_ext_6.jpg not downloaded yet
2025-12-05 06:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3787547-3993510-1009.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3787547-3993510-1009.jpg not downloaded yet
2025-12-05 06:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb74107a6-143f-4b9b-b00f-d75d11547e4d_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b74107a6-143f-4b9b-b00f-d75d11547e4d_ext_1.jpg not downloaded yet
2025-12-05 06:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3787547-3993510-1010.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3787547-3993510-1010.jpg not downloaded yet
2025-12-05 06:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb74107a6-143f-4b9b-b00f-d75d11547e4d_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b74107a6-143f-4b9b-b00f-d75d11547e4d_5.jpg not downloaded yet
2025-12-05 06:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3787547-3993510-1011.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3787547-3993510-1011.jpg not downloaded yet
2025-12-05 06:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb74107a6-143f-4b9b-b00f-d75d11547e4d_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b74107a6-143f-4b9b-b00f-d75d11547e4d_4.jpg not downloaded yet
2025-12-05 06:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3787547-3993510-1012.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3787547-3993510-1012.jpg not downloaded yet
2025-12-05 06:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb74107a6-143f-4b9b-b00f-d75d11547e4d_11.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b74107a6-143f-4b9b-b00f-d75d11547e4d_11.jpg not downloaded yet
2025-12-05 06:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3787547-3993510-1013.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3787547-3993510-1013.jpg not downloaded yet
2025-12-05 06:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb74107a6-143f-4b9b-b00f-d75d11547e4d_10.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b74107a6-143f-4b9b-b00f-d75d11547e4d_10.jpg not downloaded yet
2025-12-05 06:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3787547-3993510-1014.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3787547-3993510-1014.jpg not downloaded yet
2025-12-05 06:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb74107a6-143f-4b9b-b00f-d75d11547e4d_9.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b74107a6-143f-4b9b-b00f-d75d11547e4d_9.jpg not downloaded yet
2025-12-05 06:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3787547-3993510-1015.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3787547-3993510-1015.jpg not downloaded yet
2025-12-05 06:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb74107a6-143f-4b9b-b00f-d75d11547e4d_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b74107a6-143f-4b9b-b00f-d75d11547e4d_ext_2.jpg not downloaded yet
2025-12-05 06:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb74107a6-143f-4b9b-b00f-d75d11547e4d_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b74107a6-143f-4b9b-b00f-d75d11547e4d_ext_5.jpg not downloaded yet
2025-12-05 06:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb74107a6-143f-4b9b-b00f-d75d11547e4d_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b74107a6-143f-4b9b-b00f-d75d11547e4d_ext_3.jpg not downloaded yet
2025-12-05 06:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb74107a6-143f-4b9b-b00f-d75d11547e4d_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b74107a6-143f-4b9b-b00f-d75d11547e4d_ext_4.jpg not downloaded yet
2025-12-05 06:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3791288-3749769-13.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3791288-3749769-13.jpg not downloaded yet
2025-12-05 06:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3791288-3749769-1000.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3791288-3749769-1000.jpg not downloaded yet
2025-12-05 06:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3791288-3749769-1001.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3791288-3749769-1001.jpg not downloaded yet
2025-12-05 06:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3791288-3749769-1002.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3791288-3749769-1002.jpg not downloaded yet
2025-12-05 06:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3791288-3749769-1003.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3791288-3749769-1003.jpg not downloaded yet
2025-12-05 06:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3791288-3749769-1004.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3791288-3749769-1004.jpg not downloaded yet
2025-12-05 06:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3791288-3749769-1005.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3791288-3749769-1005.jpg not downloaded yet
2025-12-05 06:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/b74107a6-143f-4b9b-b00f-d75d11547e4d_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003791288-01777440-004.pdf)
2025-12-05 06:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/b74107a6-143f-4b9b-b00f-d75d11547e4d_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003791288-01777440-004.pdf)
2025-12-05 06:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/b74107a6-143f-4b9b-b00f-d75d11547e4d_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003791288-01777440-004.pdf)
2025-12-05 06:06:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23427b2090>
2025-12-05 06:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 06:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10b93c70-9ccd-5c79-bbc5-6fb60601b311/10b93c70-9ccd-5c79-bbc5-6fb60601b311_image_8.jpg HTTP/1.1" 201 0
2025-12-05 06:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb74107a6-143f-4b9b-b00f-d75d11547e4d_9.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b74107a6-143f-4b9b-b00f-d75d11547e4d_9.jpg saved to cache
2025-12-05 06:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 10b93c70-9ccd-5c79-bbc5-6fb60601b311
2025-12-05 06:06:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425e3750>
2025-12-05 06:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10b93c70-9ccd-5c79-bbc5-6fb60601b311/10b93c70-9ccd-5c79-bbc5-6fb60601b311_image_9.jpg HTTP/1.1" 201 0
2025-12-05 06:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb74107a6-143f-4b9b-b00f-d75d11547e4d_ext_2.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b74107a6-143f-4b9b-b00f-d75d11547e4d_ext_2.jpg saved to cache
2025-12-05 06:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 10b93c70-9ccd-5c79-bbc5-6fb60601b311
2025-12-05 06:06:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23426e6e90>
2025-12-05 06:06:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 06:06:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10b93c70-9ccd-5c79-bbc5-6fb60601b311/10b93c70-9ccd-5c79-bbc5-6fb60601b311_image_10.jpg HTTP/1.1" 201 0
2025-12-05 06:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb74107a6-143f-4b9b-b00f-d75d11547e4d_ext_5.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b74107a6-143f-4b9b-b00f-d75d11547e4d_ext_5.jpg saved to cache
2025-12-05 06:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 10b93c70-9ccd-5c79-bbc5-6fb60601b311
2025-12-05 06:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3791288-3749769-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003791288-01777440-004.pdf)
2025-12-05 06:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3787547-3993510-1015.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003787547-01969277-004.pdf)
2025-12-05 06:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3791288-3749769-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003791288-01777440-004.pdf)
2025-12-05 06:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3791288-3749769-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003791288-01777440-004.pdf)
2025-12-05 06:06:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23427c1850>
2025-12-05 06:06:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:06:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10b93c70-9ccd-5c79-bbc5-6fb60601b311/10b93c70-9ccd-5c79-bbc5-6fb60601b311_image_17.jpg HTTP/1.1" 201 0
2025-12-05 06:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3791288-3749769-1003.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3791288-3749769-1003.jpg saved to cache
2025-12-05 06:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 10b93c70-9ccd-5c79-bbc5-6fb60601b311
2025-12-05 06:06:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23426e7550>
2025-12-05 06:06:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_301a1c7b-dc57-5e53-a180-51a6be347921/301a1c7b-dc57-5e53-a180-51a6be347921_image_19.jpg HTTP/1.1" 201 0
2025-12-05 06:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3787547-3993510-1015.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3787547-3993510-1015.jpg saved to cache
2025-12-05 06:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 301a1c7b-dc57-5e53-a180-51a6be347921
2025-12-05 06:06:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234285e350>
2025-12-05 06:06:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10b93c70-9ccd-5c79-bbc5-6fb60601b311/10b93c70-9ccd-5c79-bbc5-6fb60601b311_image_19.jpg HTTP/1.1" 201 0
2025-12-05 06:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3791288-3749769-1005.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3791288-3749769-1005.jpg saved to cache
2025-12-05 06:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 10b93c70-9ccd-5c79-bbc5-6fb60601b311
2025-12-05 06:06:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3791288-3749769-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003791288-01777440-004.pdf)
2025-12-05 06:06:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/RENAULT/TRAFIC?id=3784865&returnUrl=%2Fsearch%3FPage%3D4%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233784865&indx=300> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:06:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341eda390>
2025-12-05 06:06:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10b93c70-9ccd-5c79-bbc5-6fb60601b311/10b93c70-9ccd-5c79-bbc5-6fb60601b311_image_18.jpg HTTP/1.1" 201 0
2025-12-05 06:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3791288-3749769-1004.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3791288-3749769-1004.jpg saved to cache
2025-12-05 06:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 10b93c70-9ccd-5c79-bbc5-6fb60601b311
2025-12-05 06:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3791288-3749769-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003791288-01777440-004.pdf)
2025-12-05 06:06:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3791288-3749769-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003791288-01777440-004.pdf)
2025-12-05 06:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3791288-3749769-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003791288-01777440-004.pdf)
2025-12-05 06:06:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23427c1ed0>
2025-12-05 06:06:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:06:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10b93c70-9ccd-5c79-bbc5-6fb60601b311/10b93c70-9ccd-5c79-bbc5-6fb60601b311_image_16.jpg HTTP/1.1" 201 0
2025-12-05 06:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3791288-3749769-1002.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3791288-3749769-1002.jpg saved to cache
2025-12-05 06:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 10b93c70-9ccd-5c79-bbc5-6fb60601b311
2025-12-05 06:06:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 676f95d5-f452-510b-ac71-9c1d9bb9de92 with identifier: 3784865
2025-12-05 06:06:06 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 676f95d5-f452-510b-ac71-9c1d9bb9de92
2025-12-05 06:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/b74107a6-143f-4b9b-b00f-d75d11547e4d_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003791288-01777440-004.pdf)
2025-12-05 06:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/b74107a6-143f-4b9b-b00f-d75d11547e4d_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003791288-01777440-004.pdf)
2025-12-05 06:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/b74107a6-143f-4b9b-b00f-d75d11547e4d_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003791288-01777440-004.pdf)
2025-12-05 06:06:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2343cece10>
2025-12-05 06:06:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 06:06:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10b93c70-9ccd-5c79-bbc5-6fb60601b311/10b93c70-9ccd-5c79-bbc5-6fb60601b311_image_15.jpg HTTP/1.1" 201 0
2025-12-05 06:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3791288-3749769-1001.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3791288-3749769-1001.jpg saved to cache
2025-12-05 06:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 10b93c70-9ccd-5c79-bbc5-6fb60601b311
2025-12-05 06:06:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23415fad10>
2025-12-05 06:06:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:06:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10b93c70-9ccd-5c79-bbc5-6fb60601b311/10b93c70-9ccd-5c79-bbc5-6fb60601b311_image_13.jpg HTTP/1.1" 201 0
2025-12-05 06:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3791288-3749769-13.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3791288-3749769-13.jpg saved to cache
2025-12-05 06:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 10b93c70-9ccd-5c79-bbc5-6fb60601b311
2025-12-05 06:06:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342668e90>
2025-12-05 06:06:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:06:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10b93c70-9ccd-5c79-bbc5-6fb60601b311/10b93c70-9ccd-5c79-bbc5-6fb60601b311_image_14.jpg HTTP/1.1" 201 0
2025-12-05 06:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3791288-3749769-1000.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3791288-3749769-1000.jpg saved to cache
2025-12-05 06:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 10b93c70-9ccd-5c79-bbc5-6fb60601b311
2025-12-05 06:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3787547-3993510-1013.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003787547-01969277-004.pdf)
2025-12-05 06:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/TIGUAN?id=3712711&returnUrl=%2Fsearch%3FPage%3D3%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233712711&indx=269> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:06:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3787547-3993510-1014.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003787547-01969277-004.pdf)
2025-12-05 06:06:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342511750>
2025-12-05 06:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:06:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10b93c70-9ccd-5c79-bbc5-6fb60601b311/10b93c70-9ccd-5c79-bbc5-6fb60601b311_image_7.jpg HTTP/1.1" 201 0
2025-12-05 06:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb74107a6-143f-4b9b-b00f-d75d11547e4d_10.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b74107a6-143f-4b9b-b00f-d75d11547e4d_10.jpg saved to cache
2025-12-05 06:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 10b93c70-9ccd-5c79-bbc5-6fb60601b311
2025-12-05 06:06:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341ea3f10>
2025-12-05 06:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:06:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10b93c70-9ccd-5c79-bbc5-6fb60601b311/10b93c70-9ccd-5c79-bbc5-6fb60601b311_image_12.jpg HTTP/1.1" 201 0
2025-12-05 06:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb74107a6-143f-4b9b-b00f-d75d11547e4d_ext_4.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b74107a6-143f-4b9b-b00f-d75d11547e4d_ext_4.jpg saved to cache
2025-12-05 06:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 10b93c70-9ccd-5c79-bbc5-6fb60601b311
2025-12-05 06:06:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342617b90>
2025-12-05 06:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:06:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10b93c70-9ccd-5c79-bbc5-6fb60601b311/10b93c70-9ccd-5c79-bbc5-6fb60601b311_image_11.jpg HTTP/1.1" 201 0
2025-12-05 06:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb74107a6-143f-4b9b-b00f-d75d11547e4d_ext_3.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b74107a6-143f-4b9b-b00f-d75d11547e4d_ext_3.jpg saved to cache
2025-12-05 06:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 10b93c70-9ccd-5c79-bbc5-6fb60601b311
2025-12-05 06:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/b74107a6-143f-4b9b-b00f-d75d11547e4d_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003791288-01777440-004.pdf)
2025-12-05 06:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/b74107a6-143f-4b9b-b00f-d75d11547e4d_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003791288-01777440-004.pdf)
2025-12-05 06:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3787547-3993510-1012.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003787547-01969277-004.pdf)
2025-12-05 06:06:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342617c90>
2025-12-05 06:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 06:06:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_301a1c7b-dc57-5e53-a180-51a6be347921/301a1c7b-dc57-5e53-a180-51a6be347921_image_17.jpg HTTP/1.1" 201 0
2025-12-05 06:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3787547-3993510-1013.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3787547-3993510-1013.jpg saved to cache
2025-12-05 06:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 301a1c7b-dc57-5e53-a180-51a6be347921
2025-12-05 06:06:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003 with identifier: 3712711
2025-12-05 06:06:08 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003
2025-12-05 06:06:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342774750>
2025-12-05 06:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:06:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_301a1c7b-dc57-5e53-a180-51a6be347921/301a1c7b-dc57-5e53-a180-51a6be347921_image_18.jpg HTTP/1.1" 201 0
2025-12-05 06:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3787547-3993510-1014.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3787547-3993510-1014.jpg saved to cache
2025-12-05 06:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 301a1c7b-dc57-5e53-a180-51a6be347921
2025-12-05 06:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/PEUGEOT/2008?id=3641838&returnUrl=%2Fsearch%3FPage%3D3%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233641838&indx=249> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/b74107a6-143f-4b9b-b00f-d75d11547e4d_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003791288-01777440-004.pdf)
2025-12-05 06:06:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:06:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23415a5950>
2025-12-05 06:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:06:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10b93c70-9ccd-5c79-bbc5-6fb60601b311/10b93c70-9ccd-5c79-bbc5-6fb60601b311_image_6.jpg HTTP/1.1" 201 0
2025-12-05 06:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb74107a6-143f-4b9b-b00f-d75d11547e4d_11.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b74107a6-143f-4b9b-b00f-d75d11547e4d_11.jpg saved to cache
2025-12-05 06:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 10b93c70-9ccd-5c79-bbc5-6fb60601b311
2025-12-05 06:06:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342694d10>
2025-12-05 06:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:06:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10b93c70-9ccd-5c79-bbc5-6fb60601b311/10b93c70-9ccd-5c79-bbc5-6fb60601b311_image_5.jpg HTTP/1.1" 201 0
2025-12-05 06:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb74107a6-143f-4b9b-b00f-d75d11547e4d_4.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b74107a6-143f-4b9b-b00f-d75d11547e4d_4.jpg saved to cache
2025-12-05 06:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 10b93c70-9ccd-5c79-bbc5-6fb60601b311
2025-12-05 06:06:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234243ebd0>
2025-12-05 06:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:06:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_301a1c7b-dc57-5e53-a180-51a6be347921/301a1c7b-dc57-5e53-a180-51a6be347921_image_16.jpg HTTP/1.1" 201 0
2025-12-05 06:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3787547-3993510-1012.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3787547-3993510-1012.jpg saved to cache
2025-12-05 06:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 301a1c7b-dc57-5e53-a180-51a6be347921
2025-12-05 06:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3787547-3993510-1011.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003787547-01969277-004.pdf)
2025-12-05 06:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3787547-3993510-1009.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003787547-01969277-004.pdf)
2025-12-05 06:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/b74107a6-143f-4b9b-b00f-d75d11547e4d_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003791288-01777440-004.pdf)
2025-12-05 06:06:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1759cc2-a8c3-545a-9cf7-a69ef72be55f with identifier: 3641838
2025-12-05 06:06:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1759cc2-a8c3-545a-9cf7-a69ef72be55f with scrape type 1
2025-12-05 06:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 18 photos for item e1759cc2-a8c3-545a-9cf7-a69ef72be55f
2025-12-05 06:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3641838-4008198-1.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3641838-4008198-1.jpg not downloaded yet
2025-12-05 06:06:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341f31110>
2025-12-05 06:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:06:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10b93c70-9ccd-5c79-bbc5-6fb60601b311/10b93c70-9ccd-5c79-bbc5-6fb60601b311_image_4.jpg HTTP/1.1" 201 0
2025-12-05 06:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb74107a6-143f-4b9b-b00f-d75d11547e4d_5.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b74107a6-143f-4b9b-b00f-d75d11547e4d_5.jpg saved to cache
2025-12-05 06:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 10b93c70-9ccd-5c79-bbc5-6fb60601b311
2025-12-05 06:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3641838-4008198-2.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3641838-4008198-2.jpg not downloaded yet
2025-12-05 06:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3787547-3993510-1010.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003787547-01969277-004.pdf)
2025-12-05 06:06:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425626d0>
2025-12-05 06:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:06:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_301a1c7b-dc57-5e53-a180-51a6be347921/301a1c7b-dc57-5e53-a180-51a6be347921_image_15.jpg HTTP/1.1" 201 0
2025-12-05 06:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3787547-3993510-1011.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3787547-3993510-1011.jpg saved to cache
2025-12-05 06:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 301a1c7b-dc57-5e53-a180-51a6be347921
2025-12-05 06:06:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341f24c10>
2025-12-05 06:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:06:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_301a1c7b-dc57-5e53-a180-51a6be347921/301a1c7b-dc57-5e53-a180-51a6be347921_image_13.jpg HTTP/1.1" 201 0
2025-12-05 06:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3787547-3993510-1009.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3787547-3993510-1009.jpg saved to cache
2025-12-05 06:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 301a1c7b-dc57-5e53-a180-51a6be347921
2025-12-05 06:06:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234253dc10>
2025-12-05 06:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:06:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10b93c70-9ccd-5c79-bbc5-6fb60601b311/10b93c70-9ccd-5c79-bbc5-6fb60601b311_image_3.jpg HTTP/1.1" 201 0
2025-12-05 06:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb74107a6-143f-4b9b-b00f-d75d11547e4d_ext_1.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b74107a6-143f-4b9b-b00f-d75d11547e4d_ext_1.jpg saved to cache
2025-12-05 06:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 10b93c70-9ccd-5c79-bbc5-6fb60601b311
2025-12-05 06:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3641838-4008198-3.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3641838-4008198-3.jpg not downloaded yet
2025-12-05 06:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3641838-4008198-4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3641838-4008198-4.jpg not downloaded yet
2025-12-05 06:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/b74107a6-143f-4b9b-b00f-d75d11547e4d_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003791288-01777440-004.pdf)
2025-12-05 06:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/b74107a6-143f-4b9b-b00f-d75d11547e4d_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003791288-01777440-004.pdf)
2025-12-05 06:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3787547-3993510-1008.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003787547-01969277-004.pdf)
2025-12-05 06:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3641838-4008198-6.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3641838-4008198-6.jpg not downloaded yet
2025-12-05 06:06:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23427b3dd0>
2025-12-05 06:06:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_301a1c7b-dc57-5e53-a180-51a6be347921/301a1c7b-dc57-5e53-a180-51a6be347921_image_14.jpg HTTP/1.1" 201 0
2025-12-05 06:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3787547-3993510-1010.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3787547-3993510-1010.jpg saved to cache
2025-12-05 06:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 301a1c7b-dc57-5e53-a180-51a6be347921
2025-12-05 06:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3787547-3993510-1007.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003787547-01969277-004.pdf)
2025-12-05 06:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3641838-4008198-13.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3641838-4008198-13.jpg not downloaded yet
2025-12-05 06:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3641838-4008198-8.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3641838-4008198-8.jpg not downloaded yet
2025-12-05 06:06:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342695a10>
2025-12-05 06:06:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10b93c70-9ccd-5c79-bbc5-6fb60601b311/10b93c70-9ccd-5c79-bbc5-6fb60601b311_image_2.jpg HTTP/1.1" 201 0
2025-12-05 06:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb74107a6-143f-4b9b-b00f-d75d11547e4d_ext_6.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b74107a6-143f-4b9b-b00f-d75d11547e4d_ext_6.jpg saved to cache
2025-12-05 06:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 10b93c70-9ccd-5c79-bbc5-6fb60601b311
2025-12-05 06:06:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425a22d0>
2025-12-05 06:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:06:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10b93c70-9ccd-5c79-bbc5-6fb60601b311/10b93c70-9ccd-5c79-bbc5-6fb60601b311_image_1.jpg HTTP/1.1" 201 0
2025-12-05 06:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb74107a6-143f-4b9b-b00f-d75d11547e4d_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b74107a6-143f-4b9b-b00f-d75d11547e4d_ext_7.jpg saved to cache
2025-12-05 06:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 10b93c70-9ccd-5c79-bbc5-6fb60601b311
2025-12-05 06:06:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341f23390>
2025-12-05 06:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:06:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_301a1c7b-dc57-5e53-a180-51a6be347921/301a1c7b-dc57-5e53-a180-51a6be347921_image_12.jpg HTTP/1.1" 201 0
2025-12-05 06:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3787547-3993510-1008.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3787547-3993510-1008.jpg saved to cache
2025-12-05 06:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 301a1c7b-dc57-5e53-a180-51a6be347921
2025-12-05 06:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3641838-4008198-15.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3641838-4008198-15.jpg not downloaded yet
2025-12-05 06:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3641838-4008198-16.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3641838-4008198-16.jpg not downloaded yet
2025-12-05 06:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3641838-4008198-1.jpg> (referer: None)
2025-12-05 06:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3641838-4008198-3.jpg> (referer: None)
2025-12-05 06:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3641838-4008198-28.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3641838-4008198-28.jpg not downloaded yet
2025-12-05 06:06:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341ed9ad0>
2025-12-05 06:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:06:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_301a1c7b-dc57-5e53-a180-51a6be347921/301a1c7b-dc57-5e53-a180-51a6be347921_image_11.jpg HTTP/1.1" 201 0
2025-12-05 06:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3787547-3993510-1007.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3787547-3993510-1007.jpg saved to cache
2025-12-05 06:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 301a1c7b-dc57-5e53-a180-51a6be347921
2025-12-05 06:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3641838-4008198-2.jpg> (referer: None)
2025-12-05 06:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3641838-4008198-42.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3641838-4008198-42.jpg not downloaded yet
2025-12-05 06:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3641838-4008198-6.jpg> (referer: None)
2025-12-05 06:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3641838-4008198-4.jpg> (referer: None)
2025-12-05 06:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3641838-4008198-43.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3641838-4008198-43.jpg not downloaded yet
2025-12-05 06:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003784865-01952922-008.pdf> (referer: None)
2025-12-05 06:06:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234155db10>
2025-12-05 06:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:06:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1759cc2-a8c3-545a-9cf7-a69ef72be55f/e1759cc2-a8c3-545a-9cf7-a69ef72be55f_image_0.jpg HTTP/1.1" 201 0
2025-12-05 06:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3641838-4008198-1.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3641838-4008198-1.jpg saved to cache
2025-12-05 06:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e1759cc2-a8c3-545a-9cf7-a69ef72be55f
2025-12-05 06:06:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342662b10>
2025-12-05 06:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:06:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1759cc2-a8c3-545a-9cf7-a69ef72be55f/e1759cc2-a8c3-545a-9cf7-a69ef72be55f_image_2.jpg HTTP/1.1" 201 0
2025-12-05 06:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3641838-4008198-3.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3641838-4008198-3.jpg saved to cache
2025-12-05 06:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e1759cc2-a8c3-545a-9cf7-a69ef72be55f
2025-12-05 06:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3641838-4008198-44.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3641838-4008198-44.jpg not downloaded yet
2025-12-05 06:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3641838-4008198-1000.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3641838-4008198-1000.jpg not downloaded yet
2025-12-05 06:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003712711-01981914-003.pdf> (referer: None)
2025-12-05 06:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3641838-4008198-16.jpg> (referer: None)
2025-12-05 06:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3641838-4008198-28.jpg> (referer: None)
2025-12-05 06:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3641838-4008198-15.jpg> (referer: None)
2025-12-05 06:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3641838-4008198-1001.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3641838-4008198-1001.jpg not downloaded yet
2025-12-05 06:06:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23424c6990>
2025-12-05 06:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:06:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1759cc2-a8c3-545a-9cf7-a69ef72be55f/e1759cc2-a8c3-545a-9cf7-a69ef72be55f_image_1.jpg HTTP/1.1" 201 0
2025-12-05 06:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3641838-4008198-2.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3641838-4008198-2.jpg saved to cache
2025-12-05 06:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e1759cc2-a8c3-545a-9cf7-a69ef72be55f
2025-12-05 06:06:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341558550>
2025-12-05 06:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1759cc2-a8c3-545a-9cf7-a69ef72be55f/e1759cc2-a8c3-545a-9cf7-a69ef72be55f_image_4.jpg HTTP/1.1" 201 0
2025-12-05 06:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3641838-4008198-6.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3641838-4008198-6.jpg saved to cache
2025-12-05 06:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e1759cc2-a8c3-545a-9cf7-a69ef72be55f
2025-12-05 06:06:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23415c1b50>
2025-12-05 06:06:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1759cc2-a8c3-545a-9cf7-a69ef72be55f/e1759cc2-a8c3-545a-9cf7-a69ef72be55f_image_3.jpg HTTP/1.1" 201 0
2025-12-05 06:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3641838-4008198-4.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3641838-4008198-4.jpg saved to cache
2025-12-05 06:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e1759cc2-a8c3-545a-9cf7-a69ef72be55f
2025-12-05 06:06:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342527a50>
2025-12-05 06:06:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_676f95d5-f452-510b-ac71-9c1d9bb9de92/676f95d5-f452-510b-ac71-9c1d9bb9de92_expert_report_file_8e6a3a10-2e39-4b9e-a546-f82f50a3c624.pdf HTTP/1.1" 201 0
2025-12-05 06:06:15 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 676f95d5-f452-510b-ac71-9c1d9bb9de92
2025-12-05 06:06:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 676f95d5-f452-510b-ac71-9c1d9bb9de92, skipping ID generation
2025-12-05 06:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 676f95d5-f452-510b-ac71-9c1d9bb9de92
2025-12-05 06:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F06a25fb2-92d0-40b6-912a-85b47d661d77_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/06a25fb2-92d0-40b6-912a-85b47d661d77_ext_7.jpg already downloaded
2025-12-05 06:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F06a25fb2-92d0-40b6-912a-85b47d661d77_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/06a25fb2-92d0-40b6-912a-85b47d661d77_ext_7.jpg already downloaded
2025-12-05 06:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F06a25fb2-92d0-40b6-912a-85b47d661d77_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/06a25fb2-92d0-40b6-912a-85b47d661d77_ext_6.jpg already downloaded
2025-12-05 06:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F06a25fb2-92d0-40b6-912a-85b47d661d77_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/06a25fb2-92d0-40b6-912a-85b47d661d77_ext_1.jpg already downloaded
2025-12-05 06:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F06a25fb2-92d0-40b6-912a-85b47d661d77_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/06a25fb2-92d0-40b6-912a-85b47d661d77_5.jpg already downloaded
2025-12-05 06:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F06a25fb2-92d0-40b6-912a-85b47d661d77_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/06a25fb2-92d0-40b6-912a-85b47d661d77_4.jpg already downloaded
2025-12-05 06:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F06a25fb2-92d0-40b6-912a-85b47d661d77_11.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/06a25fb2-92d0-40b6-912a-85b47d661d77_11.jpg already downloaded
2025-12-05 06:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F06a25fb2-92d0-40b6-912a-85b47d661d77_10.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/06a25fb2-92d0-40b6-912a-85b47d661d77_10.jpg already downloaded
2025-12-05 06:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F06a25fb2-92d0-40b6-912a-85b47d661d77_9.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/06a25fb2-92d0-40b6-912a-85b47d661d77_9.jpg already downloaded
2025-12-05 06:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F06a25fb2-92d0-40b6-912a-85b47d661d77_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/06a25fb2-92d0-40b6-912a-85b47d661d77_ext_2.jpg already downloaded
2025-12-05 06:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F06a25fb2-92d0-40b6-912a-85b47d661d77_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/06a25fb2-92d0-40b6-912a-85b47d661d77_ext_5.jpg already downloaded
2025-12-05 06:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F06a25fb2-92d0-40b6-912a-85b47d661d77_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/06a25fb2-92d0-40b6-912a-85b47d661d77_ext_3.jpg already downloaded
2025-12-05 06:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F06a25fb2-92d0-40b6-912a-85b47d661d77_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/06a25fb2-92d0-40b6-912a-85b47d661d77_ext_4.jpg already downloaded
2025-12-05 06:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3784865-3969560-13.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3784865-3969560-13.jpg already downloaded
2025-12-05 06:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3784865-3969560-1000.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3784865-3969560-1000.jpg already downloaded
2025-12-05 06:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3784865-3969560-1001.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3784865-3969560-1001.jpg already downloaded
2025-12-05 06:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3784865-3969560-1002.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3784865-3969560-1002.jpg already downloaded
2025-12-05 06:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3784865-3969560-1003.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3784865-3969560-1003.jpg already downloaded
2025-12-05 06:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3784865-3969560-1004.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3784865-3969560-1004.jpg already downloaded
2025-12-05 06:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3784865-3969560-1005.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3784865-3969560-1005.jpg already downloaded
2025-12-05 06:06:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 676f95d5-f452-510b-ac71-9c1d9bb9de92, identifier: 3784865
2025-12-05 06:06:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 676f95d5-f452-510b-ac71-9c1d9bb9de92 with identifier: 3784865
2025-12-05 06:06:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 676f95d5-f452-510b-ac71-9c1d9bb9de92 with identifier: 3784865
2025-12-05 06:06:16 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'trafic' containing 'trafic'
2025-12-05 06:06:16 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 676f95d5-f452-510b-ac71-9c1d9bb9de92 spider: manheim.gb
2025-12-05 06:06:16 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 676f95d5-f452-510b-ac71-9c1d9bb9de92 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'trafic' containing 'trafic'
{'auction_title': '',
 'c_o_2_emission_value': 186,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_676f95d5-f452-510b-ac71-9c1d9bb9de92/676f95d5-f452-510b-ac71-9c1d9bb9de92_expert_report_file_8e6a3a10-2e39-4b9e-a546-f82f50a3c624.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003784865-01952922-008.pdf',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': '2025-12-05T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '676f95d5-f452-510b-ac71-9c1d9bb9de92',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'NA72BGV',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/RENAULT/TRAFIC?id=3784865',
 'listing': 'auction',
 'location': 'Bruntingthorpe',
 'make': 'RENAULT',
 'model': 'TRAFIC',
 'odometer': 52057,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 32,
 'photo_urls': ['http://images.manheim.co.uk/images/units/zoom/06a25fb2-92d0-40b6-912a-85b47d661d77_ext_7.jpg',
                'http://images.manheim.co.uk/images/units/zoom/06a25fb2-92d0-40b6-912a-85b47d661d77_ext_7.jpg',
                'http://images.manheim.co.uk/images/units/zoom/06a25fb2-92d0-40b6-912a-85b47d661d77_ext_6.jpg',
                'http://images.manheim.co.uk/images/units/zoom/06a25fb2-92d0-40b6-912a-85b47d661d77_ext_1.jpg',
                'http://images.manheim.co.uk/images/units/zoom/06a25fb2-92d0-40b6-912a-85b47d661d77_5.jpg',
                'http://images.manheim.co.uk/images/units/zoom/06a25fb2-92d0-40b6-912a-85b47d661d77_4.jpg',
                'http://images.manheim.co.uk/images/units/zoom/06a25fb2-92d0-40b6-912a-85b47d661d77_11.jpg',
                'http://images.manheim.co.uk/images/units/zoom/06a25fb2-92d0-40b6-912a-85b47d661d77_10.jpg',
                'http://images.manheim.co.uk/images/units/zoom/06a25fb2-92d0-40b6-912a-85b47d661d77_9.jpg',
                'http://images.manheim.co.uk/images/units/zoom/06a25fb2-92d0-40b6-912a-85b47d661d77_ext_2.jpg',
                'http://images.manheim.co.uk/images/units/zoom/06a25fb2-92d0-40b6-912a-85b47d661d77_ext_5.jpg',
                'http://images.manheim.co.uk/images/units/zoom/06a25fb2-92d0-40b6-912a-85b47d661d77_ext_3.jpg',
                'http://images.manheim.co.uk/images/units/zoom/06a25fb2-92d0-40b6-912a-85b47d661d77_ext_4.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3784865-3969560-13.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3784865-3969560-1000.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3784865-3969560-1001.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3784865-3969560-1002.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3784865-3969560-1003.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3784865-3969560-1004.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3784865-3969560-1005.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_676f95d5-f452-510b-ac71-9c1d9bb9de92/676f95d5-f452-510b-ac71-9c1d9bb9de92_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 181557,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/06a25fb2-92d0-40b6-912a-85b47d661d77_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_676f95d5-f452-510b-ac71-9c1d9bb9de92/676f95d5-f452-510b-ac71-9c1d9bb9de92_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 181557,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/06a25fb2-92d0-40b6-912a-85b47d661d77_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_676f95d5-f452-510b-ac71-9c1d9bb9de92/676f95d5-f452-510b-ac71-9c1d9bb9de92_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 239973,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/06a25fb2-92d0-40b6-912a-85b47d661d77_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_676f95d5-f452-510b-ac71-9c1d9bb9de92/676f95d5-f452-510b-ac71-9c1d9bb9de92_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 256291,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/06a25fb2-92d0-40b6-912a-85b47d661d77_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_676f95d5-f452-510b-ac71-9c1d9bb9de92/676f95d5-f452-510b-ac71-9c1d9bb9de92_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 172152,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/06a25fb2-92d0-40b6-912a-85b47d661d77_5.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_676f95d5-f452-510b-ac71-9c1d9bb9de92/676f95d5-f452-510b-ac71-9c1d9bb9de92_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 171107,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/06a25fb2-92d0-40b6-912a-85b47d661d77_4.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_676f95d5-f452-510b-ac71-9c1d9bb9de92/676f95d5-f452-510b-ac71-9c1d9bb9de92_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 182110,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/06a25fb2-92d0-40b6-912a-85b47d661d77_11.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_676f95d5-f452-510b-ac71-9c1d9bb9de92/676f95d5-f452-510b-ac71-9c1d9bb9de92_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 168937,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/06a25fb2-92d0-40b6-912a-85b47d661d77_10.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_676f95d5-f452-510b-ac71-9c1d9bb9de92/676f95d5-f452-510b-ac71-9c1d9bb9de92_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 178870,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/06a25fb2-92d0-40b6-912a-85b47d661d77_9.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_676f95d5-f452-510b-ac71-9c1d9bb9de92/676f95d5-f452-510b-ac71-9c1d9bb9de92_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 259400,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/06a25fb2-92d0-40b6-912a-85b47d661d77_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_676f95d5-f452-510b-ac71-9c1d9bb9de92/676f95d5-f452-510b-ac71-9c1d9bb9de92_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 216780,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/06a25fb2-92d0-40b6-912a-85b47d661d77_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_676f95d5-f452-510b-ac71-9c1d9bb9de92/676f95d5-f452-510b-ac71-9c1d9bb9de92_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 214493,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/06a25fb2-92d0-40b6-912a-85b47d661d77_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_676f95d5-f452-510b-ac71-9c1d9bb9de92/676f95d5-f452-510b-ac71-9c1d9bb9de92_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 223015,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/06a25fb2-92d0-40b6-912a-85b47d661d77_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_676f95d5-f452-510b-ac71-9c1d9bb9de92/676f95d5-f452-510b-ac71-9c1d9bb9de92_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 409455,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3784865-3969560-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_676f95d5-f452-510b-ac71-9c1d9bb9de92/676f95d5-f452-510b-ac71-9c1d9bb9de92_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 505674,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3784865-3969560-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_676f95d5-f452-510b-ac71-9c1d9bb9de92/676f95d5-f452-510b-ac71-9c1d9bb9de92_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 373574,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3784865-3969560-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_676f95d5-f452-510b-ac71-9c1d9bb9de92/676f95d5-f452-510b-ac71-9c1d9bb9de92_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 248197,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3784865-3969560-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_676f95d5-f452-510b-ac71-9c1d9bb9de92/676f95d5-f452-510b-ac71-9c1d9bb9de92_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 267695,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3784865-3969560-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_676f95d5-f452-510b-ac71-9c1d9bb9de92/676f95d5-f452-510b-ac71-9c1d9bb9de92_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 371931,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3784865-3969560-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_676f95d5-f452-510b-ac71-9c1d9bb9de92/676f95d5-f452-510b-ac71-9c1d9bb9de92_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 360097,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3784865-3969560-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-16',
 'seller_name': 'Leasys',
 'title': 'RENAULT TRAFIC SL28 ENERGY dCi 145 Business 9 Seater',
 'transmission': 'manual',
 'trim': 'SL28 ENERGY dCi 145 Business 9 Seater',
 'year': 2022}
2025-12-05 06:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273784865%27 HTTP/1.1" 200 None
2025-12-05 06:06:16 [manheim.gb] INFO: Saving data for 3784865: {'created_time': 1764914776.261112, 'last_price_update_time': 1764914776.261133, 'auction_closing_time': 1764925200.0}
2025-12-05 06:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3784865') HTTP/1.1" 204 0
2025-12-05 06:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3641838-4008198-13.jpg> (referer: None)
2025-12-05 06:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3641838-4008198-1002.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3641838-4008198-1002.jpg not downloaded yet
2025-12-05 06:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3641838-4008198-8.jpg> (referer: None)
2025-12-05 06:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3641838-4008198-1003.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3641838-4008198-1003.jpg not downloaded yet
2025-12-05 06:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3641838-4008198-42.jpg> (referer: None)
2025-12-05 06:06:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342509010>
2025-12-05 06:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:06:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003/c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003_expert_report_file_c842eded-80c9-4ca9-b9a7-ec4672704522.pdf HTTP/1.1" 201 0
2025-12-05 06:06:16 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003
2025-12-05 06:06:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003, skipping ID generation
2025-12-05 06:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003
2025-12-05 06:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd1395fce-b858-4ee7-a0a2-66271312bd4c_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d1395fce-b858-4ee7-a0a2-66271312bd4c_ext_7.jpg not downloaded yet
2025-12-05 06:06:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234247b4d0>
2025-12-05 06:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:06:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1759cc2-a8c3-545a-9cf7-a69ef72be55f/e1759cc2-a8c3-545a-9cf7-a69ef72be55f_image_8.jpg HTTP/1.1" 201 0
2025-12-05 06:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3641838-4008198-16.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3641838-4008198-16.jpg saved to cache
2025-12-05 06:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e1759cc2-a8c3-545a-9cf7-a69ef72be55f
2025-12-05 06:06:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23415fba90>
2025-12-05 06:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:06:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1759cc2-a8c3-545a-9cf7-a69ef72be55f/e1759cc2-a8c3-545a-9cf7-a69ef72be55f_image_9.jpg HTTP/1.1" 201 0
2025-12-05 06:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3641838-4008198-28.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3641838-4008198-28.jpg saved to cache
2025-12-05 06:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e1759cc2-a8c3-545a-9cf7-a69ef72be55f
2025-12-05 06:06:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234274eb10>
2025-12-05 06:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:06:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1759cc2-a8c3-545a-9cf7-a69ef72be55f/e1759cc2-a8c3-545a-9cf7-a69ef72be55f_image_7.jpg HTTP/1.1" 201 0
2025-12-05 06:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3641838-4008198-15.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3641838-4008198-15.jpg saved to cache
2025-12-05 06:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e1759cc2-a8c3-545a-9cf7-a69ef72be55f
2025-12-05 06:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3641838-4008198-1004.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3641838-4008198-1004.jpg not downloaded yet
2025-12-05 06:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd1395fce-b858-4ee7-a0a2-66271312bd4c_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d1395fce-b858-4ee7-a0a2-66271312bd4c_ext_7.jpg not downloaded yet
2025-12-05 06:06:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23415e8a50>
2025-12-05 06:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:06:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1759cc2-a8c3-545a-9cf7-a69ef72be55f/e1759cc2-a8c3-545a-9cf7-a69ef72be55f_image_5.jpg HTTP/1.1" 201 0
2025-12-05 06:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3641838-4008198-13.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3641838-4008198-13.jpg saved to cache
2025-12-05 06:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e1759cc2-a8c3-545a-9cf7-a69ef72be55f
2025-12-05 06:06:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234157ce10>
2025-12-05 06:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1759cc2-a8c3-545a-9cf7-a69ef72be55f/e1759cc2-a8c3-545a-9cf7-a69ef72be55f_image_6.jpg HTTP/1.1" 201 0
2025-12-05 06:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3641838-4008198-8.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3641838-4008198-8.jpg saved to cache
2025-12-05 06:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e1759cc2-a8c3-545a-9cf7-a69ef72be55f
2025-12-05 06:06:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342478710>
2025-12-05 06:06:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1759cc2-a8c3-545a-9cf7-a69ef72be55f/e1759cc2-a8c3-545a-9cf7-a69ef72be55f_image_10.jpg HTTP/1.1" 201 0
2025-12-05 06:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3641838-4008198-42.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3641838-4008198-42.jpg saved to cache
2025-12-05 06:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item e1759cc2-a8c3-545a-9cf7-a69ef72be55f
2025-12-05 06:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd1395fce-b858-4ee7-a0a2-66271312bd4c_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d1395fce-b858-4ee7-a0a2-66271312bd4c_ext_6.jpg not downloaded yet
2025-12-05 06:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd1395fce-b858-4ee7-a0a2-66271312bd4c_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d1395fce-b858-4ee7-a0a2-66271312bd4c_ext_1.jpg not downloaded yet
2025-12-05 06:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/b74107a6-143f-4b9b-b00f-d75d11547e4d_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003791288-01777440-004.pdf)
2025-12-05 06:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3641838-4008198-1000.jpg> (referer: None)
2025-12-05 06:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3641838-4008198-1001.jpg> (referer: None)
2025-12-05 06:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd1395fce-b858-4ee7-a0a2-66271312bd4c_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d1395fce-b858-4ee7-a0a2-66271312bd4c_5.jpg not downloaded yet
2025-12-05 06:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3641838-4008198-1002.jpg> (referer: None)
2025-12-05 06:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3641838-4008198-44.jpg> (referer: None)
2025-12-05 06:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3641838-4008198-1003.jpg> (referer: None)
2025-12-05 06:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd1395fce-b858-4ee7-a0a2-66271312bd4c_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d1395fce-b858-4ee7-a0a2-66271312bd4c_4.jpg not downloaded yet
2025-12-05 06:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3641838-4008198-43.jpg> (referer: None)
2025-12-05 06:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd1395fce-b858-4ee7-a0a2-66271312bd4c_11.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d1395fce-b858-4ee7-a0a2-66271312bd4c_11.jpg not downloaded yet
2025-12-05 06:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd1395fce-b858-4ee7-a0a2-66271312bd4c_10.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d1395fce-b858-4ee7-a0a2-66271312bd4c_10.jpg not downloaded yet
2025-12-05 06:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd1395fce-b858-4ee7-a0a2-66271312bd4c_9.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d1395fce-b858-4ee7-a0a2-66271312bd4c_9.jpg not downloaded yet
2025-12-05 06:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd1395fce-b858-4ee7-a0a2-66271312bd4c_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d1395fce-b858-4ee7-a0a2-66271312bd4c_ext_2.jpg not downloaded yet
2025-12-05 06:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd1395fce-b858-4ee7-a0a2-66271312bd4c_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d1395fce-b858-4ee7-a0a2-66271312bd4c_ext_5.jpg not downloaded yet
2025-12-05 06:06:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23423ab790>
2025-12-05 06:06:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10b93c70-9ccd-5c79-bbc5-6fb60601b311/10b93c70-9ccd-5c79-bbc5-6fb60601b311_image_0.jpg HTTP/1.1" 201 0
2025-12-05 06:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fb74107a6-143f-4b9b-b00f-d75d11547e4d_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/b74107a6-143f-4b9b-b00f-d75d11547e4d_ext_7.jpg saved to cache
2025-12-05 06:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 10b93c70-9ccd-5c79-bbc5-6fb60601b311
2025-12-05 06:06:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 10b93c70-9ccd-5c79-bbc5-6fb60601b311, skipping ID generation
2025-12-05 06:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 10b93c70-9ccd-5c79-bbc5-6fb60601b311 from tracking dictionaries
2025-12-05 06:06:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 10b93c70-9ccd-5c79-bbc5-6fb60601b311 sending to next pipeline
2025-12-05 06:06:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 10b93c70-9ccd-5c79-bbc5-6fb60601b311, identifier: 3791288
2025-12-05 06:06:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23415ea110>
2025-12-05 06:06:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:06:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1759cc2-a8c3-545a-9cf7-a69ef72be55f/e1759cc2-a8c3-545a-9cf7-a69ef72be55f_image_13.jpg HTTP/1.1" 201 0
2025-12-05 06:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3641838-4008198-1000.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3641838-4008198-1000.jpg saved to cache
2025-12-05 06:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item e1759cc2-a8c3-545a-9cf7-a69ef72be55f
2025-12-05 06:06:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341f32b50>
2025-12-05 06:06:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:06:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1759cc2-a8c3-545a-9cf7-a69ef72be55f/e1759cc2-a8c3-545a-9cf7-a69ef72be55f_image_14.jpg HTTP/1.1" 201 0
2025-12-05 06:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3641838-4008198-1001.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3641838-4008198-1001.jpg saved to cache
2025-12-05 06:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item e1759cc2-a8c3-545a-9cf7-a69ef72be55f
2025-12-05 06:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd1395fce-b858-4ee7-a0a2-66271312bd4c_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d1395fce-b858-4ee7-a0a2-66271312bd4c_ext_3.jpg not downloaded yet
2025-12-05 06:06:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 10b93c70-9ccd-5c79-bbc5-6fb60601b311 with identifier: 3791288
2025-12-05 06:06:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 10b93c70-9ccd-5c79-bbc5-6fb60601b311 with identifier: 3791288
2025-12-05 06:06:19 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 10b93c70-9ccd-5c79-bbc5-6fb60601b311 with identifier: 3791288 to the API
2025-12-05 06:06:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 06:06:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 06:06:20 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/b74107a6-143f-4b9b-b00f-d75d11547e4d_ext_7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10b93c70-9ccd-5c79-bbc5-6fb60601b311/10b93c70-9ccd-5c79-bbc5-6fb60601b311_expert_report_file_2f8bb439-c01b-47d1-83f6-894de7b06808.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003791288-01777440-004.pdf',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.5L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '10b93c70-9ccd-5c79-bbc5-6fb60601b311',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'VE21WKT',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/AUDI/A3?id=3791288',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'AUDI',
 'model': 'A3',
 'odometer': 53450,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 34,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10b93c70-9ccd-5c79-bbc5-6fb60601b311/10b93c70-9ccd-5c79-bbc5-6fb60601b311_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 180602,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b74107a6-143f-4b9b-b00f-d75d11547e4d_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10b93c70-9ccd-5c79-bbc5-6fb60601b311/10b93c70-9ccd-5c79-bbc5-6fb60601b311_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 180602,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b74107a6-143f-4b9b-b00f-d75d11547e4d_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10b93c70-9ccd-5c79-bbc5-6fb60601b311/10b93c70-9ccd-5c79-bbc5-6fb60601b311_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 251166,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b74107a6-143f-4b9b-b00f-d75d11547e4d_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10b93c70-9ccd-5c79-bbc5-6fb60601b311/10b93c70-9ccd-5c79-bbc5-6fb60601b311_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 164163,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b74107a6-143f-4b9b-b00f-d75d11547e4d_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10b93c70-9ccd-5c79-bbc5-6fb60601b311/10b93c70-9ccd-5c79-bbc5-6fb60601b311_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 147106,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b74107a6-143f-4b9b-b00f-d75d11547e4d_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10b93c70-9ccd-5c79-bbc5-6fb60601b311/10b93c70-9ccd-5c79-bbc5-6fb60601b311_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 139872,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b74107a6-143f-4b9b-b00f-d75d11547e4d_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10b93c70-9ccd-5c79-bbc5-6fb60601b311/10b93c70-9ccd-5c79-bbc5-6fb60601b311_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 146788,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b74107a6-143f-4b9b-b00f-d75d11547e4d_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10b93c70-9ccd-5c79-bbc5-6fb60601b311/10b93c70-9ccd-5c79-bbc5-6fb60601b311_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 142129,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b74107a6-143f-4b9b-b00f-d75d11547e4d_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10b93c70-9ccd-5c79-bbc5-6fb60601b311/10b93c70-9ccd-5c79-bbc5-6fb60601b311_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 145123,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b74107a6-143f-4b9b-b00f-d75d11547e4d_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10b93c70-9ccd-5c79-bbc5-6fb60601b311/10b93c70-9ccd-5c79-bbc5-6fb60601b311_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 233640,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b74107a6-143f-4b9b-b00f-d75d11547e4d_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10b93c70-9ccd-5c79-bbc5-6fb60601b311/10b93c70-9ccd-5c79-bbc5-6fb60601b311_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 215876,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b74107a6-143f-4b9b-b00f-d75d11547e4d_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10b93c70-9ccd-5c79-bbc5-6fb60601b311/10b93c70-9ccd-5c79-bbc5-6fb60601b311_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 196576,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b74107a6-143f-4b9b-b00f-d75d11547e4d_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10b93c70-9ccd-5c79-bbc5-6fb60601b311/10b93c70-9ccd-5c79-bbc5-6fb60601b311_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 224388,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/b74107a6-143f-4b9b-b00f-d75d11547e4d_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10b93c70-9ccd-5c79-bbc5-6fb60601b311/10b93c70-9ccd-5c79-bbc5-6fb60601b311_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 371619,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3791288-3749769-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10b93c70-9ccd-5c79-bbc5-6fb60601b311/10b93c70-9ccd-5c79-bbc5-6fb60601b311_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 406651,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3791288-3749769-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10b93c70-9ccd-5c79-bbc5-6fb60601b311/10b93c70-9ccd-5c79-bbc5-6fb60601b311_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 273904,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3791288-3749769-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10b93c70-9ccd-5c79-bbc5-6fb60601b311/10b93c70-9ccd-5c79-bbc5-6fb60601b311_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 165393,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3791288-3749769-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10b93c70-9ccd-5c79-bbc5-6fb60601b311/10b93c70-9ccd-5c79-bbc5-6fb60601b311_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 267549,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3791288-3749769-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10b93c70-9ccd-5c79-bbc5-6fb60601b311/10b93c70-9ccd-5c79-bbc5-6fb60601b311_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 381515,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3791288-3749769-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10b93c70-9ccd-5c79-bbc5-6fb60601b311/10b93c70-9ccd-5c79-bbc5-6fb60601b311_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 341126,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3791288-3749769-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-25',
 'seller_name': 'FCA Group',
 'title': 'AUDI A3 35 TFSI Sport 5dr S Tronic',
 'transmission': 'automatic',
 'trim': '35 TFSI Sport 5dr S Tronic',
 'year': 2021}
2025-12-05 06:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273791288%27 HTTP/1.1" 200 None
2025-12-05 06:06:20 [manheim.gb] INFO: Saving data for 3791288: {'created_time': 1764914780.163379, 'last_price_update_time': 1764914780.163392, 'auction_closing_time': 1765184400.0}
2025-12-05 06:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3791288') HTTP/1.1" 204 0
2025-12-05 06:06:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342365350>
2025-12-05 06:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:06:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1759cc2-a8c3-545a-9cf7-a69ef72be55f/e1759cc2-a8c3-545a-9cf7-a69ef72be55f_image_15.jpg HTTP/1.1" 201 0
2025-12-05 06:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3641838-4008198-1002.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3641838-4008198-1002.jpg saved to cache
2025-12-05 06:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item e1759cc2-a8c3-545a-9cf7-a69ef72be55f
2025-12-05 06:06:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342810650>
2025-12-05 06:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:06:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1759cc2-a8c3-545a-9cf7-a69ef72be55f/e1759cc2-a8c3-545a-9cf7-a69ef72be55f_image_12.jpg HTTP/1.1" 201 0
2025-12-05 06:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3641838-4008198-44.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3641838-4008198-44.jpg saved to cache
2025-12-05 06:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item e1759cc2-a8c3-545a-9cf7-a69ef72be55f
2025-12-05 06:06:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234274d690>
2025-12-05 06:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:06:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1759cc2-a8c3-545a-9cf7-a69ef72be55f/e1759cc2-a8c3-545a-9cf7-a69ef72be55f_image_16.jpg HTTP/1.1" 201 0
2025-12-05 06:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3641838-4008198-1003.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3641838-4008198-1003.jpg saved to cache
2025-12-05 06:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item e1759cc2-a8c3-545a-9cf7-a69ef72be55f
2025-12-05 06:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd1395fce-b858-4ee7-a0a2-66271312bd4c_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d1395fce-b858-4ee7-a0a2-66271312bd4c_ext_4.jpg not downloaded yet
2025-12-05 06:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/FORD/FIESTA?id=3517150&returnUrl=%2Fsearch%3FPage%3D3%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233517150&indx=224> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d1395fce-b858-4ee7-a0a2-66271312bd4c_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003712711-01981914-003.pdf)
2025-12-05 06:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d1395fce-b858-4ee7-a0a2-66271312bd4c_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003712711-01981914-003.pdf)
2025-12-05 06:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d1395fce-b858-4ee7-a0a2-66271312bd4c_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003712711-01981914-003.pdf)
2025-12-05 06:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d1395fce-b858-4ee7-a0a2-66271312bd4c_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003712711-01981914-003.pdf)
2025-12-05 06:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3712711-3995757-13.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3712711-3995757-13.jpg not downloaded yet
2025-12-05 06:06:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:06:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341ea2650>
2025-12-05 06:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:06:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1759cc2-a8c3-545a-9cf7-a69ef72be55f/e1759cc2-a8c3-545a-9cf7-a69ef72be55f_image_11.jpg HTTP/1.1" 201 0
2025-12-05 06:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3641838-4008198-43.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3641838-4008198-43.jpg saved to cache
2025-12-05 06:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item e1759cc2-a8c3-545a-9cf7-a69ef72be55f
2025-12-05 06:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d1395fce-b858-4ee7-a0a2-66271312bd4c_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003712711-01981914-003.pdf)
2025-12-05 06:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d1395fce-b858-4ee7-a0a2-66271312bd4c_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003712711-01981914-003.pdf)
2025-12-05 06:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3641838-4008198-1004.jpg> (referer: None)
2025-12-05 06:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3712711-3995757-1000.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3712711-3995757-1000.jpg not downloaded yet
2025-12-05 06:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3712711-3995757-1001.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3712711-3995757-1001.jpg not downloaded yet
2025-12-05 06:06:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a64efbf-cabf-59ed-9ed9-e7eaa4df9787 with identifier: 3517150
2025-12-05 06:06:21 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 2a64efbf-cabf-59ed-9ed9-e7eaa4df9787
2025-12-05 06:06:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342662a10>
2025-12-05 06:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:06:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003/c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003_image_1.jpg HTTP/1.1" 201 0
2025-12-05 06:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd1395fce-b858-4ee7-a0a2-66271312bd4c_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d1395fce-b858-4ee7-a0a2-66271312bd4c_ext_7.jpg saved to cache
2025-12-05 06:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003
2025-12-05 06:06:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23424cefd0>
2025-12-05 06:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:06:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003/c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003_image_0.jpg HTTP/1.1" 201 0
2025-12-05 06:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd1395fce-b858-4ee7-a0a2-66271312bd4c_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d1395fce-b858-4ee7-a0a2-66271312bd4c_ext_7.jpg saved to cache
2025-12-05 06:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003
2025-12-05 06:06:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23427a62d0>
2025-12-05 06:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 06:06:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003/c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003_image_4.jpg HTTP/1.1" 201 0
2025-12-05 06:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd1395fce-b858-4ee7-a0a2-66271312bd4c_5.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d1395fce-b858-4ee7-a0a2-66271312bd4c_5.jpg saved to cache
2025-12-05 06:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003
2025-12-05 06:06:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425621d0>
2025-12-05 06:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:06:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003/c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003_image_5.jpg HTTP/1.1" 201 0
2025-12-05 06:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd1395fce-b858-4ee7-a0a2-66271312bd4c_4.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d1395fce-b858-4ee7-a0a2-66271312bd4c_4.jpg saved to cache
2025-12-05 06:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003
2025-12-05 06:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3712711-3995757-1002.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3712711-3995757-1002.jpg not downloaded yet
2025-12-05 06:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3712711-3995757-1003.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3712711-3995757-1003.jpg not downloaded yet
2025-12-05 06:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d1395fce-b858-4ee7-a0a2-66271312bd4c_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003712711-01981914-003.pdf)
2025-12-05 06:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d1395fce-b858-4ee7-a0a2-66271312bd4c_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003712711-01981914-003.pdf)
2025-12-05 06:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d1395fce-b858-4ee7-a0a2-66271312bd4c_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003712711-01981914-003.pdf)
2025-12-05 06:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d1395fce-b858-4ee7-a0a2-66271312bd4c_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003712711-01981914-003.pdf)
2025-12-05 06:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d1395fce-b858-4ee7-a0a2-66271312bd4c_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003712711-01981914-003.pdf)
2025-12-05 06:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d1395fce-b858-4ee7-a0a2-66271312bd4c_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003712711-01981914-003.pdf)
2025-12-05 06:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3712711-3995757-1004.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3712711-3995757-1004.jpg not downloaded yet
2025-12-05 06:06:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234245e110>
2025-12-05 06:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 06:06:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003/c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003_image_3.jpg HTTP/1.1" 201 0
2025-12-05 06:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd1395fce-b858-4ee7-a0a2-66271312bd4c_ext_1.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d1395fce-b858-4ee7-a0a2-66271312bd4c_ext_1.jpg saved to cache
2025-12-05 06:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003
2025-12-05 06:06:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342389890>
2025-12-05 06:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:06:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003/c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003_image_2.jpg HTTP/1.1" 201 0
2025-12-05 06:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd1395fce-b858-4ee7-a0a2-66271312bd4c_ext_6.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d1395fce-b858-4ee7-a0a2-66271312bd4c_ext_6.jpg saved to cache
2025-12-05 06:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003
2025-12-05 06:06:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23423746d0>
2025-12-05 06:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:06:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1759cc2-a8c3-545a-9cf7-a69ef72be55f/e1759cc2-a8c3-545a-9cf7-a69ef72be55f_image_17.jpg HTTP/1.1" 201 0
2025-12-05 06:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3641838-4008198-1004.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3641838-4008198-1004.jpg saved to cache
2025-12-05 06:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item e1759cc2-a8c3-545a-9cf7-a69ef72be55f
2025-12-05 06:06:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e1759cc2-a8c3-545a-9cf7-a69ef72be55f, skipping ID generation
2025-12-05 06:06:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1759cc2-a8c3-545a-9cf7-a69ef72be55f with scrape type 1
2025-12-05 06:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e1759cc2-a8c3-545a-9cf7-a69ef72be55f from tracking dictionaries
2025-12-05 06:06:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e1759cc2-a8c3-545a-9cf7-a69ef72be55f sending to next pipeline
2025-12-05 06:06:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: e1759cc2-a8c3-545a-9cf7-a69ef72be55f, identifier: 3641838
2025-12-05 06:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d1395fce-b858-4ee7-a0a2-66271312bd4c_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003712711-01981914-003.pdf)
2025-12-05 06:06:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: e1759cc2-a8c3-545a-9cf7-a69ef72be55f with identifier: 3641838
2025-12-05 06:06:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: e1759cc2-a8c3-545a-9cf7-a69ef72be55f with identifier: 3641838
2025-12-05 06:06:23 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: e1759cc2-a8c3-545a-9cf7-a69ef72be55f with identifier: 3641838 to the API
2025-12-05 06:06:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 06:06:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 06:06:24 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/insp-0001-3641838-4008198-1004.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'car_expert_report_source_url': None,
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': '2025-12-16T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'e1759cc2-a8c3-545a-9cf7-a69ef72be55f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'AK71ETE',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/PEUGEOT/2008?id=3641838',
 'listing': 'auction',
 'location': 'Bristol',
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 31279,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 18,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1759cc2-a8c3-545a-9cf7-a69ef72be55f/e1759cc2-a8c3-545a-9cf7-a69ef72be55f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 493614,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3641838-4008198-1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1759cc2-a8c3-545a-9cf7-a69ef72be55f/e1759cc2-a8c3-545a-9cf7-a69ef72be55f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 297839,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3641838-4008198-2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1759cc2-a8c3-545a-9cf7-a69ef72be55f/e1759cc2-a8c3-545a-9cf7-a69ef72be55f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 144893,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3641838-4008198-3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1759cc2-a8c3-545a-9cf7-a69ef72be55f/e1759cc2-a8c3-545a-9cf7-a69ef72be55f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 402647,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3641838-4008198-4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1759cc2-a8c3-545a-9cf7-a69ef72be55f/e1759cc2-a8c3-545a-9cf7-a69ef72be55f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 425395,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3641838-4008198-6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1759cc2-a8c3-545a-9cf7-a69ef72be55f/e1759cc2-a8c3-545a-9cf7-a69ef72be55f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 357913,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3641838-4008198-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1759cc2-a8c3-545a-9cf7-a69ef72be55f/e1759cc2-a8c3-545a-9cf7-a69ef72be55f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 446897,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3641838-4008198-8.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1759cc2-a8c3-545a-9cf7-a69ef72be55f/e1759cc2-a8c3-545a-9cf7-a69ef72be55f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 223303,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3641838-4008198-15.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1759cc2-a8c3-545a-9cf7-a69ef72be55f/e1759cc2-a8c3-545a-9cf7-a69ef72be55f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 241896,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3641838-4008198-16.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1759cc2-a8c3-545a-9cf7-a69ef72be55f/e1759cc2-a8c3-545a-9cf7-a69ef72be55f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 261520,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3641838-4008198-28.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1759cc2-a8c3-545a-9cf7-a69ef72be55f/e1759cc2-a8c3-545a-9cf7-a69ef72be55f_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 209128,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3641838-4008198-42.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1759cc2-a8c3-545a-9cf7-a69ef72be55f/e1759cc2-a8c3-545a-9cf7-a69ef72be55f_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 431572,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3641838-4008198-43.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1759cc2-a8c3-545a-9cf7-a69ef72be55f/e1759cc2-a8c3-545a-9cf7-a69ef72be55f_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 276334,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3641838-4008198-44.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1759cc2-a8c3-545a-9cf7-a69ef72be55f/e1759cc2-a8c3-545a-9cf7-a69ef72be55f_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257140,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3641838-4008198-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1759cc2-a8c3-545a-9cf7-a69ef72be55f/e1759cc2-a8c3-545a-9cf7-a69ef72be55f_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 211954,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3641838-4008198-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1759cc2-a8c3-545a-9cf7-a69ef72be55f/e1759cc2-a8c3-545a-9cf7-a69ef72be55f_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 309998,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3641838-4008198-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1759cc2-a8c3-545a-9cf7-a69ef72be55f/e1759cc2-a8c3-545a-9cf7-a69ef72be55f_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 330123,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3641838-4008198-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1759cc2-a8c3-545a-9cf7-a69ef72be55f/e1759cc2-a8c3-545a-9cf7-a69ef72be55f_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 288688,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3641838-4008198-1004.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-18',
 'seller_name': 'Santander Consumer',
 'title': 'PEUGEOT 2008 1.2 PureTech 130 GT 5dr EAT8',
 'transmission': 'automatic',
 'trim': '1.2 PureTech 130 GT 5dr EAT8',
 'year': 2021}
2025-12-05 06:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273641838%27 HTTP/1.1" 200 None
2025-12-05 06:06:24 [manheim.gb] INFO: Saving data for 3641838: {'created_time': 1764914784.126572, 'last_price_update_time': 1764914784.126586, 'auction_closing_time': 1765875600.0}
2025-12-05 06:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3641838') HTTP/1.1" 204 0
2025-12-05 06:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3712711-3995757-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003712711-01981914-003.pdf)
2025-12-05 06:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3712711-3995757-1005.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3712711-3995757-1005.jpg not downloaded yet
2025-12-05 06:06:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341eb8610>
2025-12-05 06:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:06:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003/c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003_image_12.jpg HTTP/1.1" 201 0
2025-12-05 06:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd1395fce-b858-4ee7-a0a2-66271312bd4c_ext_4.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d1395fce-b858-4ee7-a0a2-66271312bd4c_ext_4.jpg saved to cache
2025-12-05 06:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003
2025-12-05 06:06:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341efd310>
2025-12-05 06:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:06:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003/c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003_image_10.jpg HTTP/1.1" 201 0
2025-12-05 06:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd1395fce-b858-4ee7-a0a2-66271312bd4c_ext_5.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d1395fce-b858-4ee7-a0a2-66271312bd4c_ext_5.jpg saved to cache
2025-12-05 06:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003
2025-12-05 06:06:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341eb9650>
2025-12-05 06:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:06:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003/c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003_image_11.jpg HTTP/1.1" 201 0
2025-12-05 06:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd1395fce-b858-4ee7-a0a2-66271312bd4c_ext_3.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d1395fce-b858-4ee7-a0a2-66271312bd4c_ext_3.jpg saved to cache
2025-12-05 06:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003
2025-12-05 06:06:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341eff010>
2025-12-05 06:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:06:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003/c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003_image_8.jpg HTTP/1.1" 201 0
2025-12-05 06:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd1395fce-b858-4ee7-a0a2-66271312bd4c_9.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d1395fce-b858-4ee7-a0a2-66271312bd4c_9.jpg saved to cache
2025-12-05 06:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003
2025-12-05 06:06:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341efc790>
2025-12-05 06:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:06:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003/c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003_image_7.jpg HTTP/1.1" 201 0
2025-12-05 06:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd1395fce-b858-4ee7-a0a2-66271312bd4c_10.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d1395fce-b858-4ee7-a0a2-66271312bd4c_10.jpg saved to cache
2025-12-05 06:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003
2025-12-05 06:06:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341e91a90>
2025-12-05 06:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:06:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003/c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003_image_6.jpg HTTP/1.1" 201 0
2025-12-05 06:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd1395fce-b858-4ee7-a0a2-66271312bd4c_11.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d1395fce-b858-4ee7-a0a2-66271312bd4c_11.jpg saved to cache
2025-12-05 06:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003
2025-12-05 06:06:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23415d7690>
2025-12-05 06:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:06:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003/c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003_image_9.jpg HTTP/1.1" 201 0
2025-12-05 06:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd1395fce-b858-4ee7-a0a2-66271312bd4c_ext_2.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d1395fce-b858-4ee7-a0a2-66271312bd4c_ext_2.jpg saved to cache
2025-12-05 06:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003
2025-12-05 06:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3787547-3993510-1006.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003787547-01969277-004.pdf)
2025-12-05 06:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3712711-3995757-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003712711-01981914-003.pdf)
2025-12-05 06:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3712711-3995757-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003712711-01981914-003.pdf)
2025-12-05 06:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3712711-3995757-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003712711-01981914-003.pdf)
2025-12-05 06:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3712711-3995757-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003712711-01981914-003.pdf)
2025-12-05 06:06:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23415c2250>
2025-12-05 06:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:06:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003/c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003_image_13.jpg HTTP/1.1" 201 0
2025-12-05 06:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3712711-3995757-13.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3712711-3995757-13.jpg saved to cache
2025-12-05 06:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003
2025-12-05 06:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3712711-3995757-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003712711-01981914-003.pdf)
2025-12-05 06:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3787547-3993510-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003787547-01969277-004.pdf)
2025-12-05 06:06:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341546490>
2025-12-05 06:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:06:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_301a1c7b-dc57-5e53-a180-51a6be347921/301a1c7b-dc57-5e53-a180-51a6be347921_image_10.jpg HTTP/1.1" 201 0
2025-12-05 06:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3787547-3993510-1006.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3787547-3993510-1006.jpg saved to cache
2025-12-05 06:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 301a1c7b-dc57-5e53-a180-51a6be347921
2025-12-05 06:06:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341f30f10>
2025-12-05 06:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:06:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003/c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003_image_17.jpg HTTP/1.1" 201 0
2025-12-05 06:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3712711-3995757-1003.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3712711-3995757-1003.jpg saved to cache
2025-12-05 06:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003
2025-12-05 06:06:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234245df10>
2025-12-05 06:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003/c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003_image_16.jpg HTTP/1.1" 201 0
2025-12-05 06:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3712711-3995757-1002.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3712711-3995757-1002.jpg saved to cache
2025-12-05 06:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003
2025-12-05 06:06:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23415a2c10>
2025-12-05 06:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003/c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003_image_14.jpg HTTP/1.1" 201 0
2025-12-05 06:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3712711-3995757-1000.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3712711-3995757-1000.jpg saved to cache
2025-12-05 06:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003
2025-12-05 06:06:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234157c310>
2025-12-05 06:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003/c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003_image_15.jpg HTTP/1.1" 201 0
2025-12-05 06:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3712711-3995757-1001.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3712711-3995757-1001.jpg saved to cache
2025-12-05 06:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003
2025-12-05 06:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3712711-3995757-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003712711-01981914-003.pdf)
2025-12-05 06:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3787547-3993510-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003787547-01969277-004.pdf)
2025-12-05 06:06:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234239ba50>
2025-12-05 06:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:06:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003/c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003_image_18.jpg HTTP/1.1" 201 0
2025-12-05 06:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3712711-3995757-1004.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3712711-3995757-1004.jpg saved to cache
2025-12-05 06:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003
2025-12-05 06:06:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23423aab10>
2025-12-05 06:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:06:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_301a1c7b-dc57-5e53-a180-51a6be347921/301a1c7b-dc57-5e53-a180-51a6be347921_image_9.jpg HTTP/1.1" 201 0
2025-12-05 06:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3787547-3993510-1005.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3787547-3993510-1005.jpg saved to cache
2025-12-05 06:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 301a1c7b-dc57-5e53-a180-51a6be347921
2025-12-05 06:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3787547-3993510-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003787547-01969277-004.pdf)
2025-12-05 06:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3787547-3993510-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003787547-01969277-004.pdf)
2025-12-05 06:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3787547-3993510-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003787547-01969277-004.pdf)
2025-12-05 06:06:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341f00d50>
2025-12-05 06:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:06:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003/c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003_image_19.jpg HTTP/1.1" 201 0
2025-12-05 06:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3712711-3995757-1005.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3712711-3995757-1005.jpg saved to cache
2025-12-05 06:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003
2025-12-05 06:06:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003, skipping ID generation
2025-12-05 06:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Removing item c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003 from tracking dictionaries
2025-12-05 06:06:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003 sending to next pipeline
2025-12-05 06:06:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003, identifier: 3712711
2025-12-05 06:06:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234278c3d0>
2025-12-05 06:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:06:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_301a1c7b-dc57-5e53-a180-51a6be347921/301a1c7b-dc57-5e53-a180-51a6be347921_image_8.jpg HTTP/1.1" 201 0
2025-12-05 06:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3787547-3993510-1004.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3787547-3993510-1004.jpg saved to cache
2025-12-05 06:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 301a1c7b-dc57-5e53-a180-51a6be347921
2025-12-05 06:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3805802-3964370-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003805802-01952362-005.pdf)
2025-12-05 06:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3787547-3993510-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003787547-01969277-004.pdf)
2025-12-05 06:06:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003 with identifier: 3712711
2025-12-05 06:06:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003 with identifier: 3712711
2025-12-05 06:06:29 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003 with identifier: 3712711 to the API
2025-12-05 06:06:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 06:06:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 06:06:29 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/insp-0001-3712711-3995757-1005.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003/c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003_expert_report_file_c842eded-80c9-4ca9-b9a7-ec4672704522.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003712711-01981914-003.pdf',
 'color': 'SILVER',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': '2025-12-10T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'WL17JBX',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/TIGUAN?id=3712711',
 'listing': 'directbuy',
 'location': 'Plymouth',
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN',
 'odometer': 77039,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003/c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 237117,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d1395fce-b858-4ee7-a0a2-66271312bd4c_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003/c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 237117,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d1395fce-b858-4ee7-a0a2-66271312bd4c_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003/c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 278557,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d1395fce-b858-4ee7-a0a2-66271312bd4c_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003/c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 261902,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d1395fce-b858-4ee7-a0a2-66271312bd4c_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003/c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 233705,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d1395fce-b858-4ee7-a0a2-66271312bd4c_5.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003/c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 230599,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d1395fce-b858-4ee7-a0a2-66271312bd4c_4.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003/c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 230087,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d1395fce-b858-4ee7-a0a2-66271312bd4c_11.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003/c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 222912,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d1395fce-b858-4ee7-a0a2-66271312bd4c_10.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003/c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 232000,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d1395fce-b858-4ee7-a0a2-66271312bd4c_9.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003/c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 274187,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d1395fce-b858-4ee7-a0a2-66271312bd4c_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003/c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 230829,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d1395fce-b858-4ee7-a0a2-66271312bd4c_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003/c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 261559,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d1395fce-b858-4ee7-a0a2-66271312bd4c_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003/c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 230359,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d1395fce-b858-4ee7-a0a2-66271312bd4c_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003/c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 364154,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3712711-3995757-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003/c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 340697,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3712711-3995757-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003/c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 366073,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3712711-3995757-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003/c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 270522,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3712711-3995757-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003/c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 274877,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3712711-3995757-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003/c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 252389,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3712711-3995757-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003/c4b9dc9b-22d1-5ad8-b38c-cf0dcdf21003_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 243330,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3712711-3995757-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-29',
 'seller_name': 'Yeomans',
 'title': 'VOLKSWAGEN TIGUAN 2.0 TDi 150 4Motion SEL 5dr',
 'transmission': 'manual',
 'trim': '2.0 TDi 150 4Motion SEL 5dr',
 'year': 2017}
2025-12-05 06:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273712711%27 HTTP/1.1" 200 None
2025-12-05 06:06:29 [manheim.gb] INFO: Saving data for 3712711: {'created_time': 1764914789.990437, 'last_price_update_time': 1764914789.990452, 'auction_closing_time': 1765357200.0}
2025-12-05 06:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3712711') HTTP/1.1" 204 0
2025-12-05 06:06:30 [scrapy.extensions.logstats] INFO: Crawled 116 pages (at 25 pages/min), scraped 35 items (at 10 items/min)
2025-12-05 06:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/LAND%20ROVER/DISCOVERYSPORT?id=3507560&returnUrl=%2Fsearch%3FPage%3D3%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233507560&indx=220> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/TESLA/MODEL?id=3512799&returnUrl=%2Fsearch%3FPage%3D3%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233512799&indx=222> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:06:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342512550>
2025-12-05 06:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_301a1c7b-dc57-5e53-a180-51a6be347921/301a1c7b-dc57-5e53-a180-51a6be347921_image_5.jpg HTTP/1.1" 201 0
2025-12-05 06:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3787547-3993510-1001.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3787547-3993510-1001.jpg saved to cache
2025-12-05 06:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 301a1c7b-dc57-5e53-a180-51a6be347921
2025-12-05 06:06:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23427770d0>
2025-12-05 06:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_301a1c7b-dc57-5e53-a180-51a6be347921/301a1c7b-dc57-5e53-a180-51a6be347921_image_6.jpg HTTP/1.1" 201 0
2025-12-05 06:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3787547-3993510-1002.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3787547-3993510-1002.jpg saved to cache
2025-12-05 06:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 301a1c7b-dc57-5e53-a180-51a6be347921
2025-12-05 06:06:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234269d6d0>
2025-12-05 06:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_301a1c7b-dc57-5e53-a180-51a6be347921/301a1c7b-dc57-5e53-a180-51a6be347921_image_7.jpg HTTP/1.1" 201 0
2025-12-05 06:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3787547-3993510-1003.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3787547-3993510-1003.jpg saved to cache
2025-12-05 06:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 301a1c7b-dc57-5e53-a180-51a6be347921
2025-12-05 06:06:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234269c710>
2025-12-05 06:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:06:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_041c8cec-8167-5084-8ad7-2c260146c6b5/041c8cec-8167-5084-8ad7-2c260146c6b5_image_19.jpg HTTP/1.1" 201 0
2025-12-05 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3805802-3964370-1005.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3805802-3964370-1005.jpg saved to cache
2025-12-05 06:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 041c8cec-8167-5084-8ad7-2c260146c6b5
2025-12-05 06:06:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234278cbd0>
2025-12-05 06:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:06:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_301a1c7b-dc57-5e53-a180-51a6be347921/301a1c7b-dc57-5e53-a180-51a6be347921_image_4.jpg HTTP/1.1" 201 0
2025-12-05 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3787547-3993510-1000.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3787547-3993510-1000.jpg saved to cache
2025-12-05 06:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 301a1c7b-dc57-5e53-a180-51a6be347921
2025-12-05 06:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3805802-3964370-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003805802-01952362-005.pdf)
2025-12-05 06:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3805802-3964370-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003805802-01952362-005.pdf)
2025-12-05 06:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3787547-3993510-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003787547-01969277-004.pdf)
2025-12-05 06:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3787547-3993510-3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003787547-01969277-004.pdf)
2025-12-05 06:06:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 704c068a-cf76-5a52-8757-ea943f020757 with identifier: 3507560
2025-12-05 06:06:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 704c068a-cf76-5a52-8757-ea943f020757 with scrape type 2
2025-12-05 06:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 704c068a-cf76-5a52-8757-ea943f020757 with scrape type 2
2025-12-05 06:06:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 704c068a-cf76-5a52-8757-ea943f020757, identifier: 3507560
2025-12-05 06:06:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b226d4b-eab0-5a6d-b970-3ae3d8509e6f with identifier: 3512799
2025-12-05 06:06:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b226d4b-eab0-5a6d-b970-3ae3d8509e6f with scrape type 2
2025-12-05 06:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b226d4b-eab0-5a6d-b970-3ae3d8509e6f with scrape type 2
2025-12-05 06:06:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 1b226d4b-eab0-5a6d-b970-3ae3d8509e6f, identifier: 3512799
2025-12-05 06:06:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 704c068a-cf76-5a52-8757-ea943f020757 with identifier: 3507560
2025-12-05 06:06:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 704c068a-cf76-5a52-8757-ea943f020757 with identifier: 3507560
2025-12-05 06:06:32 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 704c068a-cf76-5a52-8757-ea943f020757 with identifier: 3507560 to the API
2025-12-05 06:06:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 06:06:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 06:06:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/LAND%20ROVER/DISCOVERYSPORT?id=3507560&returnUrl=%2Fsearch%3FPage%3D3%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233507560&indx=220>
{'auction_title': '',
 'c_o_2_emission_value': 179,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003507560-01987335-002.pdf',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '704c068a-cf76-5a52-8757-ea943f020757',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'OV21DDK',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/LAND%20ROVER/DISCOVERY%20SPORT?id=3507560',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'LAND ROVER',
 'model': 'DISCOVERY SPORT',
 'odometer': 50847,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-19',
 'seller_name': 'Santander Consumer',
 'title': 'LAND ROVER DISCOVERY SPORT 2.0 D200 R-Dynamic S Plus 5dr Auto [5 '
          'Seat]',
 'transmission': 'automatic',
 'trim': '2.0 D200 R-Dynamic S Plus 5dr Auto [5 Seat]',
 'year': 2021}
2025-12-05 06:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273507560%27 HTTP/1.1" 200 None
2025-12-05 06:06:32 [manheim.gb] INFO: Saving data for 3507560: {'auction_closing_time': 1765270800.0, 'created_time': 1764828096.321555, 'last_price_update_time': 1764914792.232585}
2025-12-05 06:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3507560') HTTP/1.1" 204 0
2025-12-05 06:06:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 1b226d4b-eab0-5a6d-b970-3ae3d8509e6f with identifier: 3512799
2025-12-05 06:06:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 1b226d4b-eab0-5a6d-b970-3ae3d8509e6f with identifier: 3512799
2025-12-05 06:06:32 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 1b226d4b-eab0-5a6d-b970-3ae3d8509e6f with identifier: 3512799 to the API
2025-12-05 06:06:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 06:06:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 06:06:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/TESLA/MODEL?id=3512799&returnUrl=%2Fsearch%3FPage%3D3%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233512799&indx=222>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003512799-01938510-005.pdf',
 'color': 'BLUE',
 'currency': 'GBP',
 'engine': '0.0L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Electric',
 'id': '1b226d4b-eab0-5a6d-b970-3ae3d8509e6f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'LF22UPV',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/TESLA/MODEL?id=3512799',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'TESLA',
 'model': 'MODEL',
 'odometer': 30801,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-24',
 'seller_name': 'Santander Consumer',
 'title': 'TESLA MODEL Long Range AWD 5dr Auto',
 'transmission': 'automatic',
 'trim': 'Long Range AWD 5dr Auto',
 'year': 2022}
2025-12-05 06:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273512799%27 HTTP/1.1" 200 None
2025-12-05 06:06:32 [manheim.gb] INFO: Saving data for 3512799: {'auction_closing_time': 1765270800.0, 'created_time': 1764828087.76842, 'last_price_update_time': 1764914792.573233}
2025-12-05 06:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3512799') HTTP/1.1" 204 0
2025-12-05 06:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3805802-3964370-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003805802-01952362-005.pdf)
2025-12-05 06:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003517150-01993640-003.pdf> (referer: None)
2025-12-05 06:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003786170-01961777-006.pdf> (referer: None)
2025-12-05 06:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/GOLF?id=3476246&returnUrl=%2Fsearch%3FPage%3D3%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233476246&indx=217> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/980fa3c0-35b7-4fa4-9b6e-282c462ec266_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003805802-01952362-005.pdf)
2025-12-05 06:06:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234244e910>
2025-12-05 06:06:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:06:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_041c8cec-8167-5084-8ad7-2c260146c6b5/041c8cec-8167-5084-8ad7-2c260146c6b5_image_18.jpg HTTP/1.1" 201 0
2025-12-05 06:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3805802-3964370-1004.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3805802-3964370-1004.jpg saved to cache
2025-12-05 06:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 041c8cec-8167-5084-8ad7-2c260146c6b5
2025-12-05 06:06:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341eb1950>
2025-12-05 06:06:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 06:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_041c8cec-8167-5084-8ad7-2c260146c6b5/041c8cec-8167-5084-8ad7-2c260146c6b5_image_17.jpg HTTP/1.1" 201 0
2025-12-05 06:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3805802-3964370-1003.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3805802-3964370-1003.jpg saved to cache
2025-12-05 06:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 041c8cec-8167-5084-8ad7-2c260146c6b5
2025-12-05 06:06:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234257acd0>
2025-12-05 06:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_301a1c7b-dc57-5e53-a180-51a6be347921/301a1c7b-dc57-5e53-a180-51a6be347921_image_3.jpg HTTP/1.1" 201 0
2025-12-05 06:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3787547-3993510-13.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3787547-3993510-13.jpg saved to cache
2025-12-05 06:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 301a1c7b-dc57-5e53-a180-51a6be347921
2025-12-05 06:06:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341559e10>
2025-12-05 06:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_301a1c7b-dc57-5e53-a180-51a6be347921/301a1c7b-dc57-5e53-a180-51a6be347921_image_2.jpg HTTP/1.1" 201 0
2025-12-05 06:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3787547-3993510-3.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3787547-3993510-3.jpg saved to cache
2025-12-05 06:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 301a1c7b-dc57-5e53-a180-51a6be347921
2025-12-05 06:06:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 301a1c7b-dc57-5e53-a180-51a6be347921, skipping ID generation
2025-12-05 06:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 301a1c7b-dc57-5e53-a180-51a6be347921 from tracking dictionaries
2025-12-05 06:06:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 301a1c7b-dc57-5e53-a180-51a6be347921 sending to next pipeline
2025-12-05 06:06:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 301a1c7b-dc57-5e53-a180-51a6be347921, identifier: 3787547
2025-12-05 06:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/980fa3c0-35b7-4fa4-9b6e-282c462ec266_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003805802-01952362-005.pdf)
2025-12-05 06:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/980fa3c0-35b7-4fa4-9b6e-282c462ec266_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003805802-01952362-005.pdf)
2025-12-05 06:06:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 301a1c7b-dc57-5e53-a180-51a6be347921 with identifier: 3787547
2025-12-05 06:06:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 301a1c7b-dc57-5e53-a180-51a6be347921 with identifier: 3787547
2025-12-05 06:06:34 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 301a1c7b-dc57-5e53-a180-51a6be347921 with identifier: 3787547 to the API
2025-12-05 06:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 06:06:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 06:06:34 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/insp-0001-3787547-3993510-3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_301a1c7b-dc57-5e53-a180-51a6be347921/301a1c7b-dc57-5e53-a180-51a6be347921_expert_report_file_803f5848-0e1d-432f-ad14-ba303cf32ebb.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003787547-01969277-004.pdf',
 'color': 'RED',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': '2025-12-05T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '301a1c7b-dc57-5e53-a180-51a6be347921',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'DV24JZP',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VAUXHALL/GRANDLAND?id=3787547',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'VAUXHALL',
 'model': 'GRANDLAND',
 'odometer': 22873,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 34,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4622c3ba-5515-5758-814e-2f49e4247fa1/4622c3ba-5515-5758-814e-2f49e4247fa1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72484,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/awaiting-image-002.jpg',
             'Width': 1322},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4622c3ba-5515-5758-814e-2f49e4247fa1/4622c3ba-5515-5758-814e-2f49e4247fa1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72484,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/awaiting-image-002.jpg',
             'Width': 1322},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_301a1c7b-dc57-5e53-a180-51a6be347921/301a1c7b-dc57-5e53-a180-51a6be347921_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 176483,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3787547-3993510-3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_301a1c7b-dc57-5e53-a180-51a6be347921/301a1c7b-dc57-5e53-a180-51a6be347921_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 393914,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3787547-3993510-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_301a1c7b-dc57-5e53-a180-51a6be347921/301a1c7b-dc57-5e53-a180-51a6be347921_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 285526,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3787547-3993510-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_301a1c7b-dc57-5e53-a180-51a6be347921/301a1c7b-dc57-5e53-a180-51a6be347921_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 283180,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3787547-3993510-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_301a1c7b-dc57-5e53-a180-51a6be347921/301a1c7b-dc57-5e53-a180-51a6be347921_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328874,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3787547-3993510-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_301a1c7b-dc57-5e53-a180-51a6be347921/301a1c7b-dc57-5e53-a180-51a6be347921_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 383971,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3787547-3993510-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_301a1c7b-dc57-5e53-a180-51a6be347921/301a1c7b-dc57-5e53-a180-51a6be347921_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347901,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3787547-3993510-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_301a1c7b-dc57-5e53-a180-51a6be347921/301a1c7b-dc57-5e53-a180-51a6be347921_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 284097,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3787547-3993510-1005.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_301a1c7b-dc57-5e53-a180-51a6be347921/301a1c7b-dc57-5e53-a180-51a6be347921_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 254324,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3787547-3993510-1006.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_301a1c7b-dc57-5e53-a180-51a6be347921/301a1c7b-dc57-5e53-a180-51a6be347921_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 279389,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3787547-3993510-1007.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_301a1c7b-dc57-5e53-a180-51a6be347921/301a1c7b-dc57-5e53-a180-51a6be347921_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 214671,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3787547-3993510-1008.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_301a1c7b-dc57-5e53-a180-51a6be347921/301a1c7b-dc57-5e53-a180-51a6be347921_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116993,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3787547-3993510-1009.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_301a1c7b-dc57-5e53-a180-51a6be347921/301a1c7b-dc57-5e53-a180-51a6be347921_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 342898,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3787547-3993510-1010.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_301a1c7b-dc57-5e53-a180-51a6be347921/301a1c7b-dc57-5e53-a180-51a6be347921_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 360975,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3787547-3993510-1011.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_301a1c7b-dc57-5e53-a180-51a6be347921/301a1c7b-dc57-5e53-a180-51a6be347921_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 142558,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3787547-3993510-1012.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_301a1c7b-dc57-5e53-a180-51a6be347921/301a1c7b-dc57-5e53-a180-51a6be347921_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 158122,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3787547-3993510-1013.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_301a1c7b-dc57-5e53-a180-51a6be347921/301a1c7b-dc57-5e53-a180-51a6be347921_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 304532,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3787547-3993510-1014.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_301a1c7b-dc57-5e53-a180-51a6be347921/301a1c7b-dc57-5e53-a180-51a6be347921_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 436656,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3787547-3993510-1015.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-03-31',
 'seller_name': 'Leasys',
 'title': 'VAUXHALL GRANDLAND 1.2 Turbo Ultimate 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.2 Turbo Ultimate 5dr Auto',
 'year': 2024}
2025-12-05 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273787547%27 HTTP/1.1" 200 None
2025-12-05 06:06:34 [manheim.gb] INFO: Saving data for 3787547: {'created_time': 1764914794.317434, 'last_price_update_time': 1764914794.317449, 'auction_closing_time': 1764925200.0}
2025-12-05 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3787547') HTTP/1.1" 204 0
2025-12-05 06:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3805802-3964370-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003805802-01952362-005.pdf)
2025-12-05 06:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3805802-3964370-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003805802-01952362-005.pdf)
2025-12-05 06:06:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342632490>
2025-12-05 06:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_041c8cec-8167-5084-8ad7-2c260146c6b5/041c8cec-8167-5084-8ad7-2c260146c6b5_image_16.jpg HTTP/1.1" 201 0
2025-12-05 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3805802-3964370-1002.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3805802-3964370-1002.jpg saved to cache
2025-12-05 06:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 041c8cec-8167-5084-8ad7-2c260146c6b5
2025-12-05 06:06:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425101d0>
2025-12-05 06:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a64efbf-cabf-59ed-9ed9-e7eaa4df9787/2a64efbf-cabf-59ed-9ed9-e7eaa4df9787_expert_report_file_81910976-7f74-4637-b927-05ac270e9d98.pdf HTTP/1.1" 201 0
2025-12-05 06:06:34 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 2a64efbf-cabf-59ed-9ed9-e7eaa4df9787
2025-12-05 06:06:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2a64efbf-cabf-59ed-9ed9-e7eaa4df9787, skipping ID generation
2025-12-05 06:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 2a64efbf-cabf-59ed-9ed9-e7eaa4df9787
2025-12-05 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3517150-9999999-338124313-004.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3517150-9999999-338124313-004.jpg not downloaded yet
2025-12-05 06:06:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23428ccd50>
2025-12-05 06:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 06:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7600c093-6896-50a1-a116-ece885625448/7600c093-6896-50a1-a116-ece885625448_expert_report_file_0b6fe6a5-fda8-4b9a-b193-25bd2417f8db.pdf HTTP/1.1" 201 0
2025-12-05 06:06:35 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 7600c093-6896-50a1-a116-ece885625448
2025-12-05 06:06:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7600c093-6896-50a1-a116-ece885625448, skipping ID generation
2025-12-05 06:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 18 photos for item 7600c093-6896-50a1-a116-ece885625448
2025-12-05 06:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F623725e5-4e2a-42b1-a328-fa9032191602_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/623725e5-4e2a-42b1-a328-fa9032191602_ext_7.jpg already downloaded
2025-12-05 06:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F623725e5-4e2a-42b1-a328-fa9032191602_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/623725e5-4e2a-42b1-a328-fa9032191602_ext_7.jpg already downloaded
2025-12-05 06:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F623725e5-4e2a-42b1-a328-fa9032191602_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/623725e5-4e2a-42b1-a328-fa9032191602_ext_6.jpg already downloaded
2025-12-05 06:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F623725e5-4e2a-42b1-a328-fa9032191602_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/623725e5-4e2a-42b1-a328-fa9032191602_ext_1.jpg already downloaded
2025-12-05 06:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F623725e5-4e2a-42b1-a328-fa9032191602_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/623725e5-4e2a-42b1-a328-fa9032191602_5.jpg already downloaded
2025-12-05 06:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F623725e5-4e2a-42b1-a328-fa9032191602_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/623725e5-4e2a-42b1-a328-fa9032191602_4.jpg already downloaded
2025-12-05 06:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F623725e5-4e2a-42b1-a328-fa9032191602_11.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/623725e5-4e2a-42b1-a328-fa9032191602_11.jpg already downloaded
2025-12-05 06:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F623725e5-4e2a-42b1-a328-fa9032191602_10.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/623725e5-4e2a-42b1-a328-fa9032191602_10.jpg already downloaded
2025-12-05 06:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F623725e5-4e2a-42b1-a328-fa9032191602_9.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/623725e5-4e2a-42b1-a328-fa9032191602_9.jpg already downloaded
2025-12-05 06:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F623725e5-4e2a-42b1-a328-fa9032191602_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/623725e5-4e2a-42b1-a328-fa9032191602_ext_2.jpg already downloaded
2025-12-05 06:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F623725e5-4e2a-42b1-a328-fa9032191602_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/623725e5-4e2a-42b1-a328-fa9032191602_ext_5.jpg already downloaded
2025-12-05 06:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F623725e5-4e2a-42b1-a328-fa9032191602_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/623725e5-4e2a-42b1-a328-fa9032191602_ext_3.jpg already downloaded
2025-12-05 06:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F623725e5-4e2a-42b1-a328-fa9032191602_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/623725e5-4e2a-42b1-a328-fa9032191602_ext_4.jpg already downloaded
2025-12-05 06:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3786170-3969820-13.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3786170-3969820-13.jpg already downloaded
2025-12-05 06:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3786170-3969820-1000.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3786170-3969820-1000.jpg already downloaded
2025-12-05 06:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3786170-3969820-1001.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3786170-3969820-1001.jpg already downloaded
2025-12-05 06:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3786170-3969820-1002.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3786170-3969820-1002.jpg already downloaded
2025-12-05 06:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3786170-3969820-1003.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3786170-3969820-1003.jpg already downloaded
2025-12-05 06:06:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 7600c093-6896-50a1-a116-ece885625448, identifier: 3786170
2025-12-05 06:06:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3312266e-82b8-5f1b-81b7-8009f7cac9eb with identifier: 3476246
2025-12-05 06:06:35 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 3312266e-82b8-5f1b-81b7-8009f7cac9eb
2025-12-05 06:06:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342478bd0>
2025-12-05 06:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_041c8cec-8167-5084-8ad7-2c260146c6b5/041c8cec-8167-5084-8ad7-2c260146c6b5_image_11.jpg HTTP/1.1" 201 0
2025-12-05 06:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F980fa3c0-35b7-4fa4-9b6e-282c462ec266_ext_3.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/980fa3c0-35b7-4fa4-9b6e-282c462ec266_ext_3.jpg saved to cache
2025-12-05 06:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 041c8cec-8167-5084-8ad7-2c260146c6b5
2025-12-05 06:06:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 7600c093-6896-50a1-a116-ece885625448 with identifier: 3786170
2025-12-05 06:06:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 7600c093-6896-50a1-a116-ece885625448 with identifier: 3786170
2025-12-05 06:06:36 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 7600c093-6896-50a1-a116-ece885625448 with identifier: 3786170 to the API
2025-12-05 06:06:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 06:06:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 06:06:36 [scrapy.core.scraper] DEBUG: Scraped from <200 http://ecr.manheim.co.uk/pdf/MOL-0003786170-01961777-006.pdf>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7600c093-6896-50a1-a116-ece885625448/7600c093-6896-50a1-a116-ece885625448_expert_report_file_0b6fe6a5-fda8-4b9a-b193-25bd2417f8db.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003786170-01961777-006.pdf',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '7600c093-6896-50a1-a116-ece885625448',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'GU24OBR',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/PEUGEOT/2008?id=3786170',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 16230,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 18,
 'photo_urls': ['http://images.manheim.co.uk/images/units/zoom/623725e5-4e2a-42b1-a328-fa9032191602_ext_7.jpg',
                'http://images.manheim.co.uk/images/units/zoom/623725e5-4e2a-42b1-a328-fa9032191602_ext_7.jpg',
                'http://images.manheim.co.uk/images/units/zoom/623725e5-4e2a-42b1-a328-fa9032191602_ext_6.jpg',
                'http://images.manheim.co.uk/images/units/zoom/623725e5-4e2a-42b1-a328-fa9032191602_ext_1.jpg',
                'http://images.manheim.co.uk/images/units/zoom/623725e5-4e2a-42b1-a328-fa9032191602_5.jpg',
                'http://images.manheim.co.uk/images/units/zoom/623725e5-4e2a-42b1-a328-fa9032191602_4.jpg',
                'http://images.manheim.co.uk/images/units/zoom/623725e5-4e2a-42b1-a328-fa9032191602_11.jpg',
                'http://images.manheim.co.uk/images/units/zoom/623725e5-4e2a-42b1-a328-fa9032191602_10.jpg',
                'http://images.manheim.co.uk/images/units/zoom/623725e5-4e2a-42b1-a328-fa9032191602_9.jpg',
                'http://images.manheim.co.uk/images/units/zoom/623725e5-4e2a-42b1-a328-fa9032191602_ext_2.jpg',
                'http://images.manheim.co.uk/images/units/zoom/623725e5-4e2a-42b1-a328-fa9032191602_ext_5.jpg',
                'http://images.manheim.co.uk/images/units/zoom/623725e5-4e2a-42b1-a328-fa9032191602_ext_3.jpg',
                'http://images.manheim.co.uk/images/units/zoom/623725e5-4e2a-42b1-a328-fa9032191602_ext_4.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3786170-3969820-13.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3786170-3969820-1000.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3786170-3969820-1001.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3786170-3969820-1002.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3786170-3969820-1003.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7600c093-6896-50a1-a116-ece885625448/7600c093-6896-50a1-a116-ece885625448_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 210334,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/623725e5-4e2a-42b1-a328-fa9032191602_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7600c093-6896-50a1-a116-ece885625448/7600c093-6896-50a1-a116-ece885625448_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 210334,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/623725e5-4e2a-42b1-a328-fa9032191602_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7600c093-6896-50a1-a116-ece885625448/7600c093-6896-50a1-a116-ece885625448_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 331027,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/623725e5-4e2a-42b1-a328-fa9032191602_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7600c093-6896-50a1-a116-ece885625448/7600c093-6896-50a1-a116-ece885625448_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 156730,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/623725e5-4e2a-42b1-a328-fa9032191602_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7600c093-6896-50a1-a116-ece885625448/7600c093-6896-50a1-a116-ece885625448_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 209576,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/623725e5-4e2a-42b1-a328-fa9032191602_5.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7600c093-6896-50a1-a116-ece885625448/7600c093-6896-50a1-a116-ece885625448_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 210244,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/623725e5-4e2a-42b1-a328-fa9032191602_4.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7600c093-6896-50a1-a116-ece885625448/7600c093-6896-50a1-a116-ece885625448_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 204530,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/623725e5-4e2a-42b1-a328-fa9032191602_11.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7600c093-6896-50a1-a116-ece885625448/7600c093-6896-50a1-a116-ece885625448_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 196923,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/623725e5-4e2a-42b1-a328-fa9032191602_10.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7600c093-6896-50a1-a116-ece885625448/7600c093-6896-50a1-a116-ece885625448_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 204628,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/623725e5-4e2a-42b1-a328-fa9032191602_9.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7600c093-6896-50a1-a116-ece885625448/7600c093-6896-50a1-a116-ece885625448_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 353923,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/623725e5-4e2a-42b1-a328-fa9032191602_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7600c093-6896-50a1-a116-ece885625448/7600c093-6896-50a1-a116-ece885625448_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 270582,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/623725e5-4e2a-42b1-a328-fa9032191602_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7600c093-6896-50a1-a116-ece885625448/7600c093-6896-50a1-a116-ece885625448_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 310962,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/623725e5-4e2a-42b1-a328-fa9032191602_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7600c093-6896-50a1-a116-ece885625448/7600c093-6896-50a1-a116-ece885625448_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 269014,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/623725e5-4e2a-42b1-a328-fa9032191602_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7600c093-6896-50a1-a116-ece885625448/7600c093-6896-50a1-a116-ece885625448_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 365285,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3786170-3969820-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7600c093-6896-50a1-a116-ece885625448/7600c093-6896-50a1-a116-ece885625448_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 250518,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3786170-3969820-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7600c093-6896-50a1-a116-ece885625448/7600c093-6896-50a1-a116-ece885625448_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 293272,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3786170-3969820-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7600c093-6896-50a1-a116-ece885625448/7600c093-6896-50a1-a116-ece885625448_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 432439,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3786170-3969820-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7600c093-6896-50a1-a116-ece885625448/7600c093-6896-50a1-a116-ece885625448_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 454998,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3786170-3969820-1003.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-05-17',
 'seller_name': 'Leasys',
 'title': 'PEUGEOT 2008 1.2 PureTech 130 Allure 5dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech 130 Allure 5dr',
 'year': 2024}
2025-12-05 06:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273786170%27 HTTP/1.1" 200 None
2025-12-05 06:06:36 [manheim.gb] INFO: Saving data for 3786170: {'created_time': 1764914796.545139, 'last_price_update_time': 1764914796.545153, 'auction_closing_time': 1765270800.0}
2025-12-05 06:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3786170') HTTP/1.1" 204 0
2025-12-05 06:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/980fa3c0-35b7-4fa4-9b6e-282c462ec266_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003805802-01952362-005.pdf)
2025-12-05 06:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3517150-9999999-338124313-008.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3517150-9999999-338124313-008.jpg not downloaded yet
2025-12-05 06:06:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23427e5490>
2025-12-05 06:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:06:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_041c8cec-8167-5084-8ad7-2c260146c6b5/041c8cec-8167-5084-8ad7-2c260146c6b5_image_12.jpg HTTP/1.1" 201 0
2025-12-05 06:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F980fa3c0-35b7-4fa4-9b6e-282c462ec266_ext_4.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/980fa3c0-35b7-4fa4-9b6e-282c462ec266_ext_4.jpg saved to cache
2025-12-05 06:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 041c8cec-8167-5084-8ad7-2c260146c6b5
2025-12-05 06:06:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234157d2d0>
2025-12-05 06:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:06:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_041c8cec-8167-5084-8ad7-2c260146c6b5/041c8cec-8167-5084-8ad7-2c260146c6b5_image_10.jpg HTTP/1.1" 201 0
2025-12-05 06:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F980fa3c0-35b7-4fa4-9b6e-282c462ec266_ext_5.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/980fa3c0-35b7-4fa4-9b6e-282c462ec266_ext_5.jpg saved to cache
2025-12-05 06:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 041c8cec-8167-5084-8ad7-2c260146c6b5
2025-12-05 06:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3805802-3964370-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003805802-01952362-005.pdf)
2025-12-05 06:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/BMW/1SERIES?id=3445714&returnUrl=%2Fsearch%3FPage%3D3%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233445714&indx=216> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/DS/DS5?id=3690345&returnUrl=%2Fsearch%3FPage%3D3%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233690345&indx=261> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3517150-9999999-338124313-001.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3517150-9999999-338124313-001.jpg not downloaded yet
2025-12-05 06:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003790913-01943950-001.pdf> (referer: None)
2025-12-05 06:06:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342910890>
2025-12-05 06:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:06:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_041c8cec-8167-5084-8ad7-2c260146c6b5/041c8cec-8167-5084-8ad7-2c260146c6b5_image_14.jpg HTTP/1.1" 201 0
2025-12-05 06:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3805802-3964370-1000.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3805802-3964370-1000.jpg saved to cache
2025-12-05 06:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 041c8cec-8167-5084-8ad7-2c260146c6b5
2025-12-05 06:06:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341e91e10>
2025-12-05 06:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 06:06:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_041c8cec-8167-5084-8ad7-2c260146c6b5/041c8cec-8167-5084-8ad7-2c260146c6b5_image_15.jpg HTTP/1.1" 201 0
2025-12-05 06:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3805802-3964370-1001.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3805802-3964370-1001.jpg saved to cache
2025-12-05 06:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 041c8cec-8167-5084-8ad7-2c260146c6b5
2025-12-05 06:06:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342388350>
2025-12-05 06:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:06:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_041c8cec-8167-5084-8ad7-2c260146c6b5/041c8cec-8167-5084-8ad7-2c260146c6b5_image_9.jpg HTTP/1.1" 201 0
2025-12-05 06:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F980fa3c0-35b7-4fa4-9b6e-282c462ec266_ext_2.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/980fa3c0-35b7-4fa4-9b6e-282c462ec266_ext_2.jpg saved to cache
2025-12-05 06:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 041c8cec-8167-5084-8ad7-2c260146c6b5
2025-12-05 06:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3517150-9999999-338124313-002.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3517150-9999999-338124313-002.jpg not downloaded yet
2025-12-05 06:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/980fa3c0-35b7-4fa4-9b6e-282c462ec266_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003805802-01952362-005.pdf)
2025-12-05 06:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/980fa3c0-35b7-4fa4-9b6e-282c462ec266_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003805802-01952362-005.pdf)
2025-12-05 06:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/980fa3c0-35b7-4fa4-9b6e-282c462ec266_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003805802-01952362-005.pdf)
2025-12-05 06:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3517150-9999999-338124313-003.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3517150-9999999-338124313-003.jpg not downloaded yet
2025-12-05 06:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/TOYOTA/YARIS?id=343802&returnUrl=%2Fsearch%3FPage%3D3%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%23343802&indx=215> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:06:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425d5ad0>
2025-12-05 06:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:06:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_041c8cec-8167-5084-8ad7-2c260146c6b5/041c8cec-8167-5084-8ad7-2c260146c6b5_image_13.jpg HTTP/1.1" 201 0
2025-12-05 06:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3805802-3964370-13.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3805802-3964370-13.jpg saved to cache
2025-12-05 06:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 041c8cec-8167-5084-8ad7-2c260146c6b5
2025-12-05 06:06:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4dfc561a-6d21-5420-96e0-006bc5596fd6 with identifier: 3445714
2025-12-05 06:06:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4dfc561a-6d21-5420-96e0-006bc5596fd6 with scrape type 2
2025-12-05 06:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4dfc561a-6d21-5420-96e0-006bc5596fd6 with scrape type 2
2025-12-05 06:06:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 4dfc561a-6d21-5420-96e0-006bc5596fd6, identifier: 3445714
2025-12-05 06:06:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4fc77dba-953c-5b07-8795-c10f561b4b1f with identifier: 3690345
2025-12-05 06:06:38 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 4fc77dba-953c-5b07-8795-c10f561b4b1f
2025-12-05 06:06:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342366890>
2025-12-05 06:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:06:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_354bfc79-2afd-58f8-9caf-2a3bd656d429/354bfc79-2afd-58f8-9caf-2a3bd656d429_expert_report_file_0a01dbf2-c08f-4647-ac81-cec5eaca13ad.pdf HTTP/1.1" 201 0
2025-12-05 06:06:39 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 354bfc79-2afd-58f8-9caf-2a3bd656d429
2025-12-05 06:06:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 354bfc79-2afd-58f8-9caf-2a3bd656d429, skipping ID generation
2025-12-05 06:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 354bfc79-2afd-58f8-9caf-2a3bd656d429
2025-12-05 06:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9ba025c6-fd11-429e-bb34-8227a28bc43d_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9ba025c6-fd11-429e-bb34-8227a28bc43d_ext_7.jpg already downloaded
2025-12-05 06:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9ba025c6-fd11-429e-bb34-8227a28bc43d_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9ba025c6-fd11-429e-bb34-8227a28bc43d_ext_7.jpg already downloaded
2025-12-05 06:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9ba025c6-fd11-429e-bb34-8227a28bc43d_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9ba025c6-fd11-429e-bb34-8227a28bc43d_ext_6.jpg already downloaded
2025-12-05 06:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9ba025c6-fd11-429e-bb34-8227a28bc43d_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9ba025c6-fd11-429e-bb34-8227a28bc43d_ext_1.jpg already downloaded
2025-12-05 06:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9ba025c6-fd11-429e-bb34-8227a28bc43d_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9ba025c6-fd11-429e-bb34-8227a28bc43d_5.jpg already downloaded
2025-12-05 06:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9ba025c6-fd11-429e-bb34-8227a28bc43d_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9ba025c6-fd11-429e-bb34-8227a28bc43d_4.jpg already downloaded
2025-12-05 06:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9ba025c6-fd11-429e-bb34-8227a28bc43d_11.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9ba025c6-fd11-429e-bb34-8227a28bc43d_11.jpg already downloaded
2025-12-05 06:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9ba025c6-fd11-429e-bb34-8227a28bc43d_10.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9ba025c6-fd11-429e-bb34-8227a28bc43d_10.jpg already downloaded
2025-12-05 06:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9ba025c6-fd11-429e-bb34-8227a28bc43d_9.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9ba025c6-fd11-429e-bb34-8227a28bc43d_9.jpg already downloaded
2025-12-05 06:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9ba025c6-fd11-429e-bb34-8227a28bc43d_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9ba025c6-fd11-429e-bb34-8227a28bc43d_ext_2.jpg already downloaded
2025-12-05 06:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9ba025c6-fd11-429e-bb34-8227a28bc43d_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9ba025c6-fd11-429e-bb34-8227a28bc43d_ext_5.jpg already downloaded
2025-12-05 06:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9ba025c6-fd11-429e-bb34-8227a28bc43d_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9ba025c6-fd11-429e-bb34-8227a28bc43d_ext_3.jpg already downloaded
2025-12-05 06:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9ba025c6-fd11-429e-bb34-8227a28bc43d_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9ba025c6-fd11-429e-bb34-8227a28bc43d_ext_4.jpg already downloaded
2025-12-05 06:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3790913-3963340-13.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3790913-3963340-13.jpg already downloaded
2025-12-05 06:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3790913-3963340-1000.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3790913-3963340-1000.jpg already downloaded
2025-12-05 06:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3790913-3963340-1001.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3790913-3963340-1001.jpg already downloaded
2025-12-05 06:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3790913-3963340-1002.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3790913-3963340-1002.jpg already downloaded
2025-12-05 06:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3790913-3963340-1003.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3790913-3963340-1003.jpg already downloaded
2025-12-05 06:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3790913-3963340-1004.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3790913-3963340-1004.jpg already downloaded
2025-12-05 06:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3790913-3963340-1005.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3790913-3963340-1005.jpg already downloaded
2025-12-05 06:06:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 354bfc79-2afd-58f8-9caf-2a3bd656d429, identifier: 3790913
2025-12-05 06:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/980fa3c0-35b7-4fa4-9b6e-282c462ec266_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003805802-01952362-005.pdf)
2025-12-05 06:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/980fa3c0-35b7-4fa4-9b6e-282c462ec266_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003805802-01952362-005.pdf)
2025-12-05 06:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/980fa3c0-35b7-4fa4-9b6e-282c462ec266_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003805802-01952362-005.pdf)
2025-12-05 06:06:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 4dfc561a-6d21-5420-96e0-006bc5596fd6 with identifier: 3445714
2025-12-05 06:06:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 4dfc561a-6d21-5420-96e0-006bc5596fd6 with identifier: 3445714
2025-12-05 06:06:39 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 185827 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    185827
2025-12-05 06:06:39 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 4dfc561a-6d21-5420-96e0-006bc5596fd6 spider: manheim.gb
2025-12-05 06:06:39 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 4dfc561a-6d21-5420-96e0-006bc5596fd6 due to rule: high_mileage_for_country.json, error: 185827 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    185827
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003445714-01983171-001.pdf',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': '2025-12-05T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '4dfc561a-6d21-5420-96e0-006bc5596fd6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'ML61EUD',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/BMW/1%20SERIES?id=3445714',
 'listing': 'auction',
 'location': 'Northampton',
 'make': 'BMW',
 'model': '1 SERIES',
 'odometer': 115468,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-29',
 'seller_name': 'Sytner',
 'title': 'BMW 1 SERIES 116d Sport 3dr',
 'transmission': 'manual',
 'trim': '116d Sport 3dr',
 'year': 2011}
2025-12-05 06:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273445714%27 HTTP/1.1" 200 None
2025-12-05 06:06:39 [manheim.gb] INFO: Saving data for 3445714: {'auction_closing_time': 1764925200.0, 'created_time': 1764792227.736259, 'last_price_update_time': 1764914799.89669}
2025-12-05 06:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3445714') HTTP/1.1" 204 0
2025-12-05 06:06:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 354bfc79-2afd-58f8-9caf-2a3bd656d429 with identifier: 3790913
2025-12-05 06:06:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 354bfc79-2afd-58f8-9caf-2a3bd656d429 with identifier: 3790913
2025-12-05 06:06:40 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'volkswagen' containing 'volkswagen' and model 'multivan' containing 'multivan'
2025-12-05 06:06:40 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 354bfc79-2afd-58f8-9caf-2a3bd656d429 spider: manheim.gb
2025-12-05 06:06:40 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 354bfc79-2afd-58f8-9caf-2a3bd656d429 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'volkswagen' containing 'volkswagen' and model 'multivan' containing 'multivan'
{'auction_title': '',
 'c_o_2_emission_value': 41,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_354bfc79-2afd-58f8-9caf-2a3bd656d429/354bfc79-2afd-58f8-9caf-2a3bd656d429_expert_report_file_0a01dbf2-c08f-4647-ac81-cec5eaca13ad.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003790913-01943950-001.pdf',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.4L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Petrol PHEV',
 'id': '354bfc79-2afd-58f8-9caf-2a3bd656d429',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'AV73LHJ',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/MULTIVAN?id=3790913',
 'listing': 'auction',
 'location': 'Leeds',
 'make': 'VOLKSWAGEN',
 'model': 'MULTIVAN',
 'odometer': 16181,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 26,
 'photo_urls': ['http://images.manheim.co.uk/images/units/zoom/9ba025c6-fd11-429e-bb34-8227a28bc43d_ext_7.jpg',
                'http://images.manheim.co.uk/images/units/zoom/9ba025c6-fd11-429e-bb34-8227a28bc43d_ext_7.jpg',
                'http://images.manheim.co.uk/images/units/zoom/9ba025c6-fd11-429e-bb34-8227a28bc43d_ext_6.jpg',
                'http://images.manheim.co.uk/images/units/zoom/9ba025c6-fd11-429e-bb34-8227a28bc43d_ext_1.jpg',
                'http://images.manheim.co.uk/images/units/zoom/9ba025c6-fd11-429e-bb34-8227a28bc43d_5.jpg',
                'http://images.manheim.co.uk/images/units/zoom/9ba025c6-fd11-429e-bb34-8227a28bc43d_4.jpg',
                'http://images.manheim.co.uk/images/units/zoom/9ba025c6-fd11-429e-bb34-8227a28bc43d_11.jpg',
                'http://images.manheim.co.uk/images/units/zoom/9ba025c6-fd11-429e-bb34-8227a28bc43d_10.jpg',
                'http://images.manheim.co.uk/images/units/zoom/9ba025c6-fd11-429e-bb34-8227a28bc43d_9.jpg',
                'http://images.manheim.co.uk/images/units/zoom/9ba025c6-fd11-429e-bb34-8227a28bc43d_ext_2.jpg',
                'http://images.manheim.co.uk/images/units/zoom/9ba025c6-fd11-429e-bb34-8227a28bc43d_ext_5.jpg',
                'http://images.manheim.co.uk/images/units/zoom/9ba025c6-fd11-429e-bb34-8227a28bc43d_ext_3.jpg',
                'http://images.manheim.co.uk/images/units/zoom/9ba025c6-fd11-429e-bb34-8227a28bc43d_ext_4.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3790913-3963340-13.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3790913-3963340-1000.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3790913-3963340-1001.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3790913-3963340-1002.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3790913-3963340-1003.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3790913-3963340-1004.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3790913-3963340-1005.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_354bfc79-2afd-58f8-9caf-2a3bd656d429/354bfc79-2afd-58f8-9caf-2a3bd656d429_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 196310,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9ba025c6-fd11-429e-bb34-8227a28bc43d_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_354bfc79-2afd-58f8-9caf-2a3bd656d429/354bfc79-2afd-58f8-9caf-2a3bd656d429_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 196310,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9ba025c6-fd11-429e-bb34-8227a28bc43d_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_354bfc79-2afd-58f8-9caf-2a3bd656d429/354bfc79-2afd-58f8-9caf-2a3bd656d429_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 235321,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9ba025c6-fd11-429e-bb34-8227a28bc43d_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_354bfc79-2afd-58f8-9caf-2a3bd656d429/354bfc79-2afd-58f8-9caf-2a3bd656d429_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 169493,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9ba025c6-fd11-429e-bb34-8227a28bc43d_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_354bfc79-2afd-58f8-9caf-2a3bd656d429/354bfc79-2afd-58f8-9caf-2a3bd656d429_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 193148,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9ba025c6-fd11-429e-bb34-8227a28bc43d_5.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_354bfc79-2afd-58f8-9caf-2a3bd656d429/354bfc79-2afd-58f8-9caf-2a3bd656d429_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 198744,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9ba025c6-fd11-429e-bb34-8227a28bc43d_4.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_354bfc79-2afd-58f8-9caf-2a3bd656d429/354bfc79-2afd-58f8-9caf-2a3bd656d429_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 175750,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9ba025c6-fd11-429e-bb34-8227a28bc43d_11.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_354bfc79-2afd-58f8-9caf-2a3bd656d429/354bfc79-2afd-58f8-9caf-2a3bd656d429_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 192928,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9ba025c6-fd11-429e-bb34-8227a28bc43d_10.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_354bfc79-2afd-58f8-9caf-2a3bd656d429/354bfc79-2afd-58f8-9caf-2a3bd656d429_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 208393,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9ba025c6-fd11-429e-bb34-8227a28bc43d_9.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_354bfc79-2afd-58f8-9caf-2a3bd656d429/354bfc79-2afd-58f8-9caf-2a3bd656d429_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257199,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9ba025c6-fd11-429e-bb34-8227a28bc43d_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_354bfc79-2afd-58f8-9caf-2a3bd656d429/354bfc79-2afd-58f8-9caf-2a3bd656d429_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 227565,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9ba025c6-fd11-429e-bb34-8227a28bc43d_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_354bfc79-2afd-58f8-9caf-2a3bd656d429/354bfc79-2afd-58f8-9caf-2a3bd656d429_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 254933,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9ba025c6-fd11-429e-bb34-8227a28bc43d_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_354bfc79-2afd-58f8-9caf-2a3bd656d429/354bfc79-2afd-58f8-9caf-2a3bd656d429_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 256333,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9ba025c6-fd11-429e-bb34-8227a28bc43d_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_354bfc79-2afd-58f8-9caf-2a3bd656d429/354bfc79-2afd-58f8-9caf-2a3bd656d429_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47762,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3790913-3963340-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_354bfc79-2afd-58f8-9caf-2a3bd656d429/354bfc79-2afd-58f8-9caf-2a3bd656d429_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 294795,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3790913-3963340-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_354bfc79-2afd-58f8-9caf-2a3bd656d429/354bfc79-2afd-58f8-9caf-2a3bd656d429_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 210221,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3790913-3963340-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_354bfc79-2afd-58f8-9caf-2a3bd656d429/354bfc79-2afd-58f8-9caf-2a3bd656d429_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 154822,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3790913-3963340-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_354bfc79-2afd-58f8-9caf-2a3bd656d429/354bfc79-2afd-58f8-9caf-2a3bd656d429_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 221918,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3790913-3963340-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_354bfc79-2afd-58f8-9caf-2a3bd656d429/354bfc79-2afd-58f8-9caf-2a3bd656d429_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 184829,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3790913-3963340-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_354bfc79-2afd-58f8-9caf-2a3bd656d429/354bfc79-2afd-58f8-9caf-2a3bd656d429_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 175359,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3790913-3963340-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-01-12',
 'seller_name': 'Lookers Leasing',
 'title': 'VOLKSWAGEN MULTIVAN 1.4 TSI eHybrid Life 5dr DSG',
 'transmission': 'automatic',
 'trim': '1.4 TSI eHybrid Life 5dr DSG',
 'year': 2024}
2025-12-05 06:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273790913%27 HTTP/1.1" 200 None
2025-12-05 06:06:40 [manheim.gb] INFO: Saving data for 3790913: {'created_time': 1764914800.175316, 'last_price_update_time': 1764914800.175329, 'auction_closing_time': 1765184400.0}
2025-12-05 06:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3790913') HTTP/1.1" 204 0
2025-12-05 06:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/980fa3c0-35b7-4fa4-9b6e-282c462ec266_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003805802-01952362-005.pdf)
2025-12-05 06:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3517150-9999999-338124313-005.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3517150-9999999-338124313-005.jpg not downloaded yet
2025-12-05 06:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3517150-9999999-338124313-004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003517150-01993640-003.pdf)
2025-12-05 06:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/LAND%20ROVER/RANGEROVEREVOQUE?id=3607988&returnUrl=%2Fsearch%3FPage%3D3%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233607988&indx=237> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3517150-9999999-338124313-006.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3517150-9999999-338124313-006.jpg not downloaded yet
2025-12-05 06:06:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342890950>
2025-12-05 06:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_041c8cec-8167-5084-8ad7-2c260146c6b5/041c8cec-8167-5084-8ad7-2c260146c6b5_image_7.jpg HTTP/1.1" 201 0
2025-12-05 06:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F980fa3c0-35b7-4fa4-9b6e-282c462ec266_10.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/980fa3c0-35b7-4fa4-9b6e-282c462ec266_10.jpg saved to cache
2025-12-05 06:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 041c8cec-8167-5084-8ad7-2c260146c6b5
2025-12-05 06:06:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342617590>
2025-12-05 06:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_041c8cec-8167-5084-8ad7-2c260146c6b5/041c8cec-8167-5084-8ad7-2c260146c6b5_image_8.jpg HTTP/1.1" 201 0
2025-12-05 06:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F980fa3c0-35b7-4fa4-9b6e-282c462ec266_9.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/980fa3c0-35b7-4fa4-9b6e-282c462ec266_9.jpg saved to cache
2025-12-05 06:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 041c8cec-8167-5084-8ad7-2c260146c6b5
2025-12-05 06:06:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341eaa390>
2025-12-05 06:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_041c8cec-8167-5084-8ad7-2c260146c6b5/041c8cec-8167-5084-8ad7-2c260146c6b5_image_6.jpg HTTP/1.1" 201 0
2025-12-05 06:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F980fa3c0-35b7-4fa4-9b6e-282c462ec266_11.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/980fa3c0-35b7-4fa4-9b6e-282c462ec266_11.jpg saved to cache
2025-12-05 06:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 041c8cec-8167-5084-8ad7-2c260146c6b5
2025-12-05 06:06:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c97599e-83b5-5ceb-974f-30be565a9a41 with identifier: 343802
2025-12-05 06:06:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c97599e-83b5-5ceb-974f-30be565a9a41 with scrape type 2
2025-12-05 06:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c97599e-83b5-5ceb-974f-30be565a9a41 with scrape type 2
2025-12-05 06:06:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 9c97599e-83b5-5ceb-974f-30be565a9a41, identifier: 343802
2025-12-05 06:06:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342911090>
2025-12-05 06:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:06:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_041c8cec-8167-5084-8ad7-2c260146c6b5/041c8cec-8167-5084-8ad7-2c260146c6b5_image_4.jpg HTTP/1.1" 201 0
2025-12-05 06:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F980fa3c0-35b7-4fa4-9b6e-282c462ec266_5.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/980fa3c0-35b7-4fa4-9b6e-282c462ec266_5.jpg saved to cache
2025-12-05 06:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 041c8cec-8167-5084-8ad7-2c260146c6b5
2025-12-05 06:06:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234159b750>
2025-12-05 06:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:06:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_041c8cec-8167-5084-8ad7-2c260146c6b5/041c8cec-8167-5084-8ad7-2c260146c6b5_image_3.jpg HTTP/1.1" 201 0
2025-12-05 06:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F980fa3c0-35b7-4fa4-9b6e-282c462ec266_ext_1.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/980fa3c0-35b7-4fa4-9b6e-282c462ec266_ext_1.jpg saved to cache
2025-12-05 06:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 041c8cec-8167-5084-8ad7-2c260146c6b5
2025-12-05 06:06:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23427f7c50>
2025-12-05 06:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:06:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_041c8cec-8167-5084-8ad7-2c260146c6b5/041c8cec-8167-5084-8ad7-2c260146c6b5_image_5.jpg HTTP/1.1" 201 0
2025-12-05 06:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F980fa3c0-35b7-4fa4-9b6e-282c462ec266_4.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/980fa3c0-35b7-4fa4-9b6e-282c462ec266_4.jpg saved to cache
2025-12-05 06:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 041c8cec-8167-5084-8ad7-2c260146c6b5
2025-12-05 06:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3517150-9999999-338124313-007.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3517150-9999999-338124313-007.jpg not downloaded yet
2025-12-05 06:06:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 9c97599e-83b5-5ceb-974f-30be565a9a41 with identifier: 343802
2025-12-05 06:06:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 9c97599e-83b5-5ceb-974f-30be565a9a41 with identifier: 343802
2025-12-05 06:06:42 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': 'arbury', 'price_includes_vat': False, 'title': 'toyota yaris 1.0 vvt-i t3 5dr', 'price': 0, 'currency': 'gbp', 'make': 'toyota', 'model': 'yaris', 'transmission': 'manual', 'engine': '1.0l', 'fuel_type': 'petrol', 'odometer': 134641, 'odometer_reading_unit': 'mi', 'registration_date': '2006-10-31', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/toyota/yaris?id=343802', 'location': 'birmingham', 'origin_country_code': 'gb', 'trim': '1.0 vvt-i t3 5dr', 'license_plate': 'ao56xud', 'year': 2006, 'listing': 'auction', 'c_o_2_emission_value': 127, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0000343802-01984094-003.pdf', 'expiration_date': '2025-12-05t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': '9c97599e-83b5-5ceb-974f-30be565a9a41', 'current_year_diff': 19, 'age_in_months': 229, 'make_model': 'toyota yaris', 'sanitized_make': 'toyota', 'odometer_in_km': 216683}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 229,
     'auction_title': '',
     'c_o_2_emission_value': 127,
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0000343802-01984094-003.pdf',
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 19,
     'engine': '1.0l',
     'expiration_date': '2025-12-05t09:00:00z',
     'fuel_type': 'petrol',
     'id': '9c97599e-83b5-5ceb-974f-30be565a9a41',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'ao56xud',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/toyota/yaris?id=343802',
     'listing': 'auction',
     'location': 'birmingham',
     'make': 'toyota',
     'make_model': 'toyota yaris',
     'model': 'yaris',
     'odometer': 134641,
     'odometer_in_km': 216683,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2006-10-31',
     'sanitized_make': 'toyota',
     'seller_name': 'arbury',
     'title': 'toyota yaris 1.0 vvt-i t3 5dr',
     'transmission': 'manual',
     'trim': '1.0 vvt-i t3 5dr',
     'year': 2006}
2025-12-05 06:06:42 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 9c97599e-83b5-5ceb-974f-30be565a9a41 spider: manheim.gb
2025-12-05 06:06:42 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 9c97599e-83b5-5ceb-974f-30be565a9a41 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': 'arbury', 'price_includes_vat': False, 'title': 'toyota yaris 1.0 vvt-i t3 5dr', 'price': 0, 'currency': 'gbp', 'make': 'toyota', 'model': 'yaris', 'transmission': 'manual', 'engine': '1.0l', 'fuel_type': 'petrol', 'odometer': 134641, 'odometer_reading_unit': 'mi', 'registration_date': '2006-10-31', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/toyota/yaris?id=343802', 'location': 'birmingham', 'origin_country_code': 'gb', 'trim': '1.0 vvt-i t3 5dr', 'license_plate': 'ao56xud', 'year': 2006, 'listing': 'auction', 'c_o_2_emission_value': 127, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0000343802-01984094-003.pdf', 'expiration_date': '2025-12-05t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': '9c97599e-83b5-5ceb-974f-30be565a9a41', 'current_year_diff': 19, 'age_in_months': 229, 'make_model': 'toyota yaris', 'sanitized_make': 'toyota', 'odometer_in_km': 216683}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 229,
     'auction_title': '',
     'c_o_2_emission_value': 127,
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0000343802-01984094-003.pdf',
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 19,
     'engine': '1.0l',
     'expiration_date': '2025-12-05t09:00:00z',
     'fuel_type': 'petrol',
     'id': '9c97599e-83b5-5ceb-974f-30be565a9a41',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'ao56xud',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/toyota/yaris?id=343802',
     'listing': 'auction',
     'location': 'birmingham',
     'make': 'toyota',
     'make_model': 'toyota yaris',
     'model': 'yaris',
     'odometer': 134641,
     'odometer_in_km': 216683,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2006-10-31',
     'sanitized_make': 'toyota',
     'seller_name': 'arbury',
     'title': 'toyota yaris 1.0 vvt-i t3 5dr',
     'transmission': 'manual',
     'trim': '1.0 vvt-i t3 5dr',
     'year': 2006}
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0000343802-01984094-003.pdf',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.0L',
 'expiration_date': '2025-12-05T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '9c97599e-83b5-5ceb-974f-30be565a9a41',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'AO56XUD',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/TOYOTA/YARIS?id=343802',
 'listing': 'auction',
 'location': 'Birmingham',
 'make': 'TOYOTA',
 'model': 'YARIS',
 'odometer': 134641,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-10-31',
 'seller_name': 'Arbury',
 'title': 'TOYOTA YARIS 1.0 VVT-i T3 5dr',
 'transmission': 'manual',
 'trim': '1.0 VVT-i T3 5dr',
 'year': 2006}
2025-12-05 06:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27343802%27 HTTP/1.1" 200 None
2025-12-05 06:06:42 [manheim.gb] INFO: Saving data for 343802: {'auction_closing_time': 1764925200.0, 'created_time': 1764792243.52848, 'last_price_update_time': 1764914802.381036}
2025-12-05 06:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='343802') HTTP/1.1" 204 0
2025-12-05 06:06:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:06:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:06:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:06:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:06:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3517150-9999999-338124313-009.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3517150-9999999-338124313-009.jpg not downloaded yet
2025-12-05 06:06:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425c5590>
2025-12-05 06:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:06:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_041c8cec-8167-5084-8ad7-2c260146c6b5/041c8cec-8167-5084-8ad7-2c260146c6b5_image_2.jpg HTTP/1.1" 201 0
2025-12-05 06:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F980fa3c0-35b7-4fa4-9b6e-282c462ec266_ext_6.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/980fa3c0-35b7-4fa4-9b6e-282c462ec266_ext_6.jpg saved to cache
2025-12-05 06:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 041c8cec-8167-5084-8ad7-2c260146c6b5
2025-12-05 06:06:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23424ac550>
2025-12-05 06:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:06:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a64efbf-cabf-59ed-9ed9-e7eaa4df9787/2a64efbf-cabf-59ed-9ed9-e7eaa4df9787_image_0.jpg HTTP/1.1" 201 0
2025-12-05 06:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3517150-9999999-338124313-004.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3517150-9999999-338124313-004.jpg saved to cache
2025-12-05 06:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2a64efbf-cabf-59ed-9ed9-e7eaa4df9787
2025-12-05 06:06:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4cdbfc7-068e-50aa-aa3a-1e77cf962189 with identifier: 3607988
2025-12-05 06:06:43 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item f4cdbfc7-068e-50aa-aa3a-1e77cf962189
2025-12-05 06:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3517150-9999999-338124313-010.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3517150-9999999-338124313-010.jpg not downloaded yet
2025-12-05 06:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/980fa3c0-35b7-4fa4-9b6e-282c462ec266_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003805802-01952362-005.pdf)
2025-12-05 06:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/980fa3c0-35b7-4fa4-9b6e-282c462ec266_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003805802-01952362-005.pdf)
2025-12-05 06:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3517150-9999999-338124313-011.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3517150-9999999-338124313-011.jpg not downloaded yet
2025-12-05 06:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3517150-9999999-338124313-003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003517150-01993640-003.pdf)
2025-12-05 06:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3517150-9999999-338124313-006.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003517150-01993640-003.pdf)
2025-12-05 06:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3517150-9999999-338124313-008.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003517150-01993640-003.pdf)
2025-12-05 06:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3517150-9999999-338124313-001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003517150-01993640-003.pdf)
2025-12-05 06:06:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3517150-9999999-338124313-002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003517150-01993640-003.pdf)
2025-12-05 06:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3517150-9999999-338124313-005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003517150-01993640-003.pdf)
2025-12-05 06:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3517150-9999999-338124313-012.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3517150-9999999-338124313-012.jpg not downloaded yet
2025-12-05 06:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3517150-4008226-13.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3517150-4008226-13.jpg not downloaded yet
2025-12-05 06:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3517150-4008226-1000.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3517150-4008226-1000.jpg not downloaded yet
2025-12-05 06:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3517150-4008226-1001.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3517150-4008226-1001.jpg not downloaded yet
2025-12-05 06:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3517150-4008226-1002.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3517150-4008226-1002.jpg not downloaded yet
2025-12-05 06:06:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342625250>
2025-12-05 06:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:06:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_041c8cec-8167-5084-8ad7-2c260146c6b5/041c8cec-8167-5084-8ad7-2c260146c6b5_image_1.jpg HTTP/1.1" 201 0
2025-12-05 06:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F980fa3c0-35b7-4fa4-9b6e-282c462ec266_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/980fa3c0-35b7-4fa4-9b6e-282c462ec266_ext_7.jpg saved to cache
2025-12-05 06:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 041c8cec-8167-5084-8ad7-2c260146c6b5
2025-12-05 06:06:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342709790>
2025-12-05 06:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:06:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_041c8cec-8167-5084-8ad7-2c260146c6b5/041c8cec-8167-5084-8ad7-2c260146c6b5_image_0.jpg HTTP/1.1" 201 0
2025-12-05 06:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F980fa3c0-35b7-4fa4-9b6e-282c462ec266_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/980fa3c0-35b7-4fa4-9b6e-282c462ec266_ext_7.jpg saved to cache
2025-12-05 06:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 041c8cec-8167-5084-8ad7-2c260146c6b5
2025-12-05 06:06:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 041c8cec-8167-5084-8ad7-2c260146c6b5, skipping ID generation
2025-12-05 06:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 041c8cec-8167-5084-8ad7-2c260146c6b5 from tracking dictionaries
2025-12-05 06:06:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 041c8cec-8167-5084-8ad7-2c260146c6b5 sending to next pipeline
2025-12-05 06:06:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 041c8cec-8167-5084-8ad7-2c260146c6b5, identifier: 3805802
2025-12-05 06:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3517150-4008226-1003.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3517150-4008226-1003.jpg not downloaded yet
2025-12-05 06:06:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 041c8cec-8167-5084-8ad7-2c260146c6b5 with identifier: 3805802
2025-12-05 06:06:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 041c8cec-8167-5084-8ad7-2c260146c6b5 with identifier: 3805802
2025-12-05 06:06:44 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 041c8cec-8167-5084-8ad7-2c260146c6b5 with identifier: 3805802 to the API
2025-12-05 06:06:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 06:06:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 06:06:44 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/980fa3c0-35b7-4fa4-9b6e-282c462ec266_ext_7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_041c8cec-8167-5084-8ad7-2c260146c6b5/041c8cec-8167-5084-8ad7-2c260146c6b5_expert_report_file_684cbdb0-9b90-4556-a210-85fd0d54f2c9.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003805802-01952362-005.pdf',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': '2025-12-05T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '041c8cec-8167-5084-8ad7-2c260146c6b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'GU24OCD',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/PEUGEOT/2008?id=3805802',
 'listing': 'auction',
 'location': 'Bruntingthorpe',
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 18226,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 26,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_041c8cec-8167-5084-8ad7-2c260146c6b5/041c8cec-8167-5084-8ad7-2c260146c6b5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 140797,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/980fa3c0-35b7-4fa4-9b6e-282c462ec266_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_041c8cec-8167-5084-8ad7-2c260146c6b5/041c8cec-8167-5084-8ad7-2c260146c6b5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 140797,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/980fa3c0-35b7-4fa4-9b6e-282c462ec266_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_041c8cec-8167-5084-8ad7-2c260146c6b5/041c8cec-8167-5084-8ad7-2c260146c6b5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 202156,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/980fa3c0-35b7-4fa4-9b6e-282c462ec266_ext_6.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_041c8cec-8167-5084-8ad7-2c260146c6b5/041c8cec-8167-5084-8ad7-2c260146c6b5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 141724,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/980fa3c0-35b7-4fa4-9b6e-282c462ec266_ext_1.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_041c8cec-8167-5084-8ad7-2c260146c6b5/041c8cec-8167-5084-8ad7-2c260146c6b5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 130788,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/980fa3c0-35b7-4fa4-9b6e-282c462ec266_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_041c8cec-8167-5084-8ad7-2c260146c6b5/041c8cec-8167-5084-8ad7-2c260146c6b5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 135834,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/980fa3c0-35b7-4fa4-9b6e-282c462ec266_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_041c8cec-8167-5084-8ad7-2c260146c6b5/041c8cec-8167-5084-8ad7-2c260146c6b5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 124771,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/980fa3c0-35b7-4fa4-9b6e-282c462ec266_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_041c8cec-8167-5084-8ad7-2c260146c6b5/041c8cec-8167-5084-8ad7-2c260146c6b5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116141,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/980fa3c0-35b7-4fa4-9b6e-282c462ec266_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_041c8cec-8167-5084-8ad7-2c260146c6b5/041c8cec-8167-5084-8ad7-2c260146c6b5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 122217,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/980fa3c0-35b7-4fa4-9b6e-282c462ec266_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_041c8cec-8167-5084-8ad7-2c260146c6b5/041c8cec-8167-5084-8ad7-2c260146c6b5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 246188,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/980fa3c0-35b7-4fa4-9b6e-282c462ec266_ext_2.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_041c8cec-8167-5084-8ad7-2c260146c6b5/041c8cec-8167-5084-8ad7-2c260146c6b5_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 146289,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/980fa3c0-35b7-4fa4-9b6e-282c462ec266_ext_5.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_041c8cec-8167-5084-8ad7-2c260146c6b5/041c8cec-8167-5084-8ad7-2c260146c6b5_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 178521,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/980fa3c0-35b7-4fa4-9b6e-282c462ec266_ext_3.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_041c8cec-8167-5084-8ad7-2c260146c6b5/041c8cec-8167-5084-8ad7-2c260146c6b5_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 170933,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/980fa3c0-35b7-4fa4-9b6e-282c462ec266_ext_4.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_041c8cec-8167-5084-8ad7-2c260146c6b5/041c8cec-8167-5084-8ad7-2c260146c6b5_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 501350,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3805802-3964370-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_041c8cec-8167-5084-8ad7-2c260146c6b5/041c8cec-8167-5084-8ad7-2c260146c6b5_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 345220,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3805802-3964370-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_041c8cec-8167-5084-8ad7-2c260146c6b5/041c8cec-8167-5084-8ad7-2c260146c6b5_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 267743,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3805802-3964370-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_041c8cec-8167-5084-8ad7-2c260146c6b5/041c8cec-8167-5084-8ad7-2c260146c6b5_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 352272,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3805802-3964370-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_041c8cec-8167-5084-8ad7-2c260146c6b5/041c8cec-8167-5084-8ad7-2c260146c6b5_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 269332,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3805802-3964370-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_041c8cec-8167-5084-8ad7-2c260146c6b5/041c8cec-8167-5084-8ad7-2c260146c6b5_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 289430,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3805802-3964370-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_041c8cec-8167-5084-8ad7-2c260146c6b5/041c8cec-8167-5084-8ad7-2c260146c6b5_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 308788,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3805802-3964370-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-05-29',
 'seller_name': 'Leasys',
 'title': 'PEUGEOT 2008 1.2 PureTech 130 Allure 5dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech 130 Allure 5dr',
 'year': 2024}
2025-12-05 06:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273805802%27 HTTP/1.1" 200 None
2025-12-05 06:06:44 [manheim.gb] INFO: Saving data for 3805802: {'created_time': 1764914804.345512, 'last_price_update_time': 1764914804.345524, 'auction_closing_time': 1764925200.0}
2025-12-05 06:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3805802') HTTP/1.1" 204 0
2025-12-05 06:06:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342456910>
2025-12-05 06:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 06:06:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a64efbf-cabf-59ed-9ed9-e7eaa4df9787/2a64efbf-cabf-59ed-9ed9-e7eaa4df9787_image_4.jpg HTTP/1.1" 201 0
2025-12-05 06:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3517150-9999999-338124313-003.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3517150-9999999-338124313-003.jpg saved to cache
2025-12-05 06:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2a64efbf-cabf-59ed-9ed9-e7eaa4df9787
2025-12-05 06:06:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234158f750>
2025-12-05 06:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 06:06:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a64efbf-cabf-59ed-9ed9-e7eaa4df9787/2a64efbf-cabf-59ed-9ed9-e7eaa4df9787_image_6.jpg HTTP/1.1" 201 0
2025-12-05 06:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3517150-9999999-338124313-006.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3517150-9999999-338124313-006.jpg saved to cache
2025-12-05 06:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2a64efbf-cabf-59ed-9ed9-e7eaa4df9787
2025-12-05 06:06:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425a1b10>
2025-12-05 06:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:06:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a64efbf-cabf-59ed-9ed9-e7eaa4df9787/2a64efbf-cabf-59ed-9ed9-e7eaa4df9787_image_1.jpg HTTP/1.1" 201 0
2025-12-05 06:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3517150-9999999-338124313-008.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3517150-9999999-338124313-008.jpg saved to cache
2025-12-05 06:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2a64efbf-cabf-59ed-9ed9-e7eaa4df9787
2025-12-05 06:06:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342912950>
2025-12-05 06:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:06:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a64efbf-cabf-59ed-9ed9-e7eaa4df9787/2a64efbf-cabf-59ed-9ed9-e7eaa4df9787_image_2.jpg HTTP/1.1" 201 0
2025-12-05 06:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3517150-9999999-338124313-001.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3517150-9999999-338124313-001.jpg saved to cache
2025-12-05 06:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2a64efbf-cabf-59ed-9ed9-e7eaa4df9787
2025-12-05 06:06:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342671590>
2025-12-05 06:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:06:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a64efbf-cabf-59ed-9ed9-e7eaa4df9787/2a64efbf-cabf-59ed-9ed9-e7eaa4df9787_image_3.jpg HTTP/1.1" 201 0
2025-12-05 06:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3517150-9999999-338124313-002.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3517150-9999999-338124313-002.jpg saved to cache
2025-12-05 06:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2a64efbf-cabf-59ed-9ed9-e7eaa4df9787
2025-12-05 06:06:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23424e5d10>
2025-12-05 06:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:06:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a64efbf-cabf-59ed-9ed9-e7eaa4df9787/2a64efbf-cabf-59ed-9ed9-e7eaa4df9787_image_5.jpg HTTP/1.1" 201 0
2025-12-05 06:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3517150-9999999-338124313-005.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3517150-9999999-338124313-005.jpg saved to cache
2025-12-05 06:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2a64efbf-cabf-59ed-9ed9-e7eaa4df9787
2025-12-05 06:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3517150-4008226-1004.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3517150-4008226-1004.jpg not downloaded yet
2025-12-05 06:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/35d32ec0-02df-42bd-bed7-0390cc81834b_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002445301-01989097-003.pdf)
2025-12-05 06:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3517150-9999999-338124313-010.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003517150-01993640-003.pdf)
2025-12-05 06:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3517150-9999999-338124313-011.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003517150-01993640-003.pdf)
2025-12-05 06:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/35d32ec0-02df-42bd-bed7-0390cc81834b_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002445301-01989097-003.pdf)
2025-12-05 06:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3517150-4008226-1005.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3517150-4008226-1005.jpg not downloaded yet
2025-12-05 06:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3517150-9999999-338124313-009.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003517150-01993640-003.pdf)
2025-12-05 06:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3517150-9999999-338124313-007.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003517150-01993640-003.pdf)
2025-12-05 06:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3517150-4008226-1006.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3517150-4008226-1006.jpg not downloaded yet
2025-12-05 06:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003476246-01990375-002.pdf> (referer: None)
2025-12-05 06:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003607988-1001408974-002.pdf> (referer: None)
2025-12-05 06:06:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341e92510>
2025-12-05 06:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:06:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c00db30e-97d1-5780-baf0-2570c7931598/c00db30e-97d1-5780-baf0-2570c7931598_image_5.jpg HTTP/1.1" 201 0
2025-12-05 06:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F35d32ec0-02df-42bd-bed7-0390cc81834b_4.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/35d32ec0-02df-42bd-bed7-0390cc81834b_4.jpg saved to cache
2025-12-05 06:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c00db30e-97d1-5780-baf0-2570c7931598
2025-12-05 06:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3517150-4008226-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003517150-01993640-003.pdf)
2025-12-05 06:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3517150-4008226-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003517150-01993640-003.pdf)
2025-12-05 06:06:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23424a2dd0>
2025-12-05 06:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:06:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a64efbf-cabf-59ed-9ed9-e7eaa4df9787/2a64efbf-cabf-59ed-9ed9-e7eaa4df9787_image_9.jpg HTTP/1.1" 201 0
2025-12-05 06:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3517150-9999999-338124313-010.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3517150-9999999-338124313-010.jpg saved to cache
2025-12-05 06:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2a64efbf-cabf-59ed-9ed9-e7eaa4df9787
2025-12-05 06:06:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342357a90>
2025-12-05 06:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:06:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a64efbf-cabf-59ed-9ed9-e7eaa4df9787/2a64efbf-cabf-59ed-9ed9-e7eaa4df9787_image_10.jpg HTTP/1.1" 201 0
2025-12-05 06:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3517150-9999999-338124313-011.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3517150-9999999-338124313-011.jpg saved to cache
2025-12-05 06:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 2a64efbf-cabf-59ed-9ed9-e7eaa4df9787
2025-12-05 06:06:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341558610>
2025-12-05 06:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:06:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c00db30e-97d1-5780-baf0-2570c7931598/c00db30e-97d1-5780-baf0-2570c7931598_image_4.jpg HTTP/1.1" 201 0
2025-12-05 06:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F35d32ec0-02df-42bd-bed7-0390cc81834b_5.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/35d32ec0-02df-42bd-bed7-0390cc81834b_5.jpg saved to cache
2025-12-05 06:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c00db30e-97d1-5780-baf0-2570c7931598
2025-12-05 06:06:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342511750>
2025-12-05 06:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 06:06:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a64efbf-cabf-59ed-9ed9-e7eaa4df9787/2a64efbf-cabf-59ed-9ed9-e7eaa4df9787_image_8.jpg HTTP/1.1" 201 0
2025-12-05 06:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3517150-9999999-338124313-009.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3517150-9999999-338124313-009.jpg saved to cache
2025-12-05 06:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2a64efbf-cabf-59ed-9ed9-e7eaa4df9787
2025-12-05 06:06:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341f26a10>
2025-12-05 06:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:06:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a64efbf-cabf-59ed-9ed9-e7eaa4df9787/2a64efbf-cabf-59ed-9ed9-e7eaa4df9787_image_7.jpg HTTP/1.1" 201 0
2025-12-05 06:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3517150-9999999-338124313-007.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3517150-9999999-338124313-007.jpg saved to cache
2025-12-05 06:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2a64efbf-cabf-59ed-9ed9-e7eaa4df9787
2025-12-05 06:06:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23428bbb90>
2025-12-05 06:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:06:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3312266e-82b8-5f1b-81b7-8009f7cac9eb/3312266e-82b8-5f1b-81b7-8009f7cac9eb_expert_report_file_6a0662b4-1e99-41b8-ba62-9c8c7d3be5ce.pdf HTTP/1.1" 201 0
2025-12-05 06:06:48 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 3312266e-82b8-5f1b-81b7-8009f7cac9eb
2025-12-05 06:06:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3312266e-82b8-5f1b-81b7-8009f7cac9eb, skipping ID generation
2025-12-05 06:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 3312266e-82b8-5f1b-81b7-8009f7cac9eb
2025-12-05 06:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F97b1c90a-3b4a-4581-82cd-cee29e54da7b_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/97b1c90a-3b4a-4581-82cd-cee29e54da7b_ext_7.jpg not downloaded yet
2025-12-05 06:06:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342627b10>
2025-12-05 06:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:06:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4cdbfc7-068e-50aa-aa3a-1e77cf962189/f4cdbfc7-068e-50aa-aa3a-1e77cf962189_expert_report_file_73304879-7996-408a-94fa-84b99b6556e0.pdf HTTP/1.1" 201 0
2025-12-05 06:06:48 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item f4cdbfc7-068e-50aa-aa3a-1e77cf962189
2025-12-05 06:06:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f4cdbfc7-068e-50aa-aa3a-1e77cf962189, skipping ID generation
2025-12-05 06:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item f4cdbfc7-068e-50aa-aa3a-1e77cf962189
2025-12-05 06:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fawaiting-image-002.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/awaiting-image-002.jpg already downloaded
2025-12-05 06:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fawaiting-image-002.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/awaiting-image-002.jpg already downloaded
2025-12-05 06:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3607988-3539050-3.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3607988-3539050-3.jpg not downloaded yet
2025-12-05 06:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3517150-4008226-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003517150-01993640-003.pdf)
2025-12-05 06:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3517150-4008226-1006.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003517150-01993640-003.pdf)
2025-12-05 06:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3517150-4008226-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003517150-01993640-003.pdf)
2025-12-05 06:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F97b1c90a-3b4a-4581-82cd-cee29e54da7b_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/97b1c90a-3b4a-4581-82cd-cee29e54da7b_ext_7.jpg not downloaded yet
2025-12-05 06:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3607988-3539050-13.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3607988-3539050-13.jpg not downloaded yet
2025-12-05 06:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3517150-4008226-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003517150-01993640-003.pdf)
2025-12-05 06:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3517150-4008226-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003517150-01993640-003.pdf)
2025-12-05 06:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F97b1c90a-3b4a-4581-82cd-cee29e54da7b_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/97b1c90a-3b4a-4581-82cd-cee29e54da7b_ext_6.jpg not downloaded yet
2025-12-05 06:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3607988-3539050-1000.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3607988-3539050-1000.jpg not downloaded yet
2025-12-05 06:06:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23427b2910>
2025-12-05 06:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:06:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a64efbf-cabf-59ed-9ed9-e7eaa4df9787/2a64efbf-cabf-59ed-9ed9-e7eaa4df9787_image_15.jpg HTTP/1.1" 201 0
2025-12-05 06:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3517150-4008226-1002.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3517150-4008226-1002.jpg saved to cache
2025-12-05 06:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 2a64efbf-cabf-59ed-9ed9-e7eaa4df9787
2025-12-05 06:06:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341447690>
2025-12-05 06:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:06:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a64efbf-cabf-59ed-9ed9-e7eaa4df9787/2a64efbf-cabf-59ed-9ed9-e7eaa4df9787_image_17.jpg HTTP/1.1" 201 0
2025-12-05 06:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3517150-4008226-1004.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3517150-4008226-1004.jpg saved to cache
2025-12-05 06:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 2a64efbf-cabf-59ed-9ed9-e7eaa4df9787
2025-12-05 06:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F97b1c90a-3b4a-4581-82cd-cee29e54da7b_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/97b1c90a-3b4a-4581-82cd-cee29e54da7b_ext_1.jpg not downloaded yet
2025-12-05 06:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3607988-3539050-1001.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3607988-3539050-1001.jpg not downloaded yet
2025-12-05 06:06:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342633110>
2025-12-05 06:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:06:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a64efbf-cabf-59ed-9ed9-e7eaa4df9787/2a64efbf-cabf-59ed-9ed9-e7eaa4df9787_image_16.jpg HTTP/1.1" 201 0
2025-12-05 06:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3517150-4008226-1003.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3517150-4008226-1003.jpg saved to cache
2025-12-05 06:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 2a64efbf-cabf-59ed-9ed9-e7eaa4df9787
2025-12-05 06:06:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342936c50>
2025-12-05 06:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:06:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a64efbf-cabf-59ed-9ed9-e7eaa4df9787/2a64efbf-cabf-59ed-9ed9-e7eaa4df9787_image_19.jpg HTTP/1.1" 201 0
2025-12-05 06:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3517150-4008226-1006.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3517150-4008226-1006.jpg saved to cache
2025-12-05 06:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 2a64efbf-cabf-59ed-9ed9-e7eaa4df9787
2025-12-05 06:06:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341444710>
2025-12-05 06:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 06:06:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a64efbf-cabf-59ed-9ed9-e7eaa4df9787/2a64efbf-cabf-59ed-9ed9-e7eaa4df9787_image_14.jpg HTTP/1.1" 201 0
2025-12-05 06:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3517150-4008226-1001.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3517150-4008226-1001.jpg saved to cache
2025-12-05 06:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 2a64efbf-cabf-59ed-9ed9-e7eaa4df9787
2025-12-05 06:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F97b1c90a-3b4a-4581-82cd-cee29e54da7b_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/97b1c90a-3b4a-4581-82cd-cee29e54da7b_5.jpg not downloaded yet
2025-12-05 06:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3607988-3539050-1002.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3607988-3539050-1002.jpg not downloaded yet
2025-12-05 06:06:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234278eb10>
2025-12-05 06:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:06:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a64efbf-cabf-59ed-9ed9-e7eaa4df9787/2a64efbf-cabf-59ed-9ed9-e7eaa4df9787_image_13.jpg HTTP/1.1" 201 0
2025-12-05 06:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3517150-4008226-1000.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3517150-4008226-1000.jpg saved to cache
2025-12-05 06:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 2a64efbf-cabf-59ed-9ed9-e7eaa4df9787
2025-12-05 06:06:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2343ce6f90>
2025-12-05 06:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:06:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a64efbf-cabf-59ed-9ed9-e7eaa4df9787/2a64efbf-cabf-59ed-9ed9-e7eaa4df9787_image_18.jpg HTTP/1.1" 201 0
2025-12-05 06:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3517150-4008226-1005.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3517150-4008226-1005.jpg saved to cache
2025-12-05 06:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 2a64efbf-cabf-59ed-9ed9-e7eaa4df9787
2025-12-05 06:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F97b1c90a-3b4a-4581-82cd-cee29e54da7b_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/97b1c90a-3b4a-4581-82cd-cee29e54da7b_4.jpg not downloaded yet
2025-12-05 06:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3607988-3539050-1003.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3607988-3539050-1003.jpg not downloaded yet
2025-12-05 06:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F97b1c90a-3b4a-4581-82cd-cee29e54da7b_11.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/97b1c90a-3b4a-4581-82cd-cee29e54da7b_11.jpg not downloaded yet
2025-12-05 06:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3607988-3539050-1004.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3607988-3539050-1004.jpg not downloaded yet
2025-12-05 06:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F97b1c90a-3b4a-4581-82cd-cee29e54da7b_10.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/97b1c90a-3b4a-4581-82cd-cee29e54da7b_10.jpg not downloaded yet
2025-12-05 06:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3607988-3539050-1005.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3607988-3539050-1005.jpg not downloaded yet
2025-12-05 06:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F97b1c90a-3b4a-4581-82cd-cee29e54da7b_9.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/97b1c90a-3b4a-4581-82cd-cee29e54da7b_9.jpg not downloaded yet
2025-12-05 06:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3607988-3539050-1006.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3607988-3539050-1006.jpg not downloaded yet
2025-12-05 06:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F97b1c90a-3b4a-4581-82cd-cee29e54da7b_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/97b1c90a-3b4a-4581-82cd-cee29e54da7b_ext_2.jpg not downloaded yet
2025-12-05 06:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3607988-3539050-1007.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3607988-3539050-1007.jpg not downloaded yet
2025-12-05 06:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F97b1c90a-3b4a-4581-82cd-cee29e54da7b_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/97b1c90a-3b4a-4581-82cd-cee29e54da7b_ext_5.jpg not downloaded yet
2025-12-05 06:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3607988-3539050-1008.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3607988-3539050-1008.jpg not downloaded yet
2025-12-05 06:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F97b1c90a-3b4a-4581-82cd-cee29e54da7b_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/97b1c90a-3b4a-4581-82cd-cee29e54da7b_ext_3.jpg not downloaded yet
2025-12-05 06:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3607988-3539050-1009.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3607988-3539050-1009.jpg not downloaded yet
2025-12-05 06:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F97b1c90a-3b4a-4581-82cd-cee29e54da7b_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/97b1c90a-3b4a-4581-82cd-cee29e54da7b_ext_4.jpg not downloaded yet
2025-12-05 06:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3607988-3539050-1010.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3607988-3539050-1010.jpg not downloaded yet
2025-12-05 06:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3476246-4008440-13.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3476246-4008440-13.jpg not downloaded yet
2025-12-05 06:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3607988-3539050-1011.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3607988-3539050-1011.jpg not downloaded yet
2025-12-05 06:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3476246-4008440-1000.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3476246-4008440-1000.jpg not downloaded yet
2025-12-05 06:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3607988-3539050-1012.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3607988-3539050-1012.jpg not downloaded yet
2025-12-05 06:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3476246-4008440-1001.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3476246-4008440-1001.jpg not downloaded yet
2025-12-05 06:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3607988-3539050-1013.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3607988-3539050-1013.jpg not downloaded yet
2025-12-05 06:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3476246-4008440-1002.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3476246-4008440-1002.jpg not downloaded yet
2025-12-05 06:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3607988-3539050-1014.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3607988-3539050-1014.jpg not downloaded yet
2025-12-05 06:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3476246-4008440-1003.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3476246-4008440-1003.jpg not downloaded yet
2025-12-05 06:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3607988-3539050-1015.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3607988-3539050-1015.jpg not downloaded yet
2025-12-05 06:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3476246-4008440-1004.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3476246-4008440-1004.jpg not downloaded yet
2025-12-05 06:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3476246-4008440-1005.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3476246-4008440-1005.jpg not downloaded yet
2025-12-05 06:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003690345-01947401-004.pdf> (referer: None)
2025-12-05 06:06:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341f02f10>
2025-12-05 06:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:06:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fc77dba-953c-5b07-8795-c10f561b4b1f/4fc77dba-953c-5b07-8795-c10f561b4b1f_expert_report_file_aead696d-b557-44ea-94dc-f2c222b5d81b.pdf HTTP/1.1" 201 0
2025-12-05 06:06:52 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 4fc77dba-953c-5b07-8795-c10f561b4b1f
2025-12-05 06:06:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4fc77dba-953c-5b07-8795-c10f561b4b1f, skipping ID generation
2025-12-05 06:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 4fc77dba-953c-5b07-8795-c10f561b4b1f
2025-12-05 06:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcc3e6484-89c5-4cf3-8c5b-e3cab47166a1_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cc3e6484-89c5-4cf3-8c5b-e3cab47166a1_ext_7.jpg not downloaded yet
2025-12-05 06:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcc3e6484-89c5-4cf3-8c5b-e3cab47166a1_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cc3e6484-89c5-4cf3-8c5b-e3cab47166a1_ext_7.jpg not downloaded yet
2025-12-05 06:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/PEUGEOT/108?id=3432289&returnUrl=%2Fsearch%3FPage%3D3%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233432289&indx=214> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcc3e6484-89c5-4cf3-8c5b-e3cab47166a1_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cc3e6484-89c5-4cf3-8c5b-e3cab47166a1_ext_6.jpg not downloaded yet
2025-12-05 06:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3476246-4008440-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003476246-01990375-002.pdf)
2025-12-05 06:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3476246-4008440-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003476246-01990375-002.pdf)
2025-12-05 06:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcc3e6484-89c5-4cf3-8c5b-e3cab47166a1_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cc3e6484-89c5-4cf3-8c5b-e3cab47166a1_ext_1.jpg not downloaded yet
2025-12-05 06:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3476246-4008440-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003476246-01990375-002.pdf)
2025-12-05 06:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcc3e6484-89c5-4cf3-8c5b-e3cab47166a1_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cc3e6484-89c5-4cf3-8c5b-e3cab47166a1_5.jpg not downloaded yet
2025-12-05 06:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3607988-3539050-1013.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003607988-1001408974-002.pdf)
2025-12-05 06:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcc3e6484-89c5-4cf3-8c5b-e3cab47166a1_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cc3e6484-89c5-4cf3-8c5b-e3cab47166a1_4.jpg not downloaded yet
2025-12-05 06:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3476246-4008440-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003476246-01990375-002.pdf)
2025-12-05 06:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcc3e6484-89c5-4cf3-8c5b-e3cab47166a1_11.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cc3e6484-89c5-4cf3-8c5b-e3cab47166a1_11.jpg not downloaded yet
2025-12-05 06:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcc3e6484-89c5-4cf3-8c5b-e3cab47166a1_10.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cc3e6484-89c5-4cf3-8c5b-e3cab47166a1_10.jpg not downloaded yet
2025-12-05 06:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3476246-4008440-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003476246-01990375-002.pdf)
2025-12-05 06:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3607988-3539050-1015.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003607988-1001408974-002.pdf)
2025-12-05 06:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcc3e6484-89c5-4cf3-8c5b-e3cab47166a1_9.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cc3e6484-89c5-4cf3-8c5b-e3cab47166a1_9.jpg not downloaded yet
2025-12-05 06:06:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64fe5589-c7a8-53cf-8425-df943d1557e3 with identifier: 3432289
2025-12-05 06:06:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64fe5589-c7a8-53cf-8425-df943d1557e3 with scrape type 2
2025-12-05 06:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64fe5589-c7a8-53cf-8425-df943d1557e3 with scrape type 2
2025-12-05 06:06:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 64fe5589-c7a8-53cf-8425-df943d1557e3, identifier: 3432289
2025-12-05 06:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcc3e6484-89c5-4cf3-8c5b-e3cab47166a1_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cc3e6484-89c5-4cf3-8c5b-e3cab47166a1_ext_2.jpg not downloaded yet
2025-12-05 06:06:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 64fe5589-c7a8-53cf-8425-df943d1557e3 with identifier: 3432289
2025-12-05 06:06:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 06:06:52 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=PURPLE HTTP/1.1" 200 None
2025-12-05 06:06:53 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 06:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 06:06:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 64fe5589-c7a8-53cf-8425-df943d1557e3 with identifier: 3432289
2025-12-05 06:06:53 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 64fe5589-c7a8-53cf-8425-df943d1557e3 with identifier: 3432289 to the API
2025-12-05 06:06:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 06:06:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 06:06:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/PEUGEOT/108?id=3432289&returnUrl=%2Fsearch%3FPage%3D3%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233432289&indx=214>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003432289-01961388-002.pdf',
 'color': 'PURPLE',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '64fe5589-c7a8-53cf-8425-df943d1557e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'EN65YTX',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/PEUGEOT/108?id=3432289',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'PEUGEOT',
 'model': '108',
 'odometer': 69106,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-30',
 'seller_name': 'Santander Consumer',
 'title': 'PEUGEOT 108 1.2 PureTech Allure 3dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech Allure 3dr',
 'year': 2016}
2025-12-05 06:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273432289%27 HTTP/1.1" 200 None
2025-12-05 06:06:53 [manheim.gb] INFO: Saving data for 3432289: {'auction_closing_time': 1765270800.0, 'created_time': 1764792260.100978, 'last_price_update_time': 1764914813.315836}
2025-12-05 06:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3432289') HTTP/1.1" 204 0
2025-12-05 06:06:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341ea8e90>
2025-12-05 06:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:06:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3312266e-82b8-5f1b-81b7-8009f7cac9eb/3312266e-82b8-5f1b-81b7-8009f7cac9eb_image_18.jpg HTTP/1.1" 201 0
2025-12-05 06:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3476246-4008440-1004.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3476246-4008440-1004.jpg saved to cache
2025-12-05 06:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 3312266e-82b8-5f1b-81b7-8009f7cac9eb
2025-12-05 06:06:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23428a6cd0>
2025-12-05 06:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:06:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3312266e-82b8-5f1b-81b7-8009f7cac9eb/3312266e-82b8-5f1b-81b7-8009f7cac9eb_image_19.jpg HTTP/1.1" 201 0
2025-12-05 06:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3476246-4008440-1005.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3476246-4008440-1005.jpg saved to cache
2025-12-05 06:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 3312266e-82b8-5f1b-81b7-8009f7cac9eb
2025-12-05 06:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcc3e6484-89c5-4cf3-8c5b-e3cab47166a1_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cc3e6484-89c5-4cf3-8c5b-e3cab47166a1_ext_5.jpg not downloaded yet
2025-12-05 06:06:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342801350>
2025-12-05 06:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 06:06:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3312266e-82b8-5f1b-81b7-8009f7cac9eb/3312266e-82b8-5f1b-81b7-8009f7cac9eb_image_16.jpg HTTP/1.1" 201 0
2025-12-05 06:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3476246-4008440-1002.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3476246-4008440-1002.jpg saved to cache
2025-12-05 06:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 3312266e-82b8-5f1b-81b7-8009f7cac9eb
2025-12-05 06:06:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234153e890>
2025-12-05 06:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:06:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4cdbfc7-068e-50aa-aa3a-1e77cf962189/f4cdbfc7-068e-50aa-aa3a-1e77cf962189_image_17.jpg HTTP/1.1" 201 0
2025-12-05 06:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3607988-3539050-1013.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3607988-3539050-1013.jpg saved to cache
2025-12-05 06:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item f4cdbfc7-068e-50aa-aa3a-1e77cf962189
2025-12-05 06:06:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234270ed50>
2025-12-05 06:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 06:06:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3312266e-82b8-5f1b-81b7-8009f7cac9eb/3312266e-82b8-5f1b-81b7-8009f7cac9eb_image_17.jpg HTTP/1.1" 201 0
2025-12-05 06:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3476246-4008440-1003.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3476246-4008440-1003.jpg saved to cache
2025-12-05 06:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 3312266e-82b8-5f1b-81b7-8009f7cac9eb
2025-12-05 06:06:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341eb5690>
2025-12-05 06:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:06:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3312266e-82b8-5f1b-81b7-8009f7cac9eb/3312266e-82b8-5f1b-81b7-8009f7cac9eb_image_15.jpg HTTP/1.1" 201 0
2025-12-05 06:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3476246-4008440-1001.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3476246-4008440-1001.jpg saved to cache
2025-12-05 06:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 3312266e-82b8-5f1b-81b7-8009f7cac9eb
2025-12-05 06:06:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23428c7e50>
2025-12-05 06:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:06:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4cdbfc7-068e-50aa-aa3a-1e77cf962189/f4cdbfc7-068e-50aa-aa3a-1e77cf962189_image_19.jpg HTTP/1.1" 201 0
2025-12-05 06:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3607988-3539050-1015.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3607988-3539050-1015.jpg saved to cache
2025-12-05 06:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item f4cdbfc7-068e-50aa-aa3a-1e77cf962189
2025-12-05 06:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3607988-3539050-1014.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003607988-1001408974-002.pdf)
2025-12-05 06:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcc3e6484-89c5-4cf3-8c5b-e3cab47166a1_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cc3e6484-89c5-4cf3-8c5b-e3cab47166a1_ext_3.jpg not downloaded yet
2025-12-05 06:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcc3e6484-89c5-4cf3-8c5b-e3cab47166a1_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cc3e6484-89c5-4cf3-8c5b-e3cab47166a1_ext_4.jpg not downloaded yet
2025-12-05 06:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3690345-3997372-13.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3690345-3997372-13.jpg not downloaded yet
2025-12-05 06:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3690345-3997372-1000.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3690345-3997372-1000.jpg not downloaded yet
2025-12-05 06:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3690345-3997372-1001.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3690345-3997372-1001.jpg not downloaded yet
2025-12-05 06:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3690345-3997372-1002.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3690345-3997372-1002.jpg not downloaded yet
2025-12-05 06:06:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2343e27190>
2025-12-05 06:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:06:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4cdbfc7-068e-50aa-aa3a-1e77cf962189/f4cdbfc7-068e-50aa-aa3a-1e77cf962189_image_18.jpg HTTP/1.1" 201 0
2025-12-05 06:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3607988-3539050-1014.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3607988-3539050-1014.jpg saved to cache
2025-12-05 06:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item f4cdbfc7-068e-50aa-aa3a-1e77cf962189
2025-12-05 06:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3690345-3997372-1003.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3690345-3997372-1003.jpg not downloaded yet
2025-12-05 06:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3690345-3997372-1004.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3690345-3997372-1004.jpg not downloaded yet
2025-12-05 06:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3690345-3997372-1005.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3690345-3997372-1005.jpg not downloaded yet
2025-12-05 06:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3690345-3997372-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003690345-01947401-004.pdf)
2025-12-05 06:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3690345-3997372-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003690345-01947401-004.pdf)
2025-12-05 06:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/cc3e6484-89c5-4cf3-8c5b-e3cab47166a1_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003690345-01947401-004.pdf)
2025-12-05 06:06:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23427f5e10>
2025-12-05 06:06:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:06:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fc77dba-953c-5b07-8795-c10f561b4b1f/4fc77dba-953c-5b07-8795-c10f561b4b1f_image_13.jpg HTTP/1.1" 201 0
2025-12-05 06:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3690345-3997372-13.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3690345-3997372-13.jpg saved to cache
2025-12-05 06:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 4fc77dba-953c-5b07-8795-c10f561b4b1f
2025-12-05 06:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/cc3e6484-89c5-4cf3-8c5b-e3cab47166a1_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003690345-01947401-004.pdf)
2025-12-05 06:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/cc3e6484-89c5-4cf3-8c5b-e3cab47166a1_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003690345-01947401-004.pdf)
2025-12-05 06:06:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23415c1550>
2025-12-05 06:06:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:06:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fc77dba-953c-5b07-8795-c10f561b4b1f/4fc77dba-953c-5b07-8795-c10f561b4b1f_image_14.jpg HTTP/1.1" 201 0
2025-12-05 06:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3690345-3997372-1000.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3690345-3997372-1000.jpg saved to cache
2025-12-05 06:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 4fc77dba-953c-5b07-8795-c10f561b4b1f
2025-12-05 06:06:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23423a9450>
2025-12-05 06:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:06:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fc77dba-953c-5b07-8795-c10f561b4b1f/4fc77dba-953c-5b07-8795-c10f561b4b1f_image_12.jpg HTTP/1.1" 201 0
2025-12-05 06:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcc3e6484-89c5-4cf3-8c5b-e3cab47166a1_ext_4.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cc3e6484-89c5-4cf3-8c5b-e3cab47166a1_ext_4.jpg saved to cache
2025-12-05 06:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 4fc77dba-953c-5b07-8795-c10f561b4b1f
2025-12-05 06:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3690345-3997372-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003690345-01947401-004.pdf)
2025-12-05 06:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3690345-3997372-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003690345-01947401-004.pdf)
2025-12-05 06:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/cc3e6484-89c5-4cf3-8c5b-e3cab47166a1_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003690345-01947401-004.pdf)
2025-12-05 06:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3690345-3997372-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003690345-01947401-004.pdf)
2025-12-05 06:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3690345-3997372-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003690345-01947401-004.pdf)
2025-12-05 06:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3690345-3997372-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003690345-01947401-004.pdf)
2025-12-05 06:06:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234157ed50>
2025-12-05 06:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:06:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fc77dba-953c-5b07-8795-c10f561b4b1f/4fc77dba-953c-5b07-8795-c10f561b4b1f_image_10.jpg HTTP/1.1" 201 0
2025-12-05 06:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcc3e6484-89c5-4cf3-8c5b-e3cab47166a1_ext_5.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cc3e6484-89c5-4cf3-8c5b-e3cab47166a1_ext_5.jpg saved to cache
2025-12-05 06:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 4fc77dba-953c-5b07-8795-c10f561b4b1f
2025-12-05 06:06:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342934cd0>
2025-12-05 06:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:06:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fc77dba-953c-5b07-8795-c10f561b4b1f/4fc77dba-953c-5b07-8795-c10f561b4b1f_image_11.jpg HTTP/1.1" 201 0
2025-12-05 06:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcc3e6484-89c5-4cf3-8c5b-e3cab47166a1_ext_3.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cc3e6484-89c5-4cf3-8c5b-e3cab47166a1_ext_3.jpg saved to cache
2025-12-05 06:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 4fc77dba-953c-5b07-8795-c10f561b4b1f
2025-12-05 06:06:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/cc3e6484-89c5-4cf3-8c5b-e3cab47166a1_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003690345-01947401-004.pdf)
2025-12-05 06:06:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/cc3e6484-89c5-4cf3-8c5b-e3cab47166a1_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003690345-01947401-004.pdf)
2025-12-05 06:06:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/cc3e6484-89c5-4cf3-8c5b-e3cab47166a1_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003690345-01947401-004.pdf)
2025-12-05 06:06:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/cc3e6484-89c5-4cf3-8c5b-e3cab47166a1_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003690345-01947401-004.pdf)
2025-12-05 06:06:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/cc3e6484-89c5-4cf3-8c5b-e3cab47166a1_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003690345-01947401-004.pdf)
2025-12-05 06:06:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/cc3e6484-89c5-4cf3-8c5b-e3cab47166a1_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003690345-01947401-004.pdf)
2025-12-05 06:06:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/cc3e6484-89c5-4cf3-8c5b-e3cab47166a1_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003690345-01947401-004.pdf)
2025-12-05 06:06:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/cc3e6484-89c5-4cf3-8c5b-e3cab47166a1_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003690345-01947401-004.pdf)
2025-12-05 06:06:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234243fed0>
2025-12-05 06:06:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:06:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fc77dba-953c-5b07-8795-c10f561b4b1f/4fc77dba-953c-5b07-8795-c10f561b4b1f_image_18.jpg HTTP/1.1" 201 0
2025-12-05 06:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3690345-3997372-1004.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3690345-3997372-1004.jpg saved to cache
2025-12-05 06:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 4fc77dba-953c-5b07-8795-c10f561b4b1f
2025-12-05 06:06:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23415c5f50>
2025-12-05 06:06:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:06:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fc77dba-953c-5b07-8795-c10f561b4b1f/4fc77dba-953c-5b07-8795-c10f561b4b1f_image_17.jpg HTTP/1.1" 201 0
2025-12-05 06:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3690345-3997372-1003.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3690345-3997372-1003.jpg saved to cache
2025-12-05 06:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 4fc77dba-953c-5b07-8795-c10f561b4b1f
2025-12-05 06:06:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342377d90>
2025-12-05 06:06:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:06:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fc77dba-953c-5b07-8795-c10f561b4b1f/4fc77dba-953c-5b07-8795-c10f561b4b1f_image_9.jpg HTTP/1.1" 201 0
2025-12-05 06:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcc3e6484-89c5-4cf3-8c5b-e3cab47166a1_ext_2.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cc3e6484-89c5-4cf3-8c5b-e3cab47166a1_ext_2.jpg saved to cache
2025-12-05 06:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4fc77dba-953c-5b07-8795-c10f561b4b1f
2025-12-05 06:06:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234292aed0>
2025-12-05 06:06:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:06:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fc77dba-953c-5b07-8795-c10f561b4b1f/4fc77dba-953c-5b07-8795-c10f561b4b1f_image_19.jpg HTTP/1.1" 201 0
2025-12-05 06:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3690345-3997372-1005.jpg') HTTP/1.1" 204 0
2025-12-05 06:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3690345-3997372-1005.jpg saved to cache
2025-12-05 06:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 4fc77dba-953c-5b07-8795-c10f561b4b1f
2025-12-05 06:06:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:06:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:06:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:06:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234243fc50>
2025-12-05 06:06:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:06:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:06:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:06:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:06:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fc77dba-953c-5b07-8795-c10f561b4b1f/4fc77dba-953c-5b07-8795-c10f561b4b1f_image_15.jpg HTTP/1.1" 201 0
2025-12-05 06:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3690345-3997372-1001.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3690345-3997372-1001.jpg saved to cache
2025-12-05 06:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 4fc77dba-953c-5b07-8795-c10f561b4b1f
2025-12-05 06:07:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23428cfb10>
2025-12-05 06:07:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:07:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fc77dba-953c-5b07-8795-c10f561b4b1f/4fc77dba-953c-5b07-8795-c10f561b4b1f_image_16.jpg HTTP/1.1" 201 0
2025-12-05 06:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3690345-3997372-1002.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3690345-3997372-1002.jpg saved to cache
2025-12-05 06:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 4fc77dba-953c-5b07-8795-c10f561b4b1f
2025-12-05 06:07:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/cc3e6484-89c5-4cf3-8c5b-e3cab47166a1_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003690345-01947401-004.pdf)
2025-12-05 06:07:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23427b99d0>
2025-12-05 06:07:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:07:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fc77dba-953c-5b07-8795-c10f561b4b1f/4fc77dba-953c-5b07-8795-c10f561b4b1f_image_8.jpg HTTP/1.1" 201 0
2025-12-05 06:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcc3e6484-89c5-4cf3-8c5b-e3cab47166a1_9.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cc3e6484-89c5-4cf3-8c5b-e3cab47166a1_9.jpg saved to cache
2025-12-05 06:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4fc77dba-953c-5b07-8795-c10f561b4b1f
2025-12-05 06:07:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342562610>
2025-12-05 06:07:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:07:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fc77dba-953c-5b07-8795-c10f561b4b1f/4fc77dba-953c-5b07-8795-c10f561b4b1f_image_7.jpg HTTP/1.1" 201 0
2025-12-05 06:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcc3e6484-89c5-4cf3-8c5b-e3cab47166a1_10.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cc3e6484-89c5-4cf3-8c5b-e3cab47166a1_10.jpg saved to cache
2025-12-05 06:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4fc77dba-953c-5b07-8795-c10f561b4b1f
2025-12-05 06:07:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23424e7410>
2025-12-05 06:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:07:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fc77dba-953c-5b07-8795-c10f561b4b1f/4fc77dba-953c-5b07-8795-c10f561b4b1f_image_6.jpg HTTP/1.1" 201 0
2025-12-05 06:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcc3e6484-89c5-4cf3-8c5b-e3cab47166a1_11.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cc3e6484-89c5-4cf3-8c5b-e3cab47166a1_11.jpg saved to cache
2025-12-05 06:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4fc77dba-953c-5b07-8795-c10f561b4b1f
2025-12-05 06:07:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342560190>
2025-12-05 06:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:07:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fc77dba-953c-5b07-8795-c10f561b4b1f/4fc77dba-953c-5b07-8795-c10f561b4b1f_image_3.jpg HTTP/1.1" 201 0
2025-12-05 06:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcc3e6484-89c5-4cf3-8c5b-e3cab47166a1_ext_1.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cc3e6484-89c5-4cf3-8c5b-e3cab47166a1_ext_1.jpg saved to cache
2025-12-05 06:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4fc77dba-953c-5b07-8795-c10f561b4b1f
2025-12-05 06:07:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342578a50>
2025-12-05 06:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 06:07:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fc77dba-953c-5b07-8795-c10f561b4b1f/4fc77dba-953c-5b07-8795-c10f561b4b1f_image_4.jpg HTTP/1.1" 201 0
2025-12-05 06:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcc3e6484-89c5-4cf3-8c5b-e3cab47166a1_5.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cc3e6484-89c5-4cf3-8c5b-e3cab47166a1_5.jpg saved to cache
2025-12-05 06:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4fc77dba-953c-5b07-8795-c10f561b4b1f
2025-12-05 06:07:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425792d0>
2025-12-05 06:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:07:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fc77dba-953c-5b07-8795-c10f561b4b1f/4fc77dba-953c-5b07-8795-c10f561b4b1f_image_2.jpg HTTP/1.1" 201 0
2025-12-05 06:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcc3e6484-89c5-4cf3-8c5b-e3cab47166a1_ext_6.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cc3e6484-89c5-4cf3-8c5b-e3cab47166a1_ext_6.jpg saved to cache
2025-12-05 06:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4fc77dba-953c-5b07-8795-c10f561b4b1f
2025-12-05 06:07:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342365a10>
2025-12-05 06:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:07:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fc77dba-953c-5b07-8795-c10f561b4b1f/4fc77dba-953c-5b07-8795-c10f561b4b1f_image_5.jpg HTTP/1.1" 201 0
2025-12-05 06:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcc3e6484-89c5-4cf3-8c5b-e3cab47166a1_4.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cc3e6484-89c5-4cf3-8c5b-e3cab47166a1_4.jpg saved to cache
2025-12-05 06:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4fc77dba-953c-5b07-8795-c10f561b4b1f
2025-12-05 06:07:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234245fbd0>
2025-12-05 06:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:07:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fc77dba-953c-5b07-8795-c10f561b4b1f/4fc77dba-953c-5b07-8795-c10f561b4b1f_image_1.jpg HTTP/1.1" 201 0
2025-12-05 06:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcc3e6484-89c5-4cf3-8c5b-e3cab47166a1_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cc3e6484-89c5-4cf3-8c5b-e3cab47166a1_ext_7.jpg saved to cache
2025-12-05 06:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4fc77dba-953c-5b07-8795-c10f561b4b1f
2025-12-05 06:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3607988-3539050-1012.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003607988-1001408974-002.pdf)
2025-12-05 06:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3476246-4008440-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003476246-01990375-002.pdf)
2025-12-05 06:07:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341f12ed0>
2025-12-05 06:07:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:07:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fc77dba-953c-5b07-8795-c10f561b4b1f/4fc77dba-953c-5b07-8795-c10f561b4b1f_image_0.jpg HTTP/1.1" 201 0
2025-12-05 06:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fcc3e6484-89c5-4cf3-8c5b-e3cab47166a1_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/cc3e6484-89c5-4cf3-8c5b-e3cab47166a1_ext_7.jpg saved to cache
2025-12-05 06:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4fc77dba-953c-5b07-8795-c10f561b4b1f
2025-12-05 06:07:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4fc77dba-953c-5b07-8795-c10f561b4b1f, skipping ID generation
2025-12-05 06:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 4fc77dba-953c-5b07-8795-c10f561b4b1f from tracking dictionaries
2025-12-05 06:07:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4fc77dba-953c-5b07-8795-c10f561b4b1f sending to next pipeline
2025-12-05 06:07:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 4fc77dba-953c-5b07-8795-c10f561b4b1f, identifier: 3690345
2025-12-05 06:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/97b1c90a-3b4a-4581-82cd-cee29e54da7b_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003476246-01990375-002.pdf)
2025-12-05 06:07:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 4fc77dba-953c-5b07-8795-c10f561b4b1f with identifier: 3690345
2025-12-05 06:07:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 06:07:03 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Ink+Blue HTTP/1.1" 200 None
2025-12-05 06:07:03 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 06:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 06:07:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 4fc77dba-953c-5b07-8795-c10f561b4b1f with identifier: 3690345
2025-12-05 06:07:04 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 10 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    10
2025-12-05 06:07:04 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: 4fc77dba-953c-5b07-8795-c10f561b4b1f spider: manheim.gb
2025-12-05 06:07:04 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 4fc77dba-953c-5b07-8795-c10f561b4b1f due to rule: registration_date_old.json, error: 10 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    10
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fc77dba-953c-5b07-8795-c10f561b4b1f/4fc77dba-953c-5b07-8795-c10f561b4b1f_expert_report_file_aead696d-b557-44ea-94dc-f2c222b5d81b.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003690345-01947401-004.pdf',
 'color': 'Ink Blue',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '4fc77dba-953c-5b07-8795-c10f561b4b1f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'KM65GJY',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/DS/DS%205?id=3690345',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'DS',
 'model': 'DS 5',
 'odometer': 92196,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 75,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fc77dba-953c-5b07-8795-c10f561b4b1f/4fc77dba-953c-5b07-8795-c10f561b4b1f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 209211,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cc3e6484-89c5-4cf3-8c5b-e3cab47166a1_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fc77dba-953c-5b07-8795-c10f561b4b1f/4fc77dba-953c-5b07-8795-c10f561b4b1f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 209211,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cc3e6484-89c5-4cf3-8c5b-e3cab47166a1_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fc77dba-953c-5b07-8795-c10f561b4b1f/4fc77dba-953c-5b07-8795-c10f561b4b1f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 236599,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cc3e6484-89c5-4cf3-8c5b-e3cab47166a1_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fc77dba-953c-5b07-8795-c10f561b4b1f/4fc77dba-953c-5b07-8795-c10f561b4b1f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 222550,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cc3e6484-89c5-4cf3-8c5b-e3cab47166a1_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fc77dba-953c-5b07-8795-c10f561b4b1f/4fc77dba-953c-5b07-8795-c10f561b4b1f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 201751,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cc3e6484-89c5-4cf3-8c5b-e3cab47166a1_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fc77dba-953c-5b07-8795-c10f561b4b1f/4fc77dba-953c-5b07-8795-c10f561b4b1f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 201668,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cc3e6484-89c5-4cf3-8c5b-e3cab47166a1_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fc77dba-953c-5b07-8795-c10f561b4b1f/4fc77dba-953c-5b07-8795-c10f561b4b1f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 211643,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cc3e6484-89c5-4cf3-8c5b-e3cab47166a1_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fc77dba-953c-5b07-8795-c10f561b4b1f/4fc77dba-953c-5b07-8795-c10f561b4b1f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 183009,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cc3e6484-89c5-4cf3-8c5b-e3cab47166a1_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fc77dba-953c-5b07-8795-c10f561b4b1f/4fc77dba-953c-5b07-8795-c10f561b4b1f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 180806,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cc3e6484-89c5-4cf3-8c5b-e3cab47166a1_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fc77dba-953c-5b07-8795-c10f561b4b1f/4fc77dba-953c-5b07-8795-c10f561b4b1f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 285203,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cc3e6484-89c5-4cf3-8c5b-e3cab47166a1_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fc77dba-953c-5b07-8795-c10f561b4b1f/4fc77dba-953c-5b07-8795-c10f561b4b1f_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 231448,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cc3e6484-89c5-4cf3-8c5b-e3cab47166a1_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fc77dba-953c-5b07-8795-c10f561b4b1f/4fc77dba-953c-5b07-8795-c10f561b4b1f_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 238034,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cc3e6484-89c5-4cf3-8c5b-e3cab47166a1_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fc77dba-953c-5b07-8795-c10f561b4b1f/4fc77dba-953c-5b07-8795-c10f561b4b1f_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 295562,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/cc3e6484-89c5-4cf3-8c5b-e3cab47166a1_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fc77dba-953c-5b07-8795-c10f561b4b1f/4fc77dba-953c-5b07-8795-c10f561b4b1f_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 324030,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3690345-3997372-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fc77dba-953c-5b07-8795-c10f561b4b1f/4fc77dba-953c-5b07-8795-c10f561b4b1f_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 273434,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3690345-3997372-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fc77dba-953c-5b07-8795-c10f561b4b1f/4fc77dba-953c-5b07-8795-c10f561b4b1f_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 431437,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3690345-3997372-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fc77dba-953c-5b07-8795-c10f561b4b1f/4fc77dba-953c-5b07-8795-c10f561b4b1f_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 433390,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3690345-3997372-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fc77dba-953c-5b07-8795-c10f561b4b1f/4fc77dba-953c-5b07-8795-c10f561b4b1f_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 284167,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3690345-3997372-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fc77dba-953c-5b07-8795-c10f561b4b1f/4fc77dba-953c-5b07-8795-c10f561b4b1f_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329107,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3690345-3997372-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fc77dba-953c-5b07-8795-c10f561b4b1f/4fc77dba-953c-5b07-8795-c10f561b4b1f_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 418035,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3690345-3997372-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-30',
 'seller_name': 'DS UK Ltd',
 'title': 'DS DS 5 2.0 BlueHDi 180 Prestige 5dr EAT6',
 'transmission': 'automatic',
 'trim': '2.0 BlueHDi 180 Prestige 5dr EAT6',
 'year': 2015}
2025-12-05 06:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273690345%27 HTTP/1.1" 200 None
2025-12-05 06:07:04 [manheim.gb] INFO: Saving data for 3690345: {'created_time': 1764914824.19188, 'last_price_update_time': 1764914824.191894, 'auction_closing_time': 1765184400.0}
2025-12-05 06:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3690345') HTTP/1.1" 204 0
2025-12-05 06:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3607988-3539050-1009.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003607988-1001408974-002.pdf)
2025-12-05 06:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3476246-4008440-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003476246-01990375-002.pdf)
2025-12-05 06:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3607988-3539050-1010.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003607988-1001408974-002.pdf)
2025-12-05 06:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3607988-3539050-1011.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003607988-1001408974-002.pdf)
2025-12-05 06:07:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23415a0050>
2025-12-05 06:07:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:07:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4cdbfc7-068e-50aa-aa3a-1e77cf962189/f4cdbfc7-068e-50aa-aa3a-1e77cf962189_image_16.jpg HTTP/1.1" 201 0
2025-12-05 06:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3607988-3539050-1012.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3607988-3539050-1012.jpg saved to cache
2025-12-05 06:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item f4cdbfc7-068e-50aa-aa3a-1e77cf962189
2025-12-05 06:07:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342774a90>
2025-12-05 06:07:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:07:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3312266e-82b8-5f1b-81b7-8009f7cac9eb/3312266e-82b8-5f1b-81b7-8009f7cac9eb_image_14.jpg HTTP/1.1" 201 0
2025-12-05 06:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3476246-4008440-1000.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3476246-4008440-1000.jpg saved to cache
2025-12-05 06:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 3312266e-82b8-5f1b-81b7-8009f7cac9eb
2025-12-05 06:07:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23415a2890>
2025-12-05 06:07:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:07:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3312266e-82b8-5f1b-81b7-8009f7cac9eb/3312266e-82b8-5f1b-81b7-8009f7cac9eb_image_12.jpg HTTP/1.1" 201 0
2025-12-05 06:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F97b1c90a-3b4a-4581-82cd-cee29e54da7b_ext_4.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/97b1c90a-3b4a-4581-82cd-cee29e54da7b_ext_4.jpg saved to cache
2025-12-05 06:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 3312266e-82b8-5f1b-81b7-8009f7cac9eb
2025-12-05 06:07:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/97b1c90a-3b4a-4581-82cd-cee29e54da7b_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003476246-01990375-002.pdf)
2025-12-05 06:07:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/97b1c90a-3b4a-4581-82cd-cee29e54da7b_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003476246-01990375-002.pdf)
2025-12-05 06:07:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3607988-3539050-1008.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003607988-1001408974-002.pdf)
2025-12-05 06:07:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341f30fd0>
2025-12-05 06:07:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:07:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4cdbfc7-068e-50aa-aa3a-1e77cf962189/f4cdbfc7-068e-50aa-aa3a-1e77cf962189_image_13.jpg HTTP/1.1" 201 0
2025-12-05 06:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3607988-3539050-1009.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3607988-3539050-1009.jpg saved to cache
2025-12-05 06:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item f4cdbfc7-068e-50aa-aa3a-1e77cf962189
2025-12-05 06:07:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341eb3410>
2025-12-05 06:07:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:07:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3312266e-82b8-5f1b-81b7-8009f7cac9eb/3312266e-82b8-5f1b-81b7-8009f7cac9eb_image_13.jpg HTTP/1.1" 201 0
2025-12-05 06:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3476246-4008440-13.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3476246-4008440-13.jpg saved to cache
2025-12-05 06:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 3312266e-82b8-5f1b-81b7-8009f7cac9eb
2025-12-05 06:07:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341eb1410>
2025-12-05 06:07:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 06:07:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4cdbfc7-068e-50aa-aa3a-1e77cf962189/f4cdbfc7-068e-50aa-aa3a-1e77cf962189_image_14.jpg HTTP/1.1" 201 0
2025-12-05 06:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3607988-3539050-1010.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3607988-3539050-1010.jpg saved to cache
2025-12-05 06:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item f4cdbfc7-068e-50aa-aa3a-1e77cf962189
2025-12-05 06:07:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23424e4150>
2025-12-05 06:07:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:07:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4cdbfc7-068e-50aa-aa3a-1e77cf962189/f4cdbfc7-068e-50aa-aa3a-1e77cf962189_image_15.jpg HTTP/1.1" 201 0
2025-12-05 06:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3607988-3539050-1011.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3607988-3539050-1011.jpg saved to cache
2025-12-05 06:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item f4cdbfc7-068e-50aa-aa3a-1e77cf962189
2025-12-05 06:07:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/97b1c90a-3b4a-4581-82cd-cee29e54da7b_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003476246-01990375-002.pdf)
2025-12-05 06:07:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/97b1c90a-3b4a-4581-82cd-cee29e54da7b_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003476246-01990375-002.pdf)
2025-12-05 06:07:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342643190>
2025-12-05 06:07:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:07:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3312266e-82b8-5f1b-81b7-8009f7cac9eb/3312266e-82b8-5f1b-81b7-8009f7cac9eb_image_11.jpg HTTP/1.1" 201 0
2025-12-05 06:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F97b1c90a-3b4a-4581-82cd-cee29e54da7b_ext_3.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/97b1c90a-3b4a-4581-82cd-cee29e54da7b_ext_3.jpg saved to cache
2025-12-05 06:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 3312266e-82b8-5f1b-81b7-8009f7cac9eb
2025-12-05 06:07:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234285e490>
2025-12-05 06:07:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:07:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3312266e-82b8-5f1b-81b7-8009f7cac9eb/3312266e-82b8-5f1b-81b7-8009f7cac9eb_image_10.jpg HTTP/1.1" 201 0
2025-12-05 06:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F97b1c90a-3b4a-4581-82cd-cee29e54da7b_ext_5.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/97b1c90a-3b4a-4581-82cd-cee29e54da7b_ext_5.jpg saved to cache
2025-12-05 06:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 3312266e-82b8-5f1b-81b7-8009f7cac9eb
2025-12-05 06:07:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23424e8b10>
2025-12-05 06:07:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:07:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4cdbfc7-068e-50aa-aa3a-1e77cf962189/f4cdbfc7-068e-50aa-aa3a-1e77cf962189_image_12.jpg HTTP/1.1" 201 0
2025-12-05 06:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3607988-3539050-1008.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3607988-3539050-1008.jpg saved to cache
2025-12-05 06:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item f4cdbfc7-068e-50aa-aa3a-1e77cf962189
2025-12-05 06:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3607988-3539050-1006.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003607988-1001408974-002.pdf)
2025-12-05 06:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/97b1c90a-3b4a-4581-82cd-cee29e54da7b_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003476246-01990375-002.pdf)
2025-12-05 06:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3607988-3539050-1007.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003607988-1001408974-002.pdf)
2025-12-05 06:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3607988-3539050-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003607988-1001408974-002.pdf)
2025-12-05 06:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3607988-3539050-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003607988-1001408974-002.pdf)
2025-12-05 06:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/97b1c90a-3b4a-4581-82cd-cee29e54da7b_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003476246-01990375-002.pdf)
2025-12-05 06:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/97b1c90a-3b4a-4581-82cd-cee29e54da7b_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003476246-01990375-002.pdf)
2025-12-05 06:07:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23424cd610>
2025-12-05 06:07:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:07:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3312266e-82b8-5f1b-81b7-8009f7cac9eb/3312266e-82b8-5f1b-81b7-8009f7cac9eb_image_8.jpg HTTP/1.1" 201 0
2025-12-05 06:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F97b1c90a-3b4a-4581-82cd-cee29e54da7b_9.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/97b1c90a-3b4a-4581-82cd-cee29e54da7b_9.jpg saved to cache
2025-12-05 06:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3312266e-82b8-5f1b-81b7-8009f7cac9eb
2025-12-05 06:07:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234264fb10>
2025-12-05 06:07:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:07:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3312266e-82b8-5f1b-81b7-8009f7cac9eb/3312266e-82b8-5f1b-81b7-8009f7cac9eb_image_9.jpg HTTP/1.1" 201 0
2025-12-05 06:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F97b1c90a-3b4a-4581-82cd-cee29e54da7b_ext_2.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/97b1c90a-3b4a-4581-82cd-cee29e54da7b_ext_2.jpg saved to cache
2025-12-05 06:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3312266e-82b8-5f1b-81b7-8009f7cac9eb
2025-12-05 06:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3607988-3539050-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003607988-1001408974-002.pdf)
2025-12-05 06:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/97b1c90a-3b4a-4581-82cd-cee29e54da7b_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003476246-01990375-002.pdf)
2025-12-05 06:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/97b1c90a-3b4a-4581-82cd-cee29e54da7b_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003476246-01990375-002.pdf)
2025-12-05 06:07:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23426eaa10>
2025-12-05 06:07:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:07:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4cdbfc7-068e-50aa-aa3a-1e77cf962189/f4cdbfc7-068e-50aa-aa3a-1e77cf962189_image_10.jpg HTTP/1.1" 201 0
2025-12-05 06:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3607988-3539050-1006.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3607988-3539050-1006.jpg saved to cache
2025-12-05 06:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item f4cdbfc7-068e-50aa-aa3a-1e77cf962189
2025-12-05 06:07:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342841450>
2025-12-05 06:07:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:07:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3312266e-82b8-5f1b-81b7-8009f7cac9eb/3312266e-82b8-5f1b-81b7-8009f7cac9eb_image_7.jpg HTTP/1.1" 201 0
2025-12-05 06:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F97b1c90a-3b4a-4581-82cd-cee29e54da7b_10.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/97b1c90a-3b4a-4581-82cd-cee29e54da7b_10.jpg saved to cache
2025-12-05 06:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3312266e-82b8-5f1b-81b7-8009f7cac9eb
2025-12-05 06:07:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23423aa250>
2025-12-05 06:07:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:07:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4cdbfc7-068e-50aa-aa3a-1e77cf962189/f4cdbfc7-068e-50aa-aa3a-1e77cf962189_image_11.jpg HTTP/1.1" 201 0
2025-12-05 06:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3607988-3539050-1007.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3607988-3539050-1007.jpg saved to cache
2025-12-05 06:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item f4cdbfc7-068e-50aa-aa3a-1e77cf962189
2025-12-05 06:07:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341ee69d0>
2025-12-05 06:07:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:07:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4cdbfc7-068e-50aa-aa3a-1e77cf962189/f4cdbfc7-068e-50aa-aa3a-1e77cf962189_image_8.jpg HTTP/1.1" 201 0
2025-12-05 06:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3607988-3539050-1004.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3607988-3539050-1004.jpg saved to cache
2025-12-05 06:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f4cdbfc7-068e-50aa-aa3a-1e77cf962189
2025-12-05 06:07:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2343c39890>
2025-12-05 06:07:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:07:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4cdbfc7-068e-50aa-aa3a-1e77cf962189/f4cdbfc7-068e-50aa-aa3a-1e77cf962189_image_9.jpg HTTP/1.1" 201 0
2025-12-05 06:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3607988-3539050-1005.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3607988-3539050-1005.jpg saved to cache
2025-12-05 06:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f4cdbfc7-068e-50aa-aa3a-1e77cf962189
2025-12-05 06:07:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2343b97710>
2025-12-05 06:07:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 06:07:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3312266e-82b8-5f1b-81b7-8009f7cac9eb/3312266e-82b8-5f1b-81b7-8009f7cac9eb_image_6.jpg HTTP/1.1" 201 0
2025-12-05 06:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F97b1c90a-3b4a-4581-82cd-cee29e54da7b_11.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/97b1c90a-3b4a-4581-82cd-cee29e54da7b_11.jpg saved to cache
2025-12-05 06:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3312266e-82b8-5f1b-81b7-8009f7cac9eb
2025-12-05 06:07:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342626fd0>
2025-12-05 06:07:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 06:07:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3312266e-82b8-5f1b-81b7-8009f7cac9eb/3312266e-82b8-5f1b-81b7-8009f7cac9eb_image_5.jpg HTTP/1.1" 201 0
2025-12-05 06:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F97b1c90a-3b4a-4581-82cd-cee29e54da7b_4.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/97b1c90a-3b4a-4581-82cd-cee29e54da7b_4.jpg saved to cache
2025-12-05 06:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3312266e-82b8-5f1b-81b7-8009f7cac9eb
2025-12-05 06:07:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3607988-3539050-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003607988-1001408974-002.pdf)
2025-12-05 06:07:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/97b1c90a-3b4a-4581-82cd-cee29e54da7b_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003476246-01990375-002.pdf)
2025-12-05 06:07:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23424c54d0>
2025-12-05 06:07:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 06:07:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4cdbfc7-068e-50aa-aa3a-1e77cf962189/f4cdbfc7-068e-50aa-aa3a-1e77cf962189_image_7.jpg HTTP/1.1" 201 0
2025-12-05 06:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3607988-3539050-1003.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3607988-3539050-1003.jpg saved to cache
2025-12-05 06:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f4cdbfc7-068e-50aa-aa3a-1e77cf962189
2025-12-05 06:07:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341edd510>
2025-12-05 06:07:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:07:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3312266e-82b8-5f1b-81b7-8009f7cac9eb/3312266e-82b8-5f1b-81b7-8009f7cac9eb_image_3.jpg HTTP/1.1" 201 0
2025-12-05 06:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F97b1c90a-3b4a-4581-82cd-cee29e54da7b_ext_1.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/97b1c90a-3b4a-4581-82cd-cee29e54da7b_ext_1.jpg saved to cache
2025-12-05 06:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3312266e-82b8-5f1b-81b7-8009f7cac9eb
2025-12-05 06:07:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234292b310>
2025-12-05 06:07:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:07:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3312266e-82b8-5f1b-81b7-8009f7cac9eb/3312266e-82b8-5f1b-81b7-8009f7cac9eb_image_4.jpg HTTP/1.1" 201 0
2025-12-05 06:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F97b1c90a-3b4a-4581-82cd-cee29e54da7b_5.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/97b1c90a-3b4a-4581-82cd-cee29e54da7b_5.jpg saved to cache
2025-12-05 06:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3312266e-82b8-5f1b-81b7-8009f7cac9eb
2025-12-05 06:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3607988-3539050-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003607988-1001408974-002.pdf)
2025-12-05 06:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3607988-3539050-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003607988-1001408974-002.pdf)
2025-12-05 06:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/97b1c90a-3b4a-4581-82cd-cee29e54da7b_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003476246-01990375-002.pdf)
2025-12-05 06:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3607988-3539050-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003607988-1001408974-002.pdf)
2025-12-05 06:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/POLO?id=3424031&returnUrl=%2Fsearch%3FPage%3D3%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233424031&indx=213> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/CITROEN/C3?id=3377309&returnUrl=%2Fsearch%3FPage%3D3%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233377309&indx=208> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/97b1c90a-3b4a-4581-82cd-cee29e54da7b_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003476246-01990375-002.pdf)
2025-12-05 06:07:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23426ab0d0>
2025-12-05 06:07:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:07:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4cdbfc7-068e-50aa-aa3a-1e77cf962189/f4cdbfc7-068e-50aa-aa3a-1e77cf962189_image_6.jpg HTTP/1.1" 201 0
2025-12-05 06:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3607988-3539050-1002.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3607988-3539050-1002.jpg saved to cache
2025-12-05 06:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f4cdbfc7-068e-50aa-aa3a-1e77cf962189
2025-12-05 06:07:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23424c5490>
2025-12-05 06:07:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:07:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3312266e-82b8-5f1b-81b7-8009f7cac9eb/3312266e-82b8-5f1b-81b7-8009f7cac9eb_image_1.jpg HTTP/1.1" 201 0
2025-12-05 06:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F97b1c90a-3b4a-4581-82cd-cee29e54da7b_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/97b1c90a-3b4a-4581-82cd-cee29e54da7b_ext_7.jpg saved to cache
2025-12-05 06:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3312266e-82b8-5f1b-81b7-8009f7cac9eb
2025-12-05 06:07:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3607988-3539050-3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003607988-1001408974-002.pdf)
2025-12-05 06:07:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/35d32ec0-02df-42bd-bed7-0390cc81834b_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002445301-01989097-003.pdf)
2025-12-05 06:07:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342606a50>
2025-12-05 06:07:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:07:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4cdbfc7-068e-50aa-aa3a-1e77cf962189/f4cdbfc7-068e-50aa-aa3a-1e77cf962189_image_4.jpg HTTP/1.1" 201 0
2025-12-05 06:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3607988-3539050-1000.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3607988-3539050-1000.jpg saved to cache
2025-12-05 06:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f4cdbfc7-068e-50aa-aa3a-1e77cf962189
2025-12-05 06:07:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425453d0>
2025-12-05 06:07:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:07:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4cdbfc7-068e-50aa-aa3a-1e77cf962189/f4cdbfc7-068e-50aa-aa3a-1e77cf962189_image_5.jpg HTTP/1.1" 201 0
2025-12-05 06:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3607988-3539050-1001.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3607988-3539050-1001.jpg saved to cache
2025-12-05 06:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f4cdbfc7-068e-50aa-aa3a-1e77cf962189
2025-12-05 06:07:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23427766d0>
2025-12-05 06:07:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:07:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3312266e-82b8-5f1b-81b7-8009f7cac9eb/3312266e-82b8-5f1b-81b7-8009f7cac9eb_image_2.jpg HTTP/1.1" 201 0
2025-12-05 06:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F97b1c90a-3b4a-4581-82cd-cee29e54da7b_ext_6.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/97b1c90a-3b4a-4581-82cd-cee29e54da7b_ext_6.jpg saved to cache
2025-12-05 06:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3312266e-82b8-5f1b-81b7-8009f7cac9eb
2025-12-05 06:07:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23426eaa10>
2025-12-05 06:07:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:07:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4cdbfc7-068e-50aa-aa3a-1e77cf962189/f4cdbfc7-068e-50aa-aa3a-1e77cf962189_image_3.jpg HTTP/1.1" 201 0
2025-12-05 06:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3607988-3539050-13.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3607988-3539050-13.jpg saved to cache
2025-12-05 06:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f4cdbfc7-068e-50aa-aa3a-1e77cf962189
2025-12-05 06:07:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4251c640-8d8e-552a-945a-6761cae842fc with identifier: 3424031
2025-12-05 06:07:13 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 4251c640-8d8e-552a-945a-6761cae842fc
2025-12-05 06:07:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b770092a-1ce0-5014-9f26-6a1cc683c601 with identifier: 3377309
2025-12-05 06:07:13 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item b770092a-1ce0-5014-9f26-6a1cc683c601
2025-12-05 06:07:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342561310>
2025-12-05 06:07:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:07:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3312266e-82b8-5f1b-81b7-8009f7cac9eb/3312266e-82b8-5f1b-81b7-8009f7cac9eb_image_0.jpg HTTP/1.1" 201 0
2025-12-05 06:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F97b1c90a-3b4a-4581-82cd-cee29e54da7b_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/97b1c90a-3b4a-4581-82cd-cee29e54da7b_ext_7.jpg saved to cache
2025-12-05 06:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3312266e-82b8-5f1b-81b7-8009f7cac9eb
2025-12-05 06:07:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3312266e-82b8-5f1b-81b7-8009f7cac9eb, skipping ID generation
2025-12-05 06:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 3312266e-82b8-5f1b-81b7-8009f7cac9eb from tracking dictionaries
2025-12-05 06:07:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3312266e-82b8-5f1b-81b7-8009f7cac9eb sending to next pipeline
2025-12-05 06:07:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 3312266e-82b8-5f1b-81b7-8009f7cac9eb, identifier: 3476246
2025-12-05 06:07:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/35d32ec0-02df-42bd-bed7-0390cc81834b_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002445301-01989097-003.pdf)
2025-12-05 06:07:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/35d32ec0-02df-42bd-bed7-0390cc81834b_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002445301-01989097-003.pdf)
2025-12-05 06:07:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3517150-9999999-338124313-012.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003517150-01993640-003.pdf)
2025-12-05 06:07:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/35d32ec0-02df-42bd-bed7-0390cc81834b_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002445301-01989097-003.pdf)
2025-12-05 06:07:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 3312266e-82b8-5f1b-81b7-8009f7cac9eb with identifier: 3476246
2025-12-05 06:07:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 3312266e-82b8-5f1b-81b7-8009f7cac9eb with identifier: 3476246
2025-12-05 06:07:14 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 3312266e-82b8-5f1b-81b7-8009f7cac9eb with identifier: 3476246 to the API
2025-12-05 06:07:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 06:07:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 06:07:14 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/97b1c90a-3b4a-4581-82cd-cee29e54da7b_ext_7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3312266e-82b8-5f1b-81b7-8009f7cac9eb/3312266e-82b8-5f1b-81b7-8009f7cac9eb_expert_report_file_6a0662b4-1e99-41b8-ba62-9c8c7d3be5ce.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003476246-01990375-002.pdf',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.5L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '3312266e-82b8-5f1b-81b7-8009f7cac9eb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'RO20LBK',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/GOLF?id=3476246',
 'listing': 'auction',
 'location': 'Northampton',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF',
 'odometer': 31366,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 26,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3312266e-82b8-5f1b-81b7-8009f7cac9eb/3312266e-82b8-5f1b-81b7-8009f7cac9eb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 221936,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/97b1c90a-3b4a-4581-82cd-cee29e54da7b_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3312266e-82b8-5f1b-81b7-8009f7cac9eb/3312266e-82b8-5f1b-81b7-8009f7cac9eb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 221936,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/97b1c90a-3b4a-4581-82cd-cee29e54da7b_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3312266e-82b8-5f1b-81b7-8009f7cac9eb/3312266e-82b8-5f1b-81b7-8009f7cac9eb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 270618,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/97b1c90a-3b4a-4581-82cd-cee29e54da7b_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3312266e-82b8-5f1b-81b7-8009f7cac9eb/3312266e-82b8-5f1b-81b7-8009f7cac9eb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 207011,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/97b1c90a-3b4a-4581-82cd-cee29e54da7b_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3312266e-82b8-5f1b-81b7-8009f7cac9eb/3312266e-82b8-5f1b-81b7-8009f7cac9eb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 218120,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/97b1c90a-3b4a-4581-82cd-cee29e54da7b_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3312266e-82b8-5f1b-81b7-8009f7cac9eb/3312266e-82b8-5f1b-81b7-8009f7cac9eb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 207769,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/97b1c90a-3b4a-4581-82cd-cee29e54da7b_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3312266e-82b8-5f1b-81b7-8009f7cac9eb/3312266e-82b8-5f1b-81b7-8009f7cac9eb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 212662,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/97b1c90a-3b4a-4581-82cd-cee29e54da7b_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3312266e-82b8-5f1b-81b7-8009f7cac9eb/3312266e-82b8-5f1b-81b7-8009f7cac9eb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 215679,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/97b1c90a-3b4a-4581-82cd-cee29e54da7b_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3312266e-82b8-5f1b-81b7-8009f7cac9eb/3312266e-82b8-5f1b-81b7-8009f7cac9eb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 219790,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/97b1c90a-3b4a-4581-82cd-cee29e54da7b_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3312266e-82b8-5f1b-81b7-8009f7cac9eb/3312266e-82b8-5f1b-81b7-8009f7cac9eb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 307821,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/97b1c90a-3b4a-4581-82cd-cee29e54da7b_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3312266e-82b8-5f1b-81b7-8009f7cac9eb/3312266e-82b8-5f1b-81b7-8009f7cac9eb_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 251900,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/97b1c90a-3b4a-4581-82cd-cee29e54da7b_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3312266e-82b8-5f1b-81b7-8009f7cac9eb/3312266e-82b8-5f1b-81b7-8009f7cac9eb_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 262602,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/97b1c90a-3b4a-4581-82cd-cee29e54da7b_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3312266e-82b8-5f1b-81b7-8009f7cac9eb/3312266e-82b8-5f1b-81b7-8009f7cac9eb_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 281936,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/97b1c90a-3b4a-4581-82cd-cee29e54da7b_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3312266e-82b8-5f1b-81b7-8009f7cac9eb/3312266e-82b8-5f1b-81b7-8009f7cac9eb_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 349657,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3476246-4008440-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3312266e-82b8-5f1b-81b7-8009f7cac9eb/3312266e-82b8-5f1b-81b7-8009f7cac9eb_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 238485,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3476246-4008440-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3312266e-82b8-5f1b-81b7-8009f7cac9eb/3312266e-82b8-5f1b-81b7-8009f7cac9eb_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257117,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3476246-4008440-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3312266e-82b8-5f1b-81b7-8009f7cac9eb/3312266e-82b8-5f1b-81b7-8009f7cac9eb_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 331701,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3476246-4008440-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3312266e-82b8-5f1b-81b7-8009f7cac9eb/3312266e-82b8-5f1b-81b7-8009f7cac9eb_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 353948,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3476246-4008440-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3312266e-82b8-5f1b-81b7-8009f7cac9eb/3312266e-82b8-5f1b-81b7-8009f7cac9eb_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 217337,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3476246-4008440-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3312266e-82b8-5f1b-81b7-8009f7cac9eb/3312266e-82b8-5f1b-81b7-8009f7cac9eb_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 272957,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3476246-4008440-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-19',
 'seller_name': 'Sytner',
 'title': 'VOLKSWAGEN GOLF 1.5 TSI EVO 150 Match Edition 5dr DSG',
 'transmission': 'automatic',
 'trim': '1.5 TSI EVO 150 Match Edition 5dr DSG',
 'year': 2020}
2025-12-05 06:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273476246%27 HTTP/1.1" 200 None
2025-12-05 06:07:14 [manheim.gb] INFO: Saving data for 3476246: {'created_time': 1764914834.835647, 'last_price_update_time': 1764914834.835662, 'auction_closing_time': 1765270800.0}
2025-12-05 06:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3476246') HTTP/1.1" 204 0
2025-12-05 06:07:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3517150-4008226-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003517150-01993640-003.pdf)
2025-12-05 06:07:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342376850>
2025-12-05 06:07:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:07:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4cdbfc7-068e-50aa-aa3a-1e77cf962189/f4cdbfc7-068e-50aa-aa3a-1e77cf962189_image_2.jpg HTTP/1.1" 201 0
2025-12-05 06:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3607988-3539050-3.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3607988-3539050-3.jpg saved to cache
2025-12-05 06:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f4cdbfc7-068e-50aa-aa3a-1e77cf962189
2025-12-05 06:07:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f4cdbfc7-068e-50aa-aa3a-1e77cf962189, skipping ID generation
2025-12-05 06:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Removing item f4cdbfc7-068e-50aa-aa3a-1e77cf962189 from tracking dictionaries
2025-12-05 06:07:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f4cdbfc7-068e-50aa-aa3a-1e77cf962189 sending to next pipeline
2025-12-05 06:07:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: f4cdbfc7-068e-50aa-aa3a-1e77cf962189, identifier: 3607988
2025-12-05 06:07:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425a3450>
2025-12-05 06:07:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 06:07:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c00db30e-97d1-5780-baf0-2570c7931598/c00db30e-97d1-5780-baf0-2570c7931598_image_3.jpg HTTP/1.1" 201 0
2025-12-05 06:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F35d32ec0-02df-42bd-bed7-0390cc81834b_ext_1.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/35d32ec0-02df-42bd-bed7-0390cc81834b_ext_1.jpg saved to cache
2025-12-05 06:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c00db30e-97d1-5780-baf0-2570c7931598
2025-12-05 06:07:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: f4cdbfc7-068e-50aa-aa3a-1e77cf962189 with identifier: 3607988
2025-12-05 06:07:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: f4cdbfc7-068e-50aa-aa3a-1e77cf962189 with identifier: 3607988
2025-12-05 06:07:15 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 10 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    10
2025-12-05 06:07:15 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: f4cdbfc7-068e-50aa-aa3a-1e77cf962189 spider: manheim.gb
2025-12-05 06:07:15 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: f4cdbfc7-068e-50aa-aa3a-1e77cf962189 due to rule: registration_date_old.json, error: 10 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    10
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4cdbfc7-068e-50aa-aa3a-1e77cf962189/f4cdbfc7-068e-50aa-aa3a-1e77cf962189_expert_report_file_73304879-7996-408a-94fa-84b99b6556e0.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003607988-1001408974-002.pdf',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'f4cdbfc7-068e-50aa-aa3a-1e77cf962189',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'YR65NUX',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/LAND%20ROVER/RANGE%20ROVER%20EVOQUE?id=3607988',
 'listing': 'auction',
 'location': 'Bristol',
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER EVOQUE',
 'odometer': 999,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 25,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4622c3ba-5515-5758-814e-2f49e4247fa1/4622c3ba-5515-5758-814e-2f49e4247fa1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72484,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/awaiting-image-002.jpg',
             'Width': 1322},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4622c3ba-5515-5758-814e-2f49e4247fa1/4622c3ba-5515-5758-814e-2f49e4247fa1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72484,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/awaiting-image-002.jpg',
             'Width': 1322},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4cdbfc7-068e-50aa-aa3a-1e77cf962189/f4cdbfc7-068e-50aa-aa3a-1e77cf962189_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 372083,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3607988-3539050-3.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4cdbfc7-068e-50aa-aa3a-1e77cf962189/f4cdbfc7-068e-50aa-aa3a-1e77cf962189_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 440240,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3607988-3539050-13.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4cdbfc7-068e-50aa-aa3a-1e77cf962189/f4cdbfc7-068e-50aa-aa3a-1e77cf962189_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 361937,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3607988-3539050-1000.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4cdbfc7-068e-50aa-aa3a-1e77cf962189/f4cdbfc7-068e-50aa-aa3a-1e77cf962189_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 424550,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3607988-3539050-1001.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4cdbfc7-068e-50aa-aa3a-1e77cf962189/f4cdbfc7-068e-50aa-aa3a-1e77cf962189_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 560992,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3607988-3539050-1002.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4cdbfc7-068e-50aa-aa3a-1e77cf962189/f4cdbfc7-068e-50aa-aa3a-1e77cf962189_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 388519,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3607988-3539050-1003.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4cdbfc7-068e-50aa-aa3a-1e77cf962189/f4cdbfc7-068e-50aa-aa3a-1e77cf962189_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 378405,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3607988-3539050-1004.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4cdbfc7-068e-50aa-aa3a-1e77cf962189/f4cdbfc7-068e-50aa-aa3a-1e77cf962189_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 410262,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3607988-3539050-1005.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4cdbfc7-068e-50aa-aa3a-1e77cf962189/f4cdbfc7-068e-50aa-aa3a-1e77cf962189_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 424830,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3607988-3539050-1006.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4cdbfc7-068e-50aa-aa3a-1e77cf962189/f4cdbfc7-068e-50aa-aa3a-1e77cf962189_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 542473,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3607988-3539050-1007.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4cdbfc7-068e-50aa-aa3a-1e77cf962189/f4cdbfc7-068e-50aa-aa3a-1e77cf962189_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 370581,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3607988-3539050-1008.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4cdbfc7-068e-50aa-aa3a-1e77cf962189/f4cdbfc7-068e-50aa-aa3a-1e77cf962189_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 339188,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3607988-3539050-1009.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4cdbfc7-068e-50aa-aa3a-1e77cf962189/f4cdbfc7-068e-50aa-aa3a-1e77cf962189_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 457807,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3607988-3539050-1010.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4cdbfc7-068e-50aa-aa3a-1e77cf962189/f4cdbfc7-068e-50aa-aa3a-1e77cf962189_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 506942,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3607988-3539050-1011.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4cdbfc7-068e-50aa-aa3a-1e77cf962189/f4cdbfc7-068e-50aa-aa3a-1e77cf962189_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 330834,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3607988-3539050-1012.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4cdbfc7-068e-50aa-aa3a-1e77cf962189/f4cdbfc7-068e-50aa-aa3a-1e77cf962189_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 421140,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3607988-3539050-1013.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4cdbfc7-068e-50aa-aa3a-1e77cf962189/f4cdbfc7-068e-50aa-aa3a-1e77cf962189_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 408561,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3607988-3539050-1014.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4cdbfc7-068e-50aa-aa3a-1e77cf962189/f4cdbfc7-068e-50aa-aa3a-1e77cf962189_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 377141,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3607988-3539050-1015.jpg',
             'Width': 1500}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-09',
 'seller_name': 'MotoNovo Finance',
 'title': 'LAND ROVER RANGE ROVER EVOQUE 2.0 TD4 SE 5dr',
 'transmission': 'manual',
 'trim': '2.0 TD4 SE 5dr',
 'year': 2015}
2025-12-05 06:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273607988%27 HTTP/1.1" 200 None
2025-12-05 06:07:15 [manheim.gb] INFO: Saving data for 3607988: {'created_time': 1764914835.77999, 'last_price_update_time': 1764914835.780001, 'auction_closing_time': 1765270800.0}
2025-12-05 06:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3607988') HTTP/1.1" 204 0
2025-12-05 06:07:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VAUXHALL/CORSA?id=3409801&returnUrl=%2Fsearch%3FPage%3D3%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233409801&indx=209> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:07:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234270a4d0>
2025-12-05 06:07:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:07:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c00db30e-97d1-5780-baf0-2570c7931598/c00db30e-97d1-5780-baf0-2570c7931598_image_2.jpg HTTP/1.1" 201 0
2025-12-05 06:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F35d32ec0-02df-42bd-bed7-0390cc81834b_ext_6.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/35d32ec0-02df-42bd-bed7-0390cc81834b_ext_6.jpg saved to cache
2025-12-05 06:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c00db30e-97d1-5780-baf0-2570c7931598
2025-12-05 06:07:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234274d650>
2025-12-05 06:07:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:07:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c00db30e-97d1-5780-baf0-2570c7931598/c00db30e-97d1-5780-baf0-2570c7931598_image_0.jpg HTTP/1.1" 201 0
2025-12-05 06:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F35d32ec0-02df-42bd-bed7-0390cc81834b_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/35d32ec0-02df-42bd-bed7-0390cc81834b_ext_7.jpg saved to cache
2025-12-05 06:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c00db30e-97d1-5780-baf0-2570c7931598
2025-12-05 06:07:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234274f710>
2025-12-05 06:07:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:07:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a64efbf-cabf-59ed-9ed9-e7eaa4df9787/2a64efbf-cabf-59ed-9ed9-e7eaa4df9787_image_11.jpg HTTP/1.1" 201 0
2025-12-05 06:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3517150-9999999-338124313-012.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3517150-9999999-338124313-012.jpg saved to cache
2025-12-05 06:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 2a64efbf-cabf-59ed-9ed9-e7eaa4df9787
2025-12-05 06:07:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23428f3b90>
2025-12-05 06:07:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:07:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c00db30e-97d1-5780-baf0-2570c7931598/c00db30e-97d1-5780-baf0-2570c7931598_image_1.jpg HTTP/1.1" 201 0
2025-12-05 06:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F35d32ec0-02df-42bd-bed7-0390cc81834b_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/35d32ec0-02df-42bd-bed7-0390cc81834b_ext_7.jpg saved to cache
2025-12-05 06:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c00db30e-97d1-5780-baf0-2570c7931598
2025-12-05 06:07:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c00db30e-97d1-5780-baf0-2570c7931598, skipping ID generation
2025-12-05 06:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Removing item c00db30e-97d1-5780-baf0-2570c7931598 from tracking dictionaries
2025-12-05 06:07:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c00db30e-97d1-5780-baf0-2570c7931598 sending to next pipeline
2025-12-05 06:07:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: c00db30e-97d1-5780-baf0-2570c7931598, identifier: 2445301
2025-12-05 06:07:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-24566-4008738-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000024566-01989096-001.pdf)
2025-12-05 06:07:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-24566-4008738-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000024566-01989096-001.pdf)
2025-12-05 06:07:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/MINI/CONVERTIBLE?id=3421582&returnUrl=%2Fsearch%3FPage%3D3%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233421582&indx=212> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:07:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: c00db30e-97d1-5780-baf0-2570c7931598 with identifier: 2445301
2025-12-05 06:07:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 06:07:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=White HTTP/1.1" 200 None
2025-12-05 06:07:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 06:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 06:07:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: c00db30e-97d1-5780-baf0-2570c7931598 with identifier: 2445301
2025-12-05 06:07:17 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 152847 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    152847
2025-12-05 06:07:17 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: c00db30e-97d1-5780-baf0-2570c7931598 spider: manheim.gb
2025-12-05 06:07:17 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: c00db30e-97d1-5780-baf0-2570c7931598 due to rule: high_mileage_for_country.json, error: 152847 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    152847
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c00db30e-97d1-5780-baf0-2570c7931598/c00db30e-97d1-5780-baf0-2570c7931598_expert_report_file_c43cc458-dc5c-4ed1-981b-03181de0cf9a.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002445301-01989097-003.pdf',
 'color': 'White',
 'currency': 'GBP',
 'engine': '2.2L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'c00db30e-97d1-5780-baf0-2570c7931598',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'HX67TUV',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/A%20CLASS?id=2445301',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'MERCEDES-BENZ',
 'model': 'A CLASS',
 'odometer': 94975,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 32,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c00db30e-97d1-5780-baf0-2570c7931598/c00db30e-97d1-5780-baf0-2570c7931598_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 199076,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/35d32ec0-02df-42bd-bed7-0390cc81834b_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c00db30e-97d1-5780-baf0-2570c7931598/c00db30e-97d1-5780-baf0-2570c7931598_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 199076,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/35d32ec0-02df-42bd-bed7-0390cc81834b_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c00db30e-97d1-5780-baf0-2570c7931598/c00db30e-97d1-5780-baf0-2570c7931598_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 243839,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/35d32ec0-02df-42bd-bed7-0390cc81834b_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c00db30e-97d1-5780-baf0-2570c7931598/c00db30e-97d1-5780-baf0-2570c7931598_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117177,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/35d32ec0-02df-42bd-bed7-0390cc81834b_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c00db30e-97d1-5780-baf0-2570c7931598/c00db30e-97d1-5780-baf0-2570c7931598_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 203161,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/35d32ec0-02df-42bd-bed7-0390cc81834b_5.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c00db30e-97d1-5780-baf0-2570c7931598/c00db30e-97d1-5780-baf0-2570c7931598_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 195963,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/35d32ec0-02df-42bd-bed7-0390cc81834b_4.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c00db30e-97d1-5780-baf0-2570c7931598/c00db30e-97d1-5780-baf0-2570c7931598_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 203736,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/35d32ec0-02df-42bd-bed7-0390cc81834b_11.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c00db30e-97d1-5780-baf0-2570c7931598/c00db30e-97d1-5780-baf0-2570c7931598_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 196658,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/35d32ec0-02df-42bd-bed7-0390cc81834b_10.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c00db30e-97d1-5780-baf0-2570c7931598/c00db30e-97d1-5780-baf0-2570c7931598_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 205557,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/35d32ec0-02df-42bd-bed7-0390cc81834b_9.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c00db30e-97d1-5780-baf0-2570c7931598/c00db30e-97d1-5780-baf0-2570c7931598_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 259373,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/35d32ec0-02df-42bd-bed7-0390cc81834b_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c00db30e-97d1-5780-baf0-2570c7931598/c00db30e-97d1-5780-baf0-2570c7931598_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 127023,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/35d32ec0-02df-42bd-bed7-0390cc81834b_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c00db30e-97d1-5780-baf0-2570c7931598/c00db30e-97d1-5780-baf0-2570c7931598_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119428,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/35d32ec0-02df-42bd-bed7-0390cc81834b_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c00db30e-97d1-5780-baf0-2570c7931598/c00db30e-97d1-5780-baf0-2570c7931598_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 164339,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/35d32ec0-02df-42bd-bed7-0390cc81834b_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c00db30e-97d1-5780-baf0-2570c7931598/c00db30e-97d1-5780-baf0-2570c7931598_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 246324,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2445301-4008912-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c00db30e-97d1-5780-baf0-2570c7931598/c00db30e-97d1-5780-baf0-2570c7931598_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 276755,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2445301-4008912-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c00db30e-97d1-5780-baf0-2570c7931598/c00db30e-97d1-5780-baf0-2570c7931598_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 135210,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2445301-4008912-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c00db30e-97d1-5780-baf0-2570c7931598/c00db30e-97d1-5780-baf0-2570c7931598_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 226730,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2445301-4008912-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c00db30e-97d1-5780-baf0-2570c7931598/c00db30e-97d1-5780-baf0-2570c7931598_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257193,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2445301-4008912-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c00db30e-97d1-5780-baf0-2570c7931598/c00db30e-97d1-5780-baf0-2570c7931598_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 180928,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2445301-4008912-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c00db30e-97d1-5780-baf0-2570c7931598/c00db30e-97d1-5780-baf0-2570c7931598_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 178497,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2445301-4008912-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-29',
 'seller_name': 'Harwoods Group',
 'title': 'MERCEDES-BENZ A CLASS A220d AMG Line Premium Plus 5dr Auto',
 'transmission': 'automatic',
 'trim': 'A220d AMG Line Premium Plus 5dr Auto',
 'year': 2017}
2025-12-05 06:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272445301%27 HTTP/1.1" 200 None
2025-12-05 06:07:17 [manheim.gb] INFO: Saving data for 2445301: {'created_time': 1764914837.490339, 'last_price_update_time': 1764914837.490351, 'auction_closing_time': 1765270800.0}
2025-12-05 06:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2445301') HTTP/1.1" 204 0
2025-12-05 06:07:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425253d0>
2025-12-05 06:07:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:07:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a64efbf-cabf-59ed-9ed9-e7eaa4df9787/2a64efbf-cabf-59ed-9ed9-e7eaa4df9787_image_12.jpg HTTP/1.1" 201 0
2025-12-05 06:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3517150-4008226-13.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3517150-4008226-13.jpg saved to cache
2025-12-05 06:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 2a64efbf-cabf-59ed-9ed9-e7eaa4df9787
2025-12-05 06:07:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2a64efbf-cabf-59ed-9ed9-e7eaa4df9787, skipping ID generation
2025-12-05 06:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 2a64efbf-cabf-59ed-9ed9-e7eaa4df9787 from tracking dictionaries
2025-12-05 06:07:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2a64efbf-cabf-59ed-9ed9-e7eaa4df9787 sending to next pipeline
2025-12-05 06:07:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 2a64efbf-cabf-59ed-9ed9-e7eaa4df9787, identifier: 3517150
2025-12-05 06:07:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-24566-4008738-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000024566-01989096-001.pdf)
2025-12-05 06:07:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 2a64efbf-cabf-59ed-9ed9-e7eaa4df9787 with identifier: 3517150
2025-12-05 06:07:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 2a64efbf-cabf-59ed-9ed9-e7eaa4df9787 with identifier: 3517150
2025-12-05 06:07:18 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 11 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    11
2025-12-05 06:07:18 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: 2a64efbf-cabf-59ed-9ed9-e7eaa4df9787 spider: manheim.gb
2025-12-05 06:07:18 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 2a64efbf-cabf-59ed-9ed9-e7eaa4df9787 due to rule: registration_date_old.json, error: 11 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    11
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a64efbf-cabf-59ed-9ed9-e7eaa4df9787/2a64efbf-cabf-59ed-9ed9-e7eaa4df9787_expert_report_file_81910976-7f74-4637-b927-05ac270e9d98.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003517150-01993640-003.pdf',
 'color': 'BLUE',
 'currency': 'GBP',
 'engine': '1.0L',
 'expiration_date': '2025-12-05T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '2a64efbf-cabf-59ed-9ed9-e7eaa4df9787',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'DU64YOK',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FORD/FIESTA?id=3517150',
 'listing': 'auction',
 'location': 'Washington',
 'make': 'FORD',
 'model': 'FIESTA',
 'odometer': 64299,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 26,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a64efbf-cabf-59ed-9ed9-e7eaa4df9787/2a64efbf-cabf-59ed-9ed9-e7eaa4df9787_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 280257,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3517150-9999999-338124313-004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a64efbf-cabf-59ed-9ed9-e7eaa4df9787/2a64efbf-cabf-59ed-9ed9-e7eaa4df9787_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 253989,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3517150-9999999-338124313-008.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a64efbf-cabf-59ed-9ed9-e7eaa4df9787/2a64efbf-cabf-59ed-9ed9-e7eaa4df9787_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257292,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3517150-9999999-338124313-001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a64efbf-cabf-59ed-9ed9-e7eaa4df9787/2a64efbf-cabf-59ed-9ed9-e7eaa4df9787_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 267225,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3517150-9999999-338124313-002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a64efbf-cabf-59ed-9ed9-e7eaa4df9787/2a64efbf-cabf-59ed-9ed9-e7eaa4df9787_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 235422,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3517150-9999999-338124313-003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a64efbf-cabf-59ed-9ed9-e7eaa4df9787/2a64efbf-cabf-59ed-9ed9-e7eaa4df9787_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 312126,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3517150-9999999-338124313-005.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a64efbf-cabf-59ed-9ed9-e7eaa4df9787/2a64efbf-cabf-59ed-9ed9-e7eaa4df9787_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 221281,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3517150-9999999-338124313-006.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a64efbf-cabf-59ed-9ed9-e7eaa4df9787/2a64efbf-cabf-59ed-9ed9-e7eaa4df9787_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 274549,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3517150-9999999-338124313-007.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a64efbf-cabf-59ed-9ed9-e7eaa4df9787/2a64efbf-cabf-59ed-9ed9-e7eaa4df9787_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 284442,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3517150-9999999-338124313-009.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a64efbf-cabf-59ed-9ed9-e7eaa4df9787/2a64efbf-cabf-59ed-9ed9-e7eaa4df9787_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 216732,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3517150-9999999-338124313-010.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a64efbf-cabf-59ed-9ed9-e7eaa4df9787/2a64efbf-cabf-59ed-9ed9-e7eaa4df9787_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 230587,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3517150-9999999-338124313-011.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a64efbf-cabf-59ed-9ed9-e7eaa4df9787/2a64efbf-cabf-59ed-9ed9-e7eaa4df9787_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 234753,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3517150-9999999-338124313-012.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a64efbf-cabf-59ed-9ed9-e7eaa4df9787/2a64efbf-cabf-59ed-9ed9-e7eaa4df9787_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347408,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3517150-4008226-13.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a64efbf-cabf-59ed-9ed9-e7eaa4df9787/2a64efbf-cabf-59ed-9ed9-e7eaa4df9787_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 275776,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3517150-4008226-1000.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a64efbf-cabf-59ed-9ed9-e7eaa4df9787/2a64efbf-cabf-59ed-9ed9-e7eaa4df9787_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 341598,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3517150-4008226-1001.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a64efbf-cabf-59ed-9ed9-e7eaa4df9787/2a64efbf-cabf-59ed-9ed9-e7eaa4df9787_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 245738,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3517150-4008226-1002.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a64efbf-cabf-59ed-9ed9-e7eaa4df9787/2a64efbf-cabf-59ed-9ed9-e7eaa4df9787_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 278937,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3517150-4008226-1003.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a64efbf-cabf-59ed-9ed9-e7eaa4df9787/2a64efbf-cabf-59ed-9ed9-e7eaa4df9787_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 252784,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3517150-4008226-1004.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a64efbf-cabf-59ed-9ed9-e7eaa4df9787/2a64efbf-cabf-59ed-9ed9-e7eaa4df9787_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 286395,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3517150-4008226-1005.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a64efbf-cabf-59ed-9ed9-e7eaa4df9787/2a64efbf-cabf-59ed-9ed9-e7eaa4df9787_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 194799,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3517150-4008226-1006.jpg',
             'Width': 1500}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-26',
 'seller_name': 'Pulman Group Direct',
 'title': 'FORD FIESTA 1.0 EcoBoost Titanium 5dr',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost Titanium 5dr',
 'year': 2014}
2025-12-05 06:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273517150%27 HTTP/1.1" 200 None
2025-12-05 06:07:18 [manheim.gb] INFO: Saving data for 3517150: {'created_time': 1764914838.121206, 'last_price_update_time': 1764914838.121217, 'auction_closing_time': 1764925200.0}
2025-12-05 06:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3517150') HTTP/1.1" 204 0
2025-12-05 06:07:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-24566-4008738-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000024566-01989096-001.pdf)
2025-12-05 06:07:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a5b754e0-60f8-4428-ac15-0e69e9f17ec1_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000024566-01989096-001.pdf)
2025-12-05 06:07:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a5b754e0-60f8-4428-ac15-0e69e9f17ec1_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000024566-01989096-001.pdf)
2025-12-05 06:07:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4bf1d254-f708-5e51-be04-f45f7352dc60 with identifier: 3409801
2025-12-05 06:07:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bf1d254-f708-5e51-be04-f45f7352dc60 with scrape type 2
2025-12-05 06:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4bf1d254-f708-5e51-be04-f45f7352dc60 with scrape type 2
2025-12-05 06:07:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 4bf1d254-f708-5e51-be04-f45f7352dc60, identifier: 3409801
2025-12-05 06:07:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 4bf1d254-f708-5e51-be04-f45f7352dc60 with identifier: 3409801
2025-12-05 06:07:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 4bf1d254-f708-5e51-be04-f45f7352dc60 with identifier: 3409801
2025-12-05 06:07:18 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 4bf1d254-f708-5e51-be04-f45f7352dc60 with identifier: 3409801 to the API
2025-12-05 06:07:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 06:07:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 06:07:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/VAUXHALL/CORSA?id=3409801&returnUrl=%2Fsearch%3FPage%3D3%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233409801&indx=209>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003409801-01989489-002.pdf',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '4bf1d254-f708-5e51-be04-f45f7352dc60',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'DN70XDJ',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VAUXHALL/CORSA?id=3409801',
 'listing': 'auction',
 'location': 'Leeds',
 'make': 'VAUXHALL',
 'model': 'CORSA',
 'odometer': 4182,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-30',
 'seller_name': 'Big Motoring World Ltd',
 'title': 'VAUXHALL CORSA 1.2 SE Premium 5dr',
 'transmission': 'manual',
 'trim': '1.2 SE Premium 5dr',
 'year': 2020}
2025-12-05 06:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273409801%27 HTTP/1.1" 200 None
2025-12-05 06:07:18 [manheim.gb] INFO: Saving data for 3409801: {'auction_closing_time': 1765184400.0, 'created_time': 1764792267.526558, 'last_price_update_time': 1764914838.590305}
2025-12-05 06:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3409801') HTTP/1.1" 204 0
2025-12-05 06:07:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-24566-4008738-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000024566-01989096-001.pdf)
2025-12-05 06:07:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-24566-4008738-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000024566-01989096-001.pdf)
2025-12-05 06:07:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:07:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425b3950>
2025-12-05 06:07:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:07:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8180ded5-50e8-5729-b20a-a1d68523c708/8180ded5-50e8-5729-b20a-a1d68523c708_image_17.jpg HTTP/1.1" 201 0
2025-12-05 06:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-24566-4008738-1003.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-24566-4008738-1003.jpg saved to cache
2025-12-05 06:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 8180ded5-50e8-5729-b20a-a1d68523c708
2025-12-05 06:07:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342840450>
2025-12-05 06:07:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:07:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8180ded5-50e8-5729-b20a-a1d68523c708/8180ded5-50e8-5729-b20a-a1d68523c708_image_16.jpg HTTP/1.1" 201 0
2025-12-05 06:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-24566-4008738-1002.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-24566-4008738-1002.jpg saved to cache
2025-12-05 06:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 8180ded5-50e8-5729-b20a-a1d68523c708
2025-12-05 06:07:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd with identifier: 3421582
2025-12-05 06:07:19 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd
2025-12-05 06:07:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234267eb90>
2025-12-05 06:07:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:07:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8180ded5-50e8-5729-b20a-a1d68523c708/8180ded5-50e8-5729-b20a-a1d68523c708_image_18.jpg HTTP/1.1" 201 0
2025-12-05 06:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-24566-4008738-1004.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-24566-4008738-1004.jpg saved to cache
2025-12-05 06:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 8180ded5-50e8-5729-b20a-a1d68523c708
2025-12-05 06:07:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425c7590>
2025-12-05 06:07:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:07:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8180ded5-50e8-5729-b20a-a1d68523c708/8180ded5-50e8-5729-b20a-a1d68523c708_image_15.jpg HTTP/1.1" 201 0
2025-12-05 06:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-24566-4008738-1001.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-24566-4008738-1001.jpg saved to cache
2025-12-05 06:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 8180ded5-50e8-5729-b20a-a1d68523c708
2025-12-05 06:07:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23428e25d0>
2025-12-05 06:07:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:07:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8180ded5-50e8-5729-b20a-a1d68523c708/8180ded5-50e8-5729-b20a-a1d68523c708_image_12.jpg HTTP/1.1" 201 0
2025-12-05 06:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa5b754e0-60f8-4428-ac15-0e69e9f17ec1_ext_4.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a5b754e0-60f8-4428-ac15-0e69e9f17ec1_ext_4.jpg saved to cache
2025-12-05 06:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 8180ded5-50e8-5729-b20a-a1d68523c708
2025-12-05 06:07:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425f9a50>
2025-12-05 06:07:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:07:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8180ded5-50e8-5729-b20a-a1d68523c708/8180ded5-50e8-5729-b20a-a1d68523c708_image_11.jpg HTTP/1.1" 201 0
2025-12-05 06:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa5b754e0-60f8-4428-ac15-0e69e9f17ec1_ext_3.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a5b754e0-60f8-4428-ac15-0e69e9f17ec1_ext_3.jpg saved to cache
2025-12-05 06:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 8180ded5-50e8-5729-b20a-a1d68523c708
2025-12-05 06:07:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a5b754e0-60f8-4428-ac15-0e69e9f17ec1_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000024566-01989096-001.pdf)
2025-12-05 06:07:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a5b754e0-60f8-4428-ac15-0e69e9f17ec1_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000024566-01989096-001.pdf)
2025-12-05 06:07:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/CITROEN/C5?id=3417454&returnUrl=%2Fsearch%3FPage%3D3%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233417454&indx=210> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:07:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:07:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23427541d0>
2025-12-05 06:07:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:07:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8180ded5-50e8-5729-b20a-a1d68523c708/8180ded5-50e8-5729-b20a-a1d68523c708_image_14.jpg HTTP/1.1" 201 0
2025-12-05 06:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-24566-4008738-1000.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-24566-4008738-1000.jpg saved to cache
2025-12-05 06:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 8180ded5-50e8-5729-b20a-a1d68523c708
2025-12-05 06:07:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341eb4c50>
2025-12-05 06:07:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8180ded5-50e8-5729-b20a-a1d68523c708/8180ded5-50e8-5729-b20a-a1d68523c708_image_13.jpg HTTP/1.1" 201 0
2025-12-05 06:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-24566-4008738-13.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-24566-4008738-13.jpg saved to cache
2025-12-05 06:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 8180ded5-50e8-5729-b20a-a1d68523c708
2025-12-05 06:07:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a5b754e0-60f8-4428-ac15-0e69e9f17ec1_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000024566-01989096-001.pdf)
2025-12-05 06:07:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a5b754e0-60f8-4428-ac15-0e69e9f17ec1_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000024566-01989096-001.pdf)
2025-12-05 06:07:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a5b754e0-60f8-4428-ac15-0e69e9f17ec1_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000024566-01989096-001.pdf)
2025-12-05 06:07:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a5b754e0-60f8-4428-ac15-0e69e9f17ec1_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000024566-01989096-001.pdf)
2025-12-05 06:07:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a5b754e0-60f8-4428-ac15-0e69e9f17ec1_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000024566-01989096-001.pdf)
2025-12-05 06:07:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:07:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:07:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:07:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:07:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:07:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a5b754e0-60f8-4428-ac15-0e69e9f17ec1_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000024566-01989096-001.pdf)
2025-12-05 06:07:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341ea0750>
2025-12-05 06:07:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8180ded5-50e8-5729-b20a-a1d68523c708/8180ded5-50e8-5729-b20a-a1d68523c708_image_9.jpg HTTP/1.1" 201 0
2025-12-05 06:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa5b754e0-60f8-4428-ac15-0e69e9f17ec1_ext_2.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a5b754e0-60f8-4428-ac15-0e69e9f17ec1_ext_2.jpg saved to cache
2025-12-05 06:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8180ded5-50e8-5729-b20a-a1d68523c708
2025-12-05 06:07:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23428a7a10>
2025-12-05 06:07:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 06:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8180ded5-50e8-5729-b20a-a1d68523c708/8180ded5-50e8-5729-b20a-a1d68523c708_image_10.jpg HTTP/1.1" 201 0
2025-12-05 06:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa5b754e0-60f8-4428-ac15-0e69e9f17ec1_ext_5.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a5b754e0-60f8-4428-ac15-0e69e9f17ec1_ext_5.jpg saved to cache
2025-12-05 06:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 8180ded5-50e8-5729-b20a-a1d68523c708
2025-12-05 06:07:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08208214-b40a-5c7d-aedc-4684f081f829 with identifier: 3417454
2025-12-05 06:07:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08208214-b40a-5c7d-aedc-4684f081f829 with scrape type 2
2025-12-05 06:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08208214-b40a-5c7d-aedc-4684f081f829 with scrape type 2
2025-12-05 06:07:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 08208214-b40a-5c7d-aedc-4684f081f829, identifier: 3417454
2025-12-05 06:07:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 08208214-b40a-5c7d-aedc-4684f081f829 with identifier: 3417454
2025-12-05 06:07:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 08208214-b40a-5c7d-aedc-4684f081f829 with identifier: 3417454
2025-12-05 06:07:22 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 08208214-b40a-5c7d-aedc-4684f081f829 with identifier: 3417454 to the API
2025-12-05 06:07:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 06:07:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 06:07:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/CITROEN/C5?id=3417454&returnUrl=%2Fsearch%3FPage%3D3%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233417454&indx=210>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003417454-01982693-002.pdf',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.5L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '08208214-b40a-5c7d-aedc-4684f081f829',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'MJ21KHX',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/CITROEN/C5?id=3417454',
 'listing': 'auction',
 'location': 'Leeds',
 'make': 'CITROEN',
 'model': 'C5',
 'odometer': 42348,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-31',
 'seller_name': 'Novuna Vehicle Solutions',
 'title': 'CITROEN C5 1.5 BlueHDi 130 Shine Plus 5dr EAT8',
 'transmission': 'automatic',
 'trim': '1.5 BlueHDi 130 Shine Plus 5dr EAT8',
 'year': 2021}
2025-12-05 06:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273417454%27 HTTP/1.1" 200 None
2025-12-05 06:07:22 [manheim.gb] INFO: Saving data for 3417454: {'auction_closing_time': 1765184400.0, 'created_time': 1764792243.294603, 'last_price_update_time': 1764914842.331953}
2025-12-05 06:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3417454') HTTP/1.1" 204 0
2025-12-05 06:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a5b754e0-60f8-4428-ac15-0e69e9f17ec1_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000024566-01989096-001.pdf)
2025-12-05 06:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a5b754e0-60f8-4428-ac15-0e69e9f17ec1_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000024566-01989096-001.pdf)
2025-12-05 06:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a5b754e0-60f8-4428-ac15-0e69e9f17ec1_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000024566-01989096-001.pdf)
2025-12-05 06:07:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234278fe50>
2025-12-05 06:07:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:07:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8180ded5-50e8-5729-b20a-a1d68523c708/8180ded5-50e8-5729-b20a-a1d68523c708_image_8.jpg HTTP/1.1" 201 0
2025-12-05 06:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa5b754e0-60f8-4428-ac15-0e69e9f17ec1_9.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a5b754e0-60f8-4428-ac15-0e69e9f17ec1_9.jpg saved to cache
2025-12-05 06:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8180ded5-50e8-5729-b20a-a1d68523c708
2025-12-05 06:07:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342890fd0>
2025-12-05 06:07:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:07:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8180ded5-50e8-5729-b20a-a1d68523c708/8180ded5-50e8-5729-b20a-a1d68523c708_image_5.jpg HTTP/1.1" 201 0
2025-12-05 06:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa5b754e0-60f8-4428-ac15-0e69e9f17ec1_4.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a5b754e0-60f8-4428-ac15-0e69e9f17ec1_4.jpg saved to cache
2025-12-05 06:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8180ded5-50e8-5729-b20a-a1d68523c708
2025-12-05 06:07:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341f212d0>
2025-12-05 06:07:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:07:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8180ded5-50e8-5729-b20a-a1d68523c708/8180ded5-50e8-5729-b20a-a1d68523c708_image_7.jpg HTTP/1.1" 201 0
2025-12-05 06:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa5b754e0-60f8-4428-ac15-0e69e9f17ec1_10.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a5b754e0-60f8-4428-ac15-0e69e9f17ec1_10.jpg saved to cache
2025-12-05 06:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8180ded5-50e8-5729-b20a-a1d68523c708
2025-12-05 06:07:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341598850>
2025-12-05 06:07:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 06:07:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8180ded5-50e8-5729-b20a-a1d68523c708/8180ded5-50e8-5729-b20a-a1d68523c708_image_6.jpg HTTP/1.1" 201 0
2025-12-05 06:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa5b754e0-60f8-4428-ac15-0e69e9f17ec1_11.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a5b754e0-60f8-4428-ac15-0e69e9f17ec1_11.jpg saved to cache
2025-12-05 06:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8180ded5-50e8-5729-b20a-a1d68523c708
2025-12-05 06:07:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342740290>
2025-12-05 06:07:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:07:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8180ded5-50e8-5729-b20a-a1d68523c708/8180ded5-50e8-5729-b20a-a1d68523c708_image_3.jpg HTTP/1.1" 201 0
2025-12-05 06:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa5b754e0-60f8-4428-ac15-0e69e9f17ec1_ext_1.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a5b754e0-60f8-4428-ac15-0e69e9f17ec1_ext_1.jpg saved to cache
2025-12-05 06:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8180ded5-50e8-5729-b20a-a1d68523c708
2025-12-05 06:07:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342662350>
2025-12-05 06:07:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:07:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8180ded5-50e8-5729-b20a-a1d68523c708/8180ded5-50e8-5729-b20a-a1d68523c708_image_4.jpg HTTP/1.1" 201 0
2025-12-05 06:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa5b754e0-60f8-4428-ac15-0e69e9f17ec1_5.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a5b754e0-60f8-4428-ac15-0e69e9f17ec1_5.jpg saved to cache
2025-12-05 06:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8180ded5-50e8-5729-b20a-a1d68523c708
2025-12-05 06:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003377309-01989954-004.pdf> (referer: None)
2025-12-05 06:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/PEUGEOT/2008?id=3376327&returnUrl=%2Fsearch%3FPage%3D3%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233376327&indx=207> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:07:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:07:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342891c50>
2025-12-05 06:07:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:07:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8180ded5-50e8-5729-b20a-a1d68523c708/8180ded5-50e8-5729-b20a-a1d68523c708_image_1.jpg HTTP/1.1" 201 0
2025-12-05 06:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa5b754e0-60f8-4428-ac15-0e69e9f17ec1_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a5b754e0-60f8-4428-ac15-0e69e9f17ec1_ext_7.jpg saved to cache
2025-12-05 06:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8180ded5-50e8-5729-b20a-a1d68523c708
2025-12-05 06:07:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341ec9910>
2025-12-05 06:07:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:07:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8180ded5-50e8-5729-b20a-a1d68523c708/8180ded5-50e8-5729-b20a-a1d68523c708_image_2.jpg HTTP/1.1" 201 0
2025-12-05 06:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa5b754e0-60f8-4428-ac15-0e69e9f17ec1_ext_6.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a5b754e0-60f8-4428-ac15-0e69e9f17ec1_ext_6.jpg saved to cache
2025-12-05 06:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8180ded5-50e8-5729-b20a-a1d68523c708
2025-12-05 06:07:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342627ed0>
2025-12-05 06:07:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:07:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8180ded5-50e8-5729-b20a-a1d68523c708/8180ded5-50e8-5729-b20a-a1d68523c708_image_0.jpg HTTP/1.1" 201 0
2025-12-05 06:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa5b754e0-60f8-4428-ac15-0e69e9f17ec1_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a5b754e0-60f8-4428-ac15-0e69e9f17ec1_ext_7.jpg saved to cache
2025-12-05 06:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8180ded5-50e8-5729-b20a-a1d68523c708
2025-12-05 06:07:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8180ded5-50e8-5729-b20a-a1d68523c708, skipping ID generation
2025-12-05 06:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 8180ded5-50e8-5729-b20a-a1d68523c708 from tracking dictionaries
2025-12-05 06:07:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8180ded5-50e8-5729-b20a-a1d68523c708 sending to next pipeline
2025-12-05 06:07:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 8180ded5-50e8-5729-b20a-a1d68523c708, identifier: 24566
2025-12-05 06:07:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 8180ded5-50e8-5729-b20a-a1d68523c708 with identifier: 24566
2025-12-05 06:07:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 8180ded5-50e8-5729-b20a-a1d68523c708 with identifier: 24566
2025-12-05 06:07:25 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 12 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    12
2025-12-05 06:07:25 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: 8180ded5-50e8-5729-b20a-a1d68523c708 spider: manheim.gb
2025-12-05 06:07:25 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 8180ded5-50e8-5729-b20a-a1d68523c708 due to rule: registration_date_old.json, error: 12 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    12
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8180ded5-50e8-5729-b20a-a1d68523c708/8180ded5-50e8-5729-b20a-a1d68523c708_expert_report_file_ad487fb0-bb6e-4ea5-94dd-f50e2815cef8.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0000024566-01989096-001.pdf',
 'color': 'Grey',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': '2025-12-11T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '8180ded5-50e8-5729-b20a-a1d68523c708',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'NL13EDX',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/AUDI/A3?id=24566',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'AUDI',
 'model': 'A3',
 'odometer': 11536,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 27,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8180ded5-50e8-5729-b20a-a1d68523c708/8180ded5-50e8-5729-b20a-a1d68523c708_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 214150,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a5b754e0-60f8-4428-ac15-0e69e9f17ec1_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8180ded5-50e8-5729-b20a-a1d68523c708/8180ded5-50e8-5729-b20a-a1d68523c708_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 214150,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a5b754e0-60f8-4428-ac15-0e69e9f17ec1_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8180ded5-50e8-5729-b20a-a1d68523c708/8180ded5-50e8-5729-b20a-a1d68523c708_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 230339,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a5b754e0-60f8-4428-ac15-0e69e9f17ec1_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8180ded5-50e8-5729-b20a-a1d68523c708/8180ded5-50e8-5729-b20a-a1d68523c708_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119043,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a5b754e0-60f8-4428-ac15-0e69e9f17ec1_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8180ded5-50e8-5729-b20a-a1d68523c708/8180ded5-50e8-5729-b20a-a1d68523c708_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 203116,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a5b754e0-60f8-4428-ac15-0e69e9f17ec1_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8180ded5-50e8-5729-b20a-a1d68523c708/8180ded5-50e8-5729-b20a-a1d68523c708_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 202251,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a5b754e0-60f8-4428-ac15-0e69e9f17ec1_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8180ded5-50e8-5729-b20a-a1d68523c708/8180ded5-50e8-5729-b20a-a1d68523c708_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 210276,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a5b754e0-60f8-4428-ac15-0e69e9f17ec1_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8180ded5-50e8-5729-b20a-a1d68523c708/8180ded5-50e8-5729-b20a-a1d68523c708_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 206685,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a5b754e0-60f8-4428-ac15-0e69e9f17ec1_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8180ded5-50e8-5729-b20a-a1d68523c708/8180ded5-50e8-5729-b20a-a1d68523c708_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 208858,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a5b754e0-60f8-4428-ac15-0e69e9f17ec1_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8180ded5-50e8-5729-b20a-a1d68523c708/8180ded5-50e8-5729-b20a-a1d68523c708_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 229346,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a5b754e0-60f8-4428-ac15-0e69e9f17ec1_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8180ded5-50e8-5729-b20a-a1d68523c708/8180ded5-50e8-5729-b20a-a1d68523c708_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 207803,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a5b754e0-60f8-4428-ac15-0e69e9f17ec1_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8180ded5-50e8-5729-b20a-a1d68523c708/8180ded5-50e8-5729-b20a-a1d68523c708_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 191831,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a5b754e0-60f8-4428-ac15-0e69e9f17ec1_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8180ded5-50e8-5729-b20a-a1d68523c708/8180ded5-50e8-5729-b20a-a1d68523c708_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 234836,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a5b754e0-60f8-4428-ac15-0e69e9f17ec1_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8180ded5-50e8-5729-b20a-a1d68523c708/8180ded5-50e8-5729-b20a-a1d68523c708_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 335384,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-24566-4008738-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8180ded5-50e8-5729-b20a-a1d68523c708/8180ded5-50e8-5729-b20a-a1d68523c708_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 373269,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-24566-4008738-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8180ded5-50e8-5729-b20a-a1d68523c708/8180ded5-50e8-5729-b20a-a1d68523c708_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 230115,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-24566-4008738-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8180ded5-50e8-5729-b20a-a1d68523c708/8180ded5-50e8-5729-b20a-a1d68523c708_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 267470,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-24566-4008738-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8180ded5-50e8-5729-b20a-a1d68523c708/8180ded5-50e8-5729-b20a-a1d68523c708_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 265526,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-24566-4008738-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8180ded5-50e8-5729-b20a-a1d68523c708/8180ded5-50e8-5729-b20a-a1d68523c708_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 337621,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-24566-4008738-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8180ded5-50e8-5729-b20a-a1d68523c708/8180ded5-50e8-5729-b20a-a1d68523c708_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 423101,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-24566-4008738-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-18',
 'seller_name': 'Lookers',
 'title': 'AUDI A3 2.0 TDI S Line 5dr',
 'transmission': 'manual',
 'trim': '2.0 TDI S Line 5dr',
 'year': 2013}
2025-12-05 06:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%2724566%27 HTTP/1.1" 200 None
2025-12-05 06:07:25 [manheim.gb] INFO: Saving data for 24566: {'created_time': 1764914845.469248, 'last_price_update_time': 1764914845.469263, 'auction_closing_time': 1765443600.0}
2025-12-05 06:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='24566') HTTP/1.1" 204 0
2025-12-05 06:07:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23415981d0>
2025-12-05 06:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:07:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b770092a-1ce0-5014-9f26-6a1cc683c601/b770092a-1ce0-5014-9f26-6a1cc683c601_expert_report_file_a5d0e25d-323b-4a66-8e21-3310faed7535.pdf HTTP/1.1" 201 0
2025-12-05 06:07:25 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item b770092a-1ce0-5014-9f26-6a1cc683c601
2025-12-05 06:07:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b770092a-1ce0-5014-9f26-6a1cc683c601, skipping ID generation
2025-12-05 06:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 17 photos for item b770092a-1ce0-5014-9f26-6a1cc683c601
2025-12-05 06:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_ext_7.jpg not downloaded yet
2025-12-05 06:07:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89482351-35ce-525a-89a1-6fb987c6e34d with identifier: 3376327
2025-12-05 06:07:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89482351-35ce-525a-89a1-6fb987c6e34d with scrape type 2
2025-12-05 06:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 89482351-35ce-525a-89a1-6fb987c6e34d with scrape type 2
2025-12-05 06:07:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 89482351-35ce-525a-89a1-6fb987c6e34d, identifier: 3376327
2025-12-05 06:07:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 89482351-35ce-525a-89a1-6fb987c6e34d with identifier: 3376327
2025-12-05 06:07:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 89482351-35ce-525a-89a1-6fb987c6e34d with identifier: 3376327
2025-12-05 06:07:26 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 89482351-35ce-525a-89a1-6fb987c6e34d with identifier: 3376327 to the API
2025-12-05 06:07:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 06:07:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 06:07:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/PEUGEOT/2008?id=3376327&returnUrl=%2Fsearch%3FPage%3D3%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233376327&indx=207>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003376327-01988757-002.pdf',
 'color': 'RED',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '89482351-35ce-525a-89a1-6fb987c6e34d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'GF22XML',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/PEUGEOT/2008?id=3376327',
 'listing': 'auction',
 'location': 'Northampton',
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 41718,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-12',
 'seller_name': 'Yorkshire Ward & Rowlatt',
 'title': 'PEUGEOT 2008 1.2 PureTech 130 GT Premium 5dr EAT8',
 'transmission': 'automatic',
 'trim': '1.2 PureTech 130 GT Premium 5dr EAT8',
 'year': 2022}
2025-12-05 06:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273376327%27 HTTP/1.1" 200 None
2025-12-05 06:07:26 [manheim.gb] INFO: Saving data for 3376327: {'auction_closing_time': 1765270800.0, 'created_time': 1764792275.656439, 'last_price_update_time': 1764914846.42792}
2025-12-05 06:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3376327') HTTP/1.1" 204 0
2025-12-05 06:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_ext_7.jpg not downloaded yet
2025-12-05 06:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_ext_6.jpg not downloaded yet
2025-12-05 06:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_ext_1.jpg not downloaded yet
2025-12-05 06:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_5.jpg not downloaded yet
2025-12-05 06:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_4.jpg not downloaded yet
2025-12-05 06:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_11.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_11.jpg not downloaded yet
2025-12-05 06:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_10.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_10.jpg not downloaded yet
2025-12-05 06:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_9.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_9.jpg not downloaded yet
2025-12-05 06:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_ext_2.jpg not downloaded yet
2025-12-05 06:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_ext_5.jpg not downloaded yet
2025-12-05 06:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_ext_3.jpg not downloaded yet
2025-12-05 06:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_ext_4.jpg not downloaded yet
2025-12-05 06:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3377309-4008333-13.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3377309-4008333-13.jpg not downloaded yet
2025-12-05 06:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3377309-4008333-1000.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3377309-4008333-1000.jpg not downloaded yet
2025-12-05 06:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3377309-4008333-1001.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3377309-4008333-1001.jpg not downloaded yet
2025-12-05 06:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003421582-01991065-002.pdf> (referer: None)
2025-12-05 06:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3377309-4008333-1002.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3377309-4008333-1002.jpg not downloaded yet
2025-12-05 06:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003424031-01991731-002.pdf> (referer: None)
2025-12-05 06:07:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23415c4310>
2025-12-05 06:07:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:07:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd/fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd_expert_report_file_7cb44e16-de8b-4dfe-b644-6dcd96e124d2.pdf HTTP/1.1" 201 0
2025-12-05 06:07:27 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd
2025-12-05 06:07:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd, skipping ID generation
2025-12-05 06:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd
2025-12-05 06:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4cc061bc-d69c-453c-ae30-78cffa92df1a_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4cc061bc-d69c-453c-ae30-78cffa92df1a_ext_7.jpg not downloaded yet
2025-12-05 06:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4cc061bc-d69c-453c-ae30-78cffa92df1a_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4cc061bc-d69c-453c-ae30-78cffa92df1a_ext_7.jpg not downloaded yet
2025-12-05 06:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4cc061bc-d69c-453c-ae30-78cffa92df1a_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4cc061bc-d69c-453c-ae30-78cffa92df1a_ext_6.jpg not downloaded yet
2025-12-05 06:07:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23423abbd0>
2025-12-05 06:07:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:07:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4251c640-8d8e-552a-945a-6761cae842fc/4251c640-8d8e-552a-945a-6761cae842fc_expert_report_file_7b756212-31ef-4268-a7e2-d0e2995bca55.pdf HTTP/1.1" 201 0
2025-12-05 06:07:27 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 4251c640-8d8e-552a-945a-6761cae842fc
2025-12-05 06:07:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4251c640-8d8e-552a-945a-6761cae842fc, skipping ID generation
2025-12-05 06:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 4251c640-8d8e-552a-945a-6761cae842fc
2025-12-05 06:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5acfbef0-1683-48cf-95ca-25f8d7c81f79_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5acfbef0-1683-48cf-95ca-25f8d7c81f79_ext_7.jpg not downloaded yet
2025-12-05 06:07:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3377309-4008333-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003377309-01989954-004.pdf)
2025-12-05 06:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4cc061bc-d69c-453c-ae30-78cffa92df1a_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4cc061bc-d69c-453c-ae30-78cffa92df1a_ext_1.jpg not downloaded yet
2025-12-05 06:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5acfbef0-1683-48cf-95ca-25f8d7c81f79_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5acfbef0-1683-48cf-95ca-25f8d7c81f79_ext_7.jpg not downloaded yet
2025-12-05 06:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4cc061bc-d69c-453c-ae30-78cffa92df1a_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4cc061bc-d69c-453c-ae30-78cffa92df1a_5.jpg not downloaded yet
2025-12-05 06:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5acfbef0-1683-48cf-95ca-25f8d7c81f79_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5acfbef0-1683-48cf-95ca-25f8d7c81f79_ext_6.jpg not downloaded yet
2025-12-05 06:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4cc061bc-d69c-453c-ae30-78cffa92df1a_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4cc061bc-d69c-453c-ae30-78cffa92df1a_4.jpg not downloaded yet
2025-12-05 06:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5acfbef0-1683-48cf-95ca-25f8d7c81f79_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5acfbef0-1683-48cf-95ca-25f8d7c81f79_ext_1.jpg not downloaded yet
2025-12-05 06:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4cc061bc-d69c-453c-ae30-78cffa92df1a_11.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4cc061bc-d69c-453c-ae30-78cffa92df1a_11.jpg not downloaded yet
2025-12-05 06:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5acfbef0-1683-48cf-95ca-25f8d7c81f79_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5acfbef0-1683-48cf-95ca-25f8d7c81f79_5.jpg not downloaded yet
2025-12-05 06:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4cc061bc-d69c-453c-ae30-78cffa92df1a_10.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4cc061bc-d69c-453c-ae30-78cffa92df1a_10.jpg not downloaded yet
2025-12-05 06:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5acfbef0-1683-48cf-95ca-25f8d7c81f79_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5acfbef0-1683-48cf-95ca-25f8d7c81f79_4.jpg not downloaded yet
2025-12-05 06:07:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234158d210>
2025-12-05 06:07:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:07:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b770092a-1ce0-5014-9f26-6a1cc683c601/b770092a-1ce0-5014-9f26-6a1cc683c601_image_14.jpg HTTP/1.1" 201 0
2025-12-05 06:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3377309-4008333-1000.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3377309-4008333-1000.jpg saved to cache
2025-12-05 06:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item b770092a-1ce0-5014-9f26-6a1cc683c601
2025-12-05 06:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4cc061bc-d69c-453c-ae30-78cffa92df1a_9.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4cc061bc-d69c-453c-ae30-78cffa92df1a_9.jpg not downloaded yet
2025-12-05 06:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5acfbef0-1683-48cf-95ca-25f8d7c81f79_11.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5acfbef0-1683-48cf-95ca-25f8d7c81f79_11.jpg not downloaded yet
2025-12-05 06:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4cc061bc-d69c-453c-ae30-78cffa92df1a_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4cc061bc-d69c-453c-ae30-78cffa92df1a_ext_2.jpg not downloaded yet
2025-12-05 06:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5acfbef0-1683-48cf-95ca-25f8d7c81f79_10.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5acfbef0-1683-48cf-95ca-25f8d7c81f79_10.jpg not downloaded yet
2025-12-05 06:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4cc061bc-d69c-453c-ae30-78cffa92df1a_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4cc061bc-d69c-453c-ae30-78cffa92df1a_ext_5.jpg not downloaded yet
2025-12-05 06:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5acfbef0-1683-48cf-95ca-25f8d7c81f79_9.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5acfbef0-1683-48cf-95ca-25f8d7c81f79_9.jpg not downloaded yet
2025-12-05 06:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4cc061bc-d69c-453c-ae30-78cffa92df1a_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4cc061bc-d69c-453c-ae30-78cffa92df1a_ext_3.jpg not downloaded yet
2025-12-05 06:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5acfbef0-1683-48cf-95ca-25f8d7c81f79_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5acfbef0-1683-48cf-95ca-25f8d7c81f79_ext_2.jpg not downloaded yet
2025-12-05 06:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4cc061bc-d69c-453c-ae30-78cffa92df1a_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4cc061bc-d69c-453c-ae30-78cffa92df1a_ext_4.jpg not downloaded yet
2025-12-05 06:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5acfbef0-1683-48cf-95ca-25f8d7c81f79_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5acfbef0-1683-48cf-95ca-25f8d7c81f79_ext_5.jpg not downloaded yet
2025-12-05 06:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3421582-4008464-13.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3421582-4008464-13.jpg not downloaded yet
2025-12-05 06:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5acfbef0-1683-48cf-95ca-25f8d7c81f79_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5acfbef0-1683-48cf-95ca-25f8d7c81f79_ext_3.jpg not downloaded yet
2025-12-05 06:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3421582-4008464-1000.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3421582-4008464-1000.jpg not downloaded yet
2025-12-05 06:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5acfbef0-1683-48cf-95ca-25f8d7c81f79_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5acfbef0-1683-48cf-95ca-25f8d7c81f79_ext_4.jpg not downloaded yet
2025-12-05 06:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3421582-4008464-1001.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3421582-4008464-1001.jpg not downloaded yet
2025-12-05 06:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3424031-4008113-13.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3424031-4008113-13.jpg not downloaded yet
2025-12-05 06:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3421582-4008464-1002.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3421582-4008464-1002.jpg not downloaded yet
2025-12-05 06:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3424031-4008113-1000.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3424031-4008113-1000.jpg not downloaded yet
2025-12-05 06:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3421582-4008464-1003.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3421582-4008464-1003.jpg not downloaded yet
2025-12-05 06:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3424031-4008113-1001.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3424031-4008113-1001.jpg not downloaded yet
2025-12-05 06:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3421582-4008464-1004.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3421582-4008464-1004.jpg not downloaded yet
2025-12-05 06:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3424031-4008113-1002.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3424031-4008113-1002.jpg not downloaded yet
2025-12-05 06:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3421582-4008464-1005.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3421582-4008464-1005.jpg not downloaded yet
2025-12-05 06:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3424031-4008113-1003.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3424031-4008113-1003.jpg not downloaded yet
2025-12-05 06:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3424031-4008113-1004.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3424031-4008113-1004.jpg not downloaded yet
2025-12-05 06:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3424031-4008113-1005.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3424031-4008113-1005.jpg not downloaded yet
2025-12-05 06:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3424031-4008113-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003424031-01991731-002.pdf)
2025-12-05 06:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3424031-4008113-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003424031-01991731-002.pdf)
2025-12-05 06:07:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342a26710>
2025-12-05 06:07:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:07:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4251c640-8d8e-552a-945a-6761cae842fc/4251c640-8d8e-552a-945a-6761cae842fc_image_18.jpg HTTP/1.1" 201 0
2025-12-05 06:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3424031-4008113-1004.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3424031-4008113-1004.jpg saved to cache
2025-12-05 06:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 4251c640-8d8e-552a-945a-6761cae842fc
2025-12-05 06:07:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2343cdd490>
2025-12-05 06:07:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:07:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4251c640-8d8e-552a-945a-6761cae842fc/4251c640-8d8e-552a-945a-6761cae842fc_image_17.jpg HTTP/1.1" 201 0
2025-12-05 06:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3424031-4008113-1003.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3424031-4008113-1003.jpg saved to cache
2025-12-05 06:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 4251c640-8d8e-552a-945a-6761cae842fc
2025-12-05 06:07:29 [scrapy.extensions.logstats] INFO: Crawled 134 pages (at 18 pages/min), scraped 45 items (at 10 items/min)
2025-12-05 06:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3421582-4008464-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003421582-01991065-002.pdf)
2025-12-05 06:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3424031-4008113-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003424031-01991731-002.pdf)
2025-12-05 06:07:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234238abd0>
2025-12-05 06:07:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:07:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd/fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd_image_19.jpg HTTP/1.1" 201 0
2025-12-05 06:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3421582-4008464-1005.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3421582-4008464-1005.jpg saved to cache
2025-12-05 06:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd
2025-12-05 06:07:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234264c690>
2025-12-05 06:07:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:07:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4251c640-8d8e-552a-945a-6761cae842fc/4251c640-8d8e-552a-945a-6761cae842fc_image_19.jpg HTTP/1.1" 201 0
2025-12-05 06:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3424031-4008113-1005.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3424031-4008113-1005.jpg saved to cache
2025-12-05 06:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 4251c640-8d8e-552a-945a-6761cae842fc
2025-12-05 06:07:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3424031-4008113-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003424031-01991731-002.pdf)
2025-12-05 06:07:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3421582-4008464-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003421582-01991065-002.pdf)
2025-12-05 06:07:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23424ae910>
2025-12-05 06:07:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:07:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4251c640-8d8e-552a-945a-6761cae842fc/4251c640-8d8e-552a-945a-6761cae842fc_image_16.jpg HTTP/1.1" 201 0
2025-12-05 06:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3424031-4008113-1002.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3424031-4008113-1002.jpg saved to cache
2025-12-05 06:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 4251c640-8d8e-552a-945a-6761cae842fc
2025-12-05 06:07:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342624cd0>
2025-12-05 06:07:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:07:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd/fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd_image_18.jpg HTTP/1.1" 201 0
2025-12-05 06:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3421582-4008464-1004.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3421582-4008464-1004.jpg saved to cache
2025-12-05 06:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd
2025-12-05 06:07:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3421582-4008464-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003421582-01991065-002.pdf)
2025-12-05 06:07:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3424031-4008113-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003424031-01991731-002.pdf)
2025-12-05 06:07:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23424f6d90>
2025-12-05 06:07:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:07:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd/fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd_image_17.jpg HTTP/1.1" 201 0
2025-12-05 06:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3421582-4008464-1003.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3421582-4008464-1003.jpg saved to cache
2025-12-05 06:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd
2025-12-05 06:07:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234239ba90>
2025-12-05 06:07:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 06:07:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4251c640-8d8e-552a-945a-6761cae842fc/4251c640-8d8e-552a-945a-6761cae842fc_image_15.jpg HTTP/1.1" 201 0
2025-12-05 06:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3424031-4008113-1001.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3424031-4008113-1001.jpg saved to cache
2025-12-05 06:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 4251c640-8d8e-552a-945a-6761cae842fc
2025-12-05 06:07:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3424031-4008113-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003424031-01991731-002.pdf)
2025-12-05 06:07:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3421582-4008464-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003421582-01991065-002.pdf)
2025-12-05 06:07:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23426a9090>
2025-12-05 06:07:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:07:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4251c640-8d8e-552a-945a-6761cae842fc/4251c640-8d8e-552a-945a-6761cae842fc_image_14.jpg HTTP/1.1" 201 0
2025-12-05 06:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3424031-4008113-1000.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3424031-4008113-1000.jpg saved to cache
2025-12-05 06:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 4251c640-8d8e-552a-945a-6761cae842fc
2025-12-05 06:07:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341544510>
2025-12-05 06:07:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:07:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd/fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd_image_16.jpg HTTP/1.1" 201 0
2025-12-05 06:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3421582-4008464-1002.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3421582-4008464-1002.jpg saved to cache
2025-12-05 06:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd
2025-12-05 06:07:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3424031-4008113-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003424031-01991731-002.pdf)
2025-12-05 06:07:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3421582-4008464-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003421582-01991065-002.pdf)
2025-12-05 06:07:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425a0110>
2025-12-05 06:07:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:07:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4251c640-8d8e-552a-945a-6761cae842fc/4251c640-8d8e-552a-945a-6761cae842fc_image_13.jpg HTTP/1.1" 201 0
2025-12-05 06:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3424031-4008113-13.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3424031-4008113-13.jpg saved to cache
2025-12-05 06:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 4251c640-8d8e-552a-945a-6761cae842fc
2025-12-05 06:07:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23415c4a50>
2025-12-05 06:07:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 06:07:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd/fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd_image_15.jpg HTTP/1.1" 201 0
2025-12-05 06:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3421582-4008464-1001.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3421582-4008464-1001.jpg saved to cache
2025-12-05 06:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd
2025-12-05 06:07:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3421582-4008464-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003421582-01991065-002.pdf)
2025-12-05 06:07:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5acfbef0-1683-48cf-95ca-25f8d7c81f79_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003424031-01991731-002.pdf)
2025-12-05 06:07:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341f23dd0>
2025-12-05 06:07:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 06:07:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd/fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd_image_14.jpg HTTP/1.1" 201 0
2025-12-05 06:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3421582-4008464-1000.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3421582-4008464-1000.jpg saved to cache
2025-12-05 06:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd
2025-12-05 06:07:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23423a8210>
2025-12-05 06:07:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:07:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4251c640-8d8e-552a-945a-6761cae842fc/4251c640-8d8e-552a-945a-6761cae842fc_image_12.jpg HTTP/1.1" 201 0
2025-12-05 06:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5acfbef0-1683-48cf-95ca-25f8d7c81f79_ext_4.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5acfbef0-1683-48cf-95ca-25f8d7c81f79_ext_4.jpg saved to cache
2025-12-05 06:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 4251c640-8d8e-552a-945a-6761cae842fc
2025-12-05 06:07:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5acfbef0-1683-48cf-95ca-25f8d7c81f79_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003424031-01991731-002.pdf)
2025-12-05 06:07:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3421582-4008464-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003421582-01991065-002.pdf)
2025-12-05 06:07:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425c6050>
2025-12-05 06:07:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 06:07:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4251c640-8d8e-552a-945a-6761cae842fc/4251c640-8d8e-552a-945a-6761cae842fc_image_11.jpg HTTP/1.1" 201 0
2025-12-05 06:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5acfbef0-1683-48cf-95ca-25f8d7c81f79_ext_3.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5acfbef0-1683-48cf-95ca-25f8d7c81f79_ext_3.jpg saved to cache
2025-12-05 06:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 4251c640-8d8e-552a-945a-6761cae842fc
2025-12-05 06:07:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23428e0dd0>
2025-12-05 06:07:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:07:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd/fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd_image_13.jpg HTTP/1.1" 201 0
2025-12-05 06:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3421582-4008464-13.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3421582-4008464-13.jpg saved to cache
2025-12-05 06:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd
2025-12-05 06:07:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5acfbef0-1683-48cf-95ca-25f8d7c81f79_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003424031-01991731-002.pdf)
2025-12-05 06:07:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234264ca10>
2025-12-05 06:07:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:07:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4251c640-8d8e-552a-945a-6761cae842fc/4251c640-8d8e-552a-945a-6761cae842fc_image_10.jpg HTTP/1.1" 201 0
2025-12-05 06:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5acfbef0-1683-48cf-95ca-25f8d7c81f79_ext_5.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5acfbef0-1683-48cf-95ca-25f8d7c81f79_ext_5.jpg saved to cache
2025-12-05 06:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 4251c640-8d8e-552a-945a-6761cae842fc
2025-12-05 06:07:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4cc061bc-d69c-453c-ae30-78cffa92df1a_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003421582-01991065-002.pdf)
2025-12-05 06:07:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341588310>
2025-12-05 06:07:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:07:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd/fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd_image_12.jpg HTTP/1.1" 201 0
2025-12-05 06:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4cc061bc-d69c-453c-ae30-78cffa92df1a_ext_4.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4cc061bc-d69c-453c-ae30-78cffa92df1a_ext_4.jpg saved to cache
2025-12-05 06:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd
2025-12-05 06:07:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5acfbef0-1683-48cf-95ca-25f8d7c81f79_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003424031-01991731-002.pdf)
2025-12-05 06:07:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341588c90>
2025-12-05 06:07:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:07:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4251c640-8d8e-552a-945a-6761cae842fc/4251c640-8d8e-552a-945a-6761cae842fc_image_9.jpg HTTP/1.1" 201 0
2025-12-05 06:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5acfbef0-1683-48cf-95ca-25f8d7c81f79_ext_2.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5acfbef0-1683-48cf-95ca-25f8d7c81f79_ext_2.jpg saved to cache
2025-12-05 06:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4251c640-8d8e-552a-945a-6761cae842fc
2025-12-05 06:07:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4cc061bc-d69c-453c-ae30-78cffa92df1a_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003421582-01991065-002.pdf)
2025-12-05 06:07:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341ecb250>
2025-12-05 06:07:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:07:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd/fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd_image_11.jpg HTTP/1.1" 201 0
2025-12-05 06:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4cc061bc-d69c-453c-ae30-78cffa92df1a_ext_3.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4cc061bc-d69c-453c-ae30-78cffa92df1a_ext_3.jpg saved to cache
2025-12-05 06:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd
2025-12-05 06:07:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5acfbef0-1683-48cf-95ca-25f8d7c81f79_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003424031-01991731-002.pdf)
2025-12-05 06:07:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425c4b90>
2025-12-05 06:07:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:07:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4251c640-8d8e-552a-945a-6761cae842fc/4251c640-8d8e-552a-945a-6761cae842fc_image_8.jpg HTTP/1.1" 201 0
2025-12-05 06:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5acfbef0-1683-48cf-95ca-25f8d7c81f79_9.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5acfbef0-1683-48cf-95ca-25f8d7c81f79_9.jpg saved to cache
2025-12-05 06:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4251c640-8d8e-552a-945a-6761cae842fc
2025-12-05 06:07:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5acfbef0-1683-48cf-95ca-25f8d7c81f79_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003424031-01991731-002.pdf)
2025-12-05 06:07:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4cc061bc-d69c-453c-ae30-78cffa92df1a_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003421582-01991065-002.pdf)
2025-12-05 06:07:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23428e15d0>
2025-12-05 06:07:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:07:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4251c640-8d8e-552a-945a-6761cae842fc/4251c640-8d8e-552a-945a-6761cae842fc_image_7.jpg HTTP/1.1" 201 0
2025-12-05 06:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5acfbef0-1683-48cf-95ca-25f8d7c81f79_10.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5acfbef0-1683-48cf-95ca-25f8d7c81f79_10.jpg saved to cache
2025-12-05 06:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4251c640-8d8e-552a-945a-6761cae842fc
2025-12-05 06:07:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23424f4a90>
2025-12-05 06:07:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:07:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd/fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd_image_10.jpg HTTP/1.1" 201 0
2025-12-05 06:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4cc061bc-d69c-453c-ae30-78cffa92df1a_ext_5.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4cc061bc-d69c-453c-ae30-78cffa92df1a_ext_5.jpg saved to cache
2025-12-05 06:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd
2025-12-05 06:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5acfbef0-1683-48cf-95ca-25f8d7c81f79_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003424031-01991731-002.pdf)
2025-12-05 06:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4cc061bc-d69c-453c-ae30-78cffa92df1a_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003421582-01991065-002.pdf)
2025-12-05 06:07:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234264ca10>
2025-12-05 06:07:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4251c640-8d8e-552a-945a-6761cae842fc/4251c640-8d8e-552a-945a-6761cae842fc_image_6.jpg HTTP/1.1" 201 0
2025-12-05 06:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5acfbef0-1683-48cf-95ca-25f8d7c81f79_11.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5acfbef0-1683-48cf-95ca-25f8d7c81f79_11.jpg saved to cache
2025-12-05 06:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4251c640-8d8e-552a-945a-6761cae842fc
2025-12-05 06:07:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23424ae390>
2025-12-05 06:07:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd/fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd_image_9.jpg HTTP/1.1" 201 0
2025-12-05 06:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4cc061bc-d69c-453c-ae30-78cffa92df1a_ext_2.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4cc061bc-d69c-453c-ae30-78cffa92df1a_ext_2.jpg saved to cache
2025-12-05 06:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd
2025-12-05 06:07:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4cc061bc-d69c-453c-ae30-78cffa92df1a_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003421582-01991065-002.pdf)
2025-12-05 06:07:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23415c2650>
2025-12-05 06:07:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd/fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd_image_8.jpg HTTP/1.1" 201 0
2025-12-05 06:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4cc061bc-d69c-453c-ae30-78cffa92df1a_9.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4cc061bc-d69c-453c-ae30-78cffa92df1a_9.jpg saved to cache
2025-12-05 06:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd
2025-12-05 06:07:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5acfbef0-1683-48cf-95ca-25f8d7c81f79_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003424031-01991731-002.pdf)
2025-12-05 06:07:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23424ac810>
2025-12-05 06:07:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:07:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4251c640-8d8e-552a-945a-6761cae842fc/4251c640-8d8e-552a-945a-6761cae842fc_image_5.jpg HTTP/1.1" 201 0
2025-12-05 06:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5acfbef0-1683-48cf-95ca-25f8d7c81f79_4.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5acfbef0-1683-48cf-95ca-25f8d7c81f79_4.jpg saved to cache
2025-12-05 06:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4251c640-8d8e-552a-945a-6761cae842fc
2025-12-05 06:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4cc061bc-d69c-453c-ae30-78cffa92df1a_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003421582-01991065-002.pdf)
2025-12-05 06:07:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425a2590>
2025-12-05 06:07:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:07:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd/fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd_image_7.jpg HTTP/1.1" 201 0
2025-12-05 06:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4cc061bc-d69c-453c-ae30-78cffa92df1a_10.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4cc061bc-d69c-453c-ae30-78cffa92df1a_10.jpg saved to cache
2025-12-05 06:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd
2025-12-05 06:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5acfbef0-1683-48cf-95ca-25f8d7c81f79_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003424031-01991731-002.pdf)
2025-12-05 06:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4cc061bc-d69c-453c-ae30-78cffa92df1a_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003421582-01991065-002.pdf)
2025-12-05 06:07:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342632cd0>
2025-12-05 06:07:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:07:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4251c640-8d8e-552a-945a-6761cae842fc/4251c640-8d8e-552a-945a-6761cae842fc_image_4.jpg HTTP/1.1" 201 0
2025-12-05 06:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5acfbef0-1683-48cf-95ca-25f8d7c81f79_5.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5acfbef0-1683-48cf-95ca-25f8d7c81f79_5.jpg saved to cache
2025-12-05 06:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4251c640-8d8e-552a-945a-6761cae842fc
2025-12-05 06:07:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341547950>
2025-12-05 06:07:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:07:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd/fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd_image_6.jpg HTTP/1.1" 201 0
2025-12-05 06:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4cc061bc-d69c-453c-ae30-78cffa92df1a_11.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4cc061bc-d69c-453c-ae30-78cffa92df1a_11.jpg saved to cache
2025-12-05 06:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd
2025-12-05 06:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5acfbef0-1683-48cf-95ca-25f8d7c81f79_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003424031-01991731-002.pdf)
2025-12-05 06:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4cc061bc-d69c-453c-ae30-78cffa92df1a_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003421582-01991065-002.pdf)
2025-12-05 06:07:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234158f950>
2025-12-05 06:07:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4251c640-8d8e-552a-945a-6761cae842fc/4251c640-8d8e-552a-945a-6761cae842fc_image_3.jpg HTTP/1.1" 201 0
2025-12-05 06:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5acfbef0-1683-48cf-95ca-25f8d7c81f79_ext_1.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5acfbef0-1683-48cf-95ca-25f8d7c81f79_ext_1.jpg saved to cache
2025-12-05 06:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4251c640-8d8e-552a-945a-6761cae842fc
2025-12-05 06:07:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234239ba90>
2025-12-05 06:07:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd/fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd_image_5.jpg HTTP/1.1" 201 0
2025-12-05 06:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4cc061bc-d69c-453c-ae30-78cffa92df1a_4.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4cc061bc-d69c-453c-ae30-78cffa92df1a_4.jpg saved to cache
2025-12-05 06:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd
2025-12-05 06:07:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4cc061bc-d69c-453c-ae30-78cffa92df1a_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003421582-01991065-002.pdf)
2025-12-05 06:07:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5acfbef0-1683-48cf-95ca-25f8d7c81f79_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003424031-01991731-002.pdf)
2025-12-05 06:07:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23426d9790>
2025-12-05 06:07:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 06:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd/fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd_image_4.jpg HTTP/1.1" 201 0
2025-12-05 06:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4cc061bc-d69c-453c-ae30-78cffa92df1a_5.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4cc061bc-d69c-453c-ae30-78cffa92df1a_5.jpg saved to cache
2025-12-05 06:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd
2025-12-05 06:07:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5acfbef0-1683-48cf-95ca-25f8d7c81f79_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003424031-01991731-002.pdf)
2025-12-05 06:07:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342569410>
2025-12-05 06:07:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:07:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4251c640-8d8e-552a-945a-6761cae842fc/4251c640-8d8e-552a-945a-6761cae842fc_image_2.jpg HTTP/1.1" 201 0
2025-12-05 06:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5acfbef0-1683-48cf-95ca-25f8d7c81f79_ext_6.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5acfbef0-1683-48cf-95ca-25f8d7c81f79_ext_6.jpg saved to cache
2025-12-05 06:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4251c640-8d8e-552a-945a-6761cae842fc
2025-12-05 06:07:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4cc061bc-d69c-453c-ae30-78cffa92df1a_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003421582-01991065-002.pdf)
2025-12-05 06:07:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23428bb810>
2025-12-05 06:07:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:07:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4251c640-8d8e-552a-945a-6761cae842fc/4251c640-8d8e-552a-945a-6761cae842fc_image_1.jpg HTTP/1.1" 201 0
2025-12-05 06:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5acfbef0-1683-48cf-95ca-25f8d7c81f79_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5acfbef0-1683-48cf-95ca-25f8d7c81f79_ext_7.jpg saved to cache
2025-12-05 06:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4251c640-8d8e-552a-945a-6761cae842fc
2025-12-05 06:07:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5acfbef0-1683-48cf-95ca-25f8d7c81f79_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003424031-01991731-002.pdf)
2025-12-05 06:07:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23415c7710>
2025-12-05 06:07:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:07:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd/fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd_image_3.jpg HTTP/1.1" 201 0
2025-12-05 06:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4cc061bc-d69c-453c-ae30-78cffa92df1a_ext_1.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4cc061bc-d69c-453c-ae30-78cffa92df1a_ext_1.jpg saved to cache
2025-12-05 06:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd
2025-12-05 06:07:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4cc061bc-d69c-453c-ae30-78cffa92df1a_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003421582-01991065-002.pdf)
2025-12-05 06:07:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234264edd0>
2025-12-05 06:07:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:07:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4251c640-8d8e-552a-945a-6761cae842fc/4251c640-8d8e-552a-945a-6761cae842fc_image_0.jpg HTTP/1.1" 201 0
2025-12-05 06:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5acfbef0-1683-48cf-95ca-25f8d7c81f79_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5acfbef0-1683-48cf-95ca-25f8d7c81f79_ext_7.jpg saved to cache
2025-12-05 06:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4251c640-8d8e-552a-945a-6761cae842fc
2025-12-05 06:07:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4251c640-8d8e-552a-945a-6761cae842fc, skipping ID generation
2025-12-05 06:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 4251c640-8d8e-552a-945a-6761cae842fc from tracking dictionaries
2025-12-05 06:07:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4251c640-8d8e-552a-945a-6761cae842fc sending to next pipeline
2025-12-05 06:07:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 4251c640-8d8e-552a-945a-6761cae842fc, identifier: 3424031
2025-12-05 06:07:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 4251c640-8d8e-552a-945a-6761cae842fc with identifier: 3424031
2025-12-05 06:07:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 4251c640-8d8e-552a-945a-6761cae842fc with identifier: 3424031
2025-12-05 06:07:45 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 16 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    16
2025-12-05 06:07:45 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: 4251c640-8d8e-552a-945a-6761cae842fc spider: manheim.gb
2025-12-05 06:07:45 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 4251c640-8d8e-552a-945a-6761cae842fc due to rule: registration_date_old.json, error: 16 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    16
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4251c640-8d8e-552a-945a-6761cae842fc/4251c640-8d8e-552a-945a-6761cae842fc_expert_report_file_7b756212-31ef-4268-a7e2-d0e2995bca55.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003424031-01991731-002.pdf',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': '2025-12-11T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '4251c640-8d8e-552a-945a-6761cae842fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'SA09ZWE',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/POLO?id=3424031',
 'listing': 'auction',
 'location': 'Northampton',
 'make': 'VOLKSWAGEN',
 'model': 'POLO',
 'odometer': 88678,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 44,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4251c640-8d8e-552a-945a-6761cae842fc/4251c640-8d8e-552a-945a-6761cae842fc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 235202,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5acfbef0-1683-48cf-95ca-25f8d7c81f79_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4251c640-8d8e-552a-945a-6761cae842fc/4251c640-8d8e-552a-945a-6761cae842fc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 235202,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5acfbef0-1683-48cf-95ca-25f8d7c81f79_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4251c640-8d8e-552a-945a-6761cae842fc/4251c640-8d8e-552a-945a-6761cae842fc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 258740,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5acfbef0-1683-48cf-95ca-25f8d7c81f79_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4251c640-8d8e-552a-945a-6761cae842fc/4251c640-8d8e-552a-945a-6761cae842fc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 213527,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5acfbef0-1683-48cf-95ca-25f8d7c81f79_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4251c640-8d8e-552a-945a-6761cae842fc/4251c640-8d8e-552a-945a-6761cae842fc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 224486,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5acfbef0-1683-48cf-95ca-25f8d7c81f79_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4251c640-8d8e-552a-945a-6761cae842fc/4251c640-8d8e-552a-945a-6761cae842fc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 213396,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5acfbef0-1683-48cf-95ca-25f8d7c81f79_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4251c640-8d8e-552a-945a-6761cae842fc/4251c640-8d8e-552a-945a-6761cae842fc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 228783,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5acfbef0-1683-48cf-95ca-25f8d7c81f79_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4251c640-8d8e-552a-945a-6761cae842fc/4251c640-8d8e-552a-945a-6761cae842fc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 223124,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5acfbef0-1683-48cf-95ca-25f8d7c81f79_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4251c640-8d8e-552a-945a-6761cae842fc/4251c640-8d8e-552a-945a-6761cae842fc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 221787,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5acfbef0-1683-48cf-95ca-25f8d7c81f79_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4251c640-8d8e-552a-945a-6761cae842fc/4251c640-8d8e-552a-945a-6761cae842fc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 286238,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5acfbef0-1683-48cf-95ca-25f8d7c81f79_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4251c640-8d8e-552a-945a-6761cae842fc/4251c640-8d8e-552a-945a-6761cae842fc_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 230305,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5acfbef0-1683-48cf-95ca-25f8d7c81f79_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4251c640-8d8e-552a-945a-6761cae842fc/4251c640-8d8e-552a-945a-6761cae842fc_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 228726,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5acfbef0-1683-48cf-95ca-25f8d7c81f79_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4251c640-8d8e-552a-945a-6761cae842fc/4251c640-8d8e-552a-945a-6761cae842fc_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 297111,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5acfbef0-1683-48cf-95ca-25f8d7c81f79_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4251c640-8d8e-552a-945a-6761cae842fc/4251c640-8d8e-552a-945a-6761cae842fc_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 255863,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3424031-4008113-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4251c640-8d8e-552a-945a-6761cae842fc/4251c640-8d8e-552a-945a-6761cae842fc_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 250657,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3424031-4008113-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4251c640-8d8e-552a-945a-6761cae842fc/4251c640-8d8e-552a-945a-6761cae842fc_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 203856,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3424031-4008113-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4251c640-8d8e-552a-945a-6761cae842fc/4251c640-8d8e-552a-945a-6761cae842fc_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 235276,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3424031-4008113-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4251c640-8d8e-552a-945a-6761cae842fc/4251c640-8d8e-552a-945a-6761cae842fc_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 283497,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3424031-4008113-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4251c640-8d8e-552a-945a-6761cae842fc/4251c640-8d8e-552a-945a-6761cae842fc_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 238782,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3424031-4008113-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4251c640-8d8e-552a-945a-6761cae842fc/4251c640-8d8e-552a-945a-6761cae842fc_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 172040,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3424031-4008113-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-30',
 'seller_name': 'Vindis Group',
 'title': 'VOLKSWAGEN POLO 1.2 E 60 3dr',
 'transmission': 'manual',
 'trim': '1.2 E 60 3dr',
 'year': 2009}
2025-12-05 06:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273424031%27 HTTP/1.1" 200 None
2025-12-05 06:07:46 [manheim.gb] INFO: Saving data for 3424031: {'created_time': 1764914866.009188, 'last_price_update_time': 1764914866.009201, 'auction_closing_time': 1765443600.0}
2025-12-05 06:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3424031') HTTP/1.1" 204 0
2025-12-05 06:07:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4cc061bc-d69c-453c-ae30-78cffa92df1a_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003421582-01991065-002.pdf)
2025-12-05 06:07:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4cc061bc-d69c-453c-ae30-78cffa92df1a_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003421582-01991065-002.pdf)
2025-12-05 06:07:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234158fbd0>
2025-12-05 06:07:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 06:07:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd/fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd_image_2.jpg HTTP/1.1" 201 0
2025-12-05 06:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4cc061bc-d69c-453c-ae30-78cffa92df1a_ext_6.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4cc061bc-d69c-453c-ae30-78cffa92df1a_ext_6.jpg saved to cache
2025-12-05 06:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd
2025-12-05 06:07:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23428e3e50>
2025-12-05 06:07:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:07:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd/fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd_image_0.jpg HTTP/1.1" 201 0
2025-12-05 06:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4cc061bc-d69c-453c-ae30-78cffa92df1a_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4cc061bc-d69c-453c-ae30-78cffa92df1a_ext_7.jpg saved to cache
2025-12-05 06:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd
2025-12-05 06:07:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341544190>
2025-12-05 06:07:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:07:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd/fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd_image_1.jpg HTTP/1.1" 201 0
2025-12-05 06:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4cc061bc-d69c-453c-ae30-78cffa92df1a_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4cc061bc-d69c-453c-ae30-78cffa92df1a_ext_7.jpg saved to cache
2025-12-05 06:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd
2025-12-05 06:07:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd, skipping ID generation
2025-12-05 06:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Removing item fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd from tracking dictionaries
2025-12-05 06:07:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd sending to next pipeline
2025-12-05 06:07:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd, identifier: 3421582
2025-12-05 06:07:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd with identifier: 3421582
2025-12-05 06:07:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 06:07:47 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=TURQUOISE HTTP/1.1" 200 None
2025-12-05 06:07:47 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 06:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 06:07:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd with identifier: 3421582
2025-12-05 06:07:47 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd with identifier: 3421582 to the API
2025-12-05 06:07:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 06:07:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 06:07:47 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/4cc061bc-d69c-453c-ae30-78cffa92df1a_ext_7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd/fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd_expert_report_file_7cb44e16-de8b-4dfe-b644-6dcd96e124d2.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003421582-01991065-002.pdf',
 'color': 'TURQUOISE',
 'currency': 'GBP',
 'engine': '1.5L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'BV17CZJ',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MINI/CONVERTIBLE?id=3421582',
 'listing': 'auction',
 'location': 'Leeds',
 'make': 'MINI',
 'model': 'CONVERTIBLE',
 'odometer': 52814,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 26,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd/fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 209539,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4cc061bc-d69c-453c-ae30-78cffa92df1a_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd/fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 209539,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4cc061bc-d69c-453c-ae30-78cffa92df1a_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd/fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 264282,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4cc061bc-d69c-453c-ae30-78cffa92df1a_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd/fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 285621,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4cc061bc-d69c-453c-ae30-78cffa92df1a_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd/fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 170654,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4cc061bc-d69c-453c-ae30-78cffa92df1a_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd/fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 180972,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4cc061bc-d69c-453c-ae30-78cffa92df1a_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd/fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 168921,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4cc061bc-d69c-453c-ae30-78cffa92df1a_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd/fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 188050,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4cc061bc-d69c-453c-ae30-78cffa92df1a_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd/fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 191131,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4cc061bc-d69c-453c-ae30-78cffa92df1a_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd/fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 244566,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4cc061bc-d69c-453c-ae30-78cffa92df1a_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd/fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 235227,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4cc061bc-d69c-453c-ae30-78cffa92df1a_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd/fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 229777,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4cc061bc-d69c-453c-ae30-78cffa92df1a_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd/fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 247794,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4cc061bc-d69c-453c-ae30-78cffa92df1a_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd/fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 279246,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3421582-4008464-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd/fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 213600,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3421582-4008464-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd/fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 306129,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3421582-4008464-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd/fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 297072,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3421582-4008464-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd/fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 182969,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3421582-4008464-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd/fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 278493,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3421582-4008464-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd/fb7cd0ee-9bdb-58ff-adc1-b8fcb61e79dd_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 202102,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3421582-4008464-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-08',
 'seller_name': 'Available Car',
 'title': 'MINI CONVERTIBLE 1.5 Cooper D 2dr',
 'transmission': 'manual',
 'trim': '1.5 Cooper D 2dr',
 'year': 2017}
2025-12-05 06:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273421582%27 HTTP/1.1" 200 None
2025-12-05 06:07:47 [manheim.gb] INFO: Saving data for 3421582: {'created_time': 1764914867.70036, 'last_price_update_time': 1764914867.700374, 'auction_closing_time': 1765184400.0}
2025-12-05 06:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3421582') HTTP/1.1" 204 0
2025-12-05 06:07:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3377309-4008333-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003377309-01989954-004.pdf)
2025-12-05 06:07:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3377309-4008333-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003377309-01989954-004.pdf)
2025-12-05 06:07:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23428e25d0>
2025-12-05 06:07:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:07:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b770092a-1ce0-5014-9f26-6a1cc683c601/b770092a-1ce0-5014-9f26-6a1cc683c601_image_15.jpg HTTP/1.1" 201 0
2025-12-05 06:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3377309-4008333-1001.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3377309-4008333-1001.jpg saved to cache
2025-12-05 06:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item b770092a-1ce0-5014-9f26-6a1cc683c601
2025-12-05 06:07:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341580490>
2025-12-05 06:07:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:07:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b770092a-1ce0-5014-9f26-6a1cc683c601/b770092a-1ce0-5014-9f26-6a1cc683c601_image_16.jpg HTTP/1.1" 201 0
2025-12-05 06:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3377309-4008333-1002.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3377309-4008333-1002.jpg saved to cache
2025-12-05 06:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item b770092a-1ce0-5014-9f26-6a1cc683c601
2025-12-05 06:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003377309-01989954-004.pdf)
2025-12-05 06:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3377309-4008333-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003377309-01989954-004.pdf)
2025-12-05 06:07:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23415b6b10>
2025-12-05 06:07:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:07:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b770092a-1ce0-5014-9f26-6a1cc683c601/b770092a-1ce0-5014-9f26-6a1cc683c601_image_12.jpg HTTP/1.1" 201 0
2025-12-05 06:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_ext_4.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_ext_4.jpg saved to cache
2025-12-05 06:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item b770092a-1ce0-5014-9f26-6a1cc683c601
2025-12-05 06:07:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23427269d0>
2025-12-05 06:07:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:07:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b770092a-1ce0-5014-9f26-6a1cc683c601/b770092a-1ce0-5014-9f26-6a1cc683c601_image_13.jpg HTTP/1.1" 201 0
2025-12-05 06:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3377309-4008333-13.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3377309-4008333-13.jpg saved to cache
2025-12-05 06:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item b770092a-1ce0-5014-9f26-6a1cc683c601
2025-12-05 06:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=3333029&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233333029&indx=193> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VOLVO/XC90?id=3305810&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233305810&indx=189> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:07:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:07:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003377309-01989954-004.pdf)
2025-12-05 06:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003377309-01989954-004.pdf)
2025-12-05 06:07:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b839da5e-368d-5654-aeae-c36947510e64 with identifier: 3333029
2025-12-05 06:07:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b839da5e-368d-5654-aeae-c36947510e64 with scrape type 2
2025-12-05 06:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b839da5e-368d-5654-aeae-c36947510e64 with scrape type 2
2025-12-05 06:07:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: b839da5e-368d-5654-aeae-c36947510e64, identifier: 3333029
2025-12-05 06:07:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: b839da5e-368d-5654-aeae-c36947510e64 with identifier: 3333029
2025-12-05 06:07:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: b839da5e-368d-5654-aeae-c36947510e64 with identifier: 3333029
2025-12-05 06:07:49 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: b839da5e-368d-5654-aeae-c36947510e64 with identifier: 3333029 to the API
2025-12-05 06:07:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 06:07:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 06:07:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=3333029&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233333029&indx=193>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003333029-01992771-004.pdf',
 'color': 'RED',
 'currency': 'GBP',
 'engine': '1.3L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'b839da5e-368d-5654-aeae-c36947510e64',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'PK70BMV',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=3333029',
 'listing': 'auction',
 'location': 'Leeds',
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 51040,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-03',
 'seller_name': 'Mobilize Financial Services',
 'title': 'NISSAN QASHQAI 1.3 DiG-T Acenta Premium 5dr',
 'transmission': 'manual',
 'trim': '1.3 DiG-T Acenta Premium 5dr',
 'year': 2020}
2025-12-05 06:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273333029%27 HTTP/1.1" 200 None
2025-12-05 06:07:49 [manheim.gb] INFO: Saving data for 3333029: {'auction_closing_time': 1765184400.0, 'created_time': 1764792337.519147, 'last_price_update_time': 1764914869.77637}
2025-12-05 06:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3333029') HTTP/1.1" 204 0
2025-12-05 06:07:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e7b65da-6863-5bed-b1ec-cb682c4b5bd0 with identifier: 3305810
2025-12-05 06:07:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e7b65da-6863-5bed-b1ec-cb682c4b5bd0 with scrape type 2
2025-12-05 06:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9e7b65da-6863-5bed-b1ec-cb682c4b5bd0 with scrape type 2
2025-12-05 06:07:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 9e7b65da-6863-5bed-b1ec-cb682c4b5bd0, identifier: 3305810
2025-12-05 06:07:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 9e7b65da-6863-5bed-b1ec-cb682c4b5bd0 with identifier: 3305810
2025-12-05 06:07:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 9e7b65da-6863-5bed-b1ec-cb682c4b5bd0 with identifier: 3305810
2025-12-05 06:07:50 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 9e7b65da-6863-5bed-b1ec-cb682c4b5bd0 with identifier: 3305810 to the API
2025-12-05 06:07:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 06:07:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 06:07:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/VOLVO/XC90?id=3305810&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233305810&indx=189>
{'auction_title': '',
 'c_o_2_emission_value': 52,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003305810-01973872-005.pdf',
 'color': 'SILVER',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': '2025-12-11T09:00:00Z',
 'fuel_type': 'Petrol PHEV',
 'id': '9e7b65da-6863-5bed-b1ec-cb682c4b5bd0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'FY69XST',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VOLVO/XC90?id=3305810',
 'listing': 'auction',
 'location': 'Manchester',
 'make': 'VOLVO',
 'model': 'XC90',
 'odometer': 87250,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-31',
 'seller_name': 'Santander Consumer',
 'title': 'VOLVO XC90 2.0 T8 [390] Hybrid Inscription 5dr AWD Gtron',
 'transmission': 'automatic',
 'trim': '2.0 T8 [390] Hybrid Inscription 5dr AWD Gtron',
 'year': 2020}
2025-12-05 06:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273305810%27 HTTP/1.1" 200 None
2025-12-05 06:07:50 [manheim.gb] INFO: Saving data for 3305810: {'auction_closing_time': 1765443600.0, 'created_time': 1764792333.133467, 'last_price_update_time': 1764914870.262626}
2025-12-05 06:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3305810') HTTP/1.1" 204 0
2025-12-05 06:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003377309-01989954-004.pdf)
2025-12-05 06:07:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234158ae10>
2025-12-05 06:07:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:07:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b770092a-1ce0-5014-9f26-6a1cc683c601/b770092a-1ce0-5014-9f26-6a1cc683c601_image_10.jpg HTTP/1.1" 201 0
2025-12-05 06:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_ext_5.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_ext_5.jpg saved to cache
2025-12-05 06:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item b770092a-1ce0-5014-9f26-6a1cc683c601
2025-12-05 06:07:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23426eb010>
2025-12-05 06:07:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:07:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b770092a-1ce0-5014-9f26-6a1cc683c601/b770092a-1ce0-5014-9f26-6a1cc683c601_image_11.jpg HTTP/1.1" 201 0
2025-12-05 06:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_ext_3.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_ext_3.jpg saved to cache
2025-12-05 06:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item b770092a-1ce0-5014-9f26-6a1cc683c601
2025-12-05 06:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003377309-01989954-004.pdf)
2025-12-05 06:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003377309-01989954-004.pdf)
2025-12-05 06:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003377309-01989954-004.pdf)
2025-12-05 06:07:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342696950>
2025-12-05 06:07:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:07:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b770092a-1ce0-5014-9f26-6a1cc683c601/b770092a-1ce0-5014-9f26-6a1cc683c601_image_6.jpg HTTP/1.1" 201 0
2025-12-05 06:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_11.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_11.jpg saved to cache
2025-12-05 06:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b770092a-1ce0-5014-9f26-6a1cc683c601
2025-12-05 06:07:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342560e90>
2025-12-05 06:07:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:07:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b770092a-1ce0-5014-9f26-6a1cc683c601/b770092a-1ce0-5014-9f26-6a1cc683c601_image_7.jpg HTTP/1.1" 201 0
2025-12-05 06:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_10.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_10.jpg saved to cache
2025-12-05 06:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b770092a-1ce0-5014-9f26-6a1cc683c601
2025-12-05 06:07:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23428cca90>
2025-12-05 06:07:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:07:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b770092a-1ce0-5014-9f26-6a1cc683c601/b770092a-1ce0-5014-9f26-6a1cc683c601_image_8.jpg HTTP/1.1" 201 0
2025-12-05 06:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_9.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_9.jpg saved to cache
2025-12-05 06:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b770092a-1ce0-5014-9f26-6a1cc683c601
2025-12-05 06:07:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341eb3dd0>
2025-12-05 06:07:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:07:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b770092a-1ce0-5014-9f26-6a1cc683c601/b770092a-1ce0-5014-9f26-6a1cc683c601_image_9.jpg HTTP/1.1" 201 0
2025-12-05 06:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_ext_2.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_ext_2.jpg saved to cache
2025-12-05 06:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b770092a-1ce0-5014-9f26-6a1cc683c601
2025-12-05 06:07:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003377309-01989954-004.pdf)
2025-12-05 06:07:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003377309-01989954-004.pdf)
2025-12-05 06:07:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003377309-01989954-004.pdf)
2025-12-05 06:07:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003377309-01989954-004.pdf)
2025-12-05 06:07:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/SEAT/ARONA?id=3338885&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233338885&indx=194> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:07:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:07:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341545c10>
2025-12-05 06:07:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:07:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b770092a-1ce0-5014-9f26-6a1cc683c601/b770092a-1ce0-5014-9f26-6a1cc683c601_image_3.jpg HTTP/1.1" 201 0
2025-12-05 06:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_ext_1.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_ext_1.jpg saved to cache
2025-12-05 06:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b770092a-1ce0-5014-9f26-6a1cc683c601
2025-12-05 06:07:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342841990>
2025-12-05 06:07:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:07:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b770092a-1ce0-5014-9f26-6a1cc683c601/b770092a-1ce0-5014-9f26-6a1cc683c601_image_4.jpg HTTP/1.1" 201 0
2025-12-05 06:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_5.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_5.jpg saved to cache
2025-12-05 06:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b770092a-1ce0-5014-9f26-6a1cc683c601
2025-12-05 06:07:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003377309-01989954-004.pdf)
2025-12-05 06:07:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003377309-01989954-004.pdf)
2025-12-05 06:07:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425a09d0>
2025-12-05 06:07:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 06:07:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b770092a-1ce0-5014-9f26-6a1cc683c601/b770092a-1ce0-5014-9f26-6a1cc683c601_image_5.jpg HTTP/1.1" 201 0
2025-12-05 06:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_4.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_4.jpg saved to cache
2025-12-05 06:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b770092a-1ce0-5014-9f26-6a1cc683c601
2025-12-05 06:07:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23428ce350>
2025-12-05 06:07:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:07:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b770092a-1ce0-5014-9f26-6a1cc683c601/b770092a-1ce0-5014-9f26-6a1cc683c601_image_2.jpg HTTP/1.1" 201 0
2025-12-05 06:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_ext_6.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_ext_6.jpg saved to cache
2025-12-05 06:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b770092a-1ce0-5014-9f26-6a1cc683c601
2025-12-05 06:07:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e654e99b-f8fe-5765-9f44-032691f77cdc with identifier: 3338885
2025-12-05 06:07:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e654e99b-f8fe-5765-9f44-032691f77cdc with scrape type 2
2025-12-05 06:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e654e99b-f8fe-5765-9f44-032691f77cdc with scrape type 2
2025-12-05 06:07:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: e654e99b-f8fe-5765-9f44-032691f77cdc, identifier: 3338885
2025-12-05 06:07:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: e654e99b-f8fe-5765-9f44-032691f77cdc with identifier: 3338885
2025-12-05 06:07:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: e654e99b-f8fe-5765-9f44-032691f77cdc with identifier: 3338885
2025-12-05 06:07:54 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: e654e99b-f8fe-5765-9f44-032691f77cdc with identifier: 3338885 to the API
2025-12-05 06:07:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 06:07:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 06:07:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/SEAT/ARONA?id=3338885&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233338885&indx=194>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003338885-01980963-003.pdf',
 'color': 'RED',
 'currency': 'GBP',
 'engine': '1.0L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'e654e99b-f8fe-5765-9f44-032691f77cdc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'KS21AGV',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/SEAT/ARONA?id=3338885',
 'listing': 'directbuy',
 'location': 'Leeds',
 'make': 'SEAT',
 'model': 'ARONA',
 'odometer': 77910,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-24',
 'seller_name': 'Big Motoring World Ltd',
 'title': 'SEAT ARONA 1.0 TSI 110 FR [EZ] 5dr',
 'transmission': 'manual',
 'trim': '1.0 TSI 110 FR [EZ] 5dr',
 'year': 2021}
2025-12-05 06:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273338885%27 HTTP/1.1" 200 None
2025-12-05 06:07:54 [manheim.gb] INFO: Saving data for 3338885: {'auction_closing_time': 1765184400.0, 'created_time': 1764792279.136349, 'last_price_update_time': 1764914874.357018}
2025-12-05 06:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3338885') HTTP/1.1" 204 0
2025-12-05 06:07:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23426ad550>
2025-12-05 06:07:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:07:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b770092a-1ce0-5014-9f26-6a1cc683c601/b770092a-1ce0-5014-9f26-6a1cc683c601_image_1.jpg HTTP/1.1" 201 0
2025-12-05 06:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_ext_7.jpg saved to cache
2025-12-05 06:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b770092a-1ce0-5014-9f26-6a1cc683c601
2025-12-05 06:07:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:07:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:07:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:07:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425a01d0>
2025-12-05 06:07:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:07:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:07:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:07:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:07:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b770092a-1ce0-5014-9f26-6a1cc683c601/b770092a-1ce0-5014-9f26-6a1cc683c601_image_0.jpg HTTP/1.1" 201 0
2025-12-05 06:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 06:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_ext_7.jpg saved to cache
2025-12-05 06:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b770092a-1ce0-5014-9f26-6a1cc683c601
2025-12-05 06:07:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b770092a-1ce0-5014-9f26-6a1cc683c601, skipping ID generation
2025-12-05 06:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b770092a-1ce0-5014-9f26-6a1cc683c601 from tracking dictionaries
2025-12-05 06:07:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b770092a-1ce0-5014-9f26-6a1cc683c601 sending to next pipeline
2025-12-05 06:07:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: b770092a-1ce0-5014-9f26-6a1cc683c601, identifier: 3377309
2025-12-05 06:07:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: b770092a-1ce0-5014-9f26-6a1cc683c601 with identifier: 3377309
2025-12-05 06:07:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: b770092a-1ce0-5014-9f26-6a1cc683c601 with identifier: 3377309
2025-12-05 06:07:55 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: b770092a-1ce0-5014-9f26-6a1cc683c601 with identifier: 3377309 to the API
2025-12-05 06:07:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 06:07:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 06:07:55 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_ext_7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b770092a-1ce0-5014-9f26-6a1cc683c601/b770092a-1ce0-5014-9f26-6a1cc683c601_expert_report_file_a5d0e25d-323b-4a66-8e21-3310faed7535.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003377309-01989954-004.pdf',
 'color': 'BLUE',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'b770092a-1ce0-5014-9f26-6a1cc683c601',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'OY71SWW',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/CITROEN/C3?id=3377309',
 'listing': 'auction',
 'location': 'Leeds',
 'make': 'CITROEN',
 'model': 'C3',
 'odometer': 66464,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b770092a-1ce0-5014-9f26-6a1cc683c601/b770092a-1ce0-5014-9f26-6a1cc683c601_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 233893,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b770092a-1ce0-5014-9f26-6a1cc683c601/b770092a-1ce0-5014-9f26-6a1cc683c601_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 233893,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b770092a-1ce0-5014-9f26-6a1cc683c601/b770092a-1ce0-5014-9f26-6a1cc683c601_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 252783,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b770092a-1ce0-5014-9f26-6a1cc683c601/b770092a-1ce0-5014-9f26-6a1cc683c601_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 185753,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b770092a-1ce0-5014-9f26-6a1cc683c601/b770092a-1ce0-5014-9f26-6a1cc683c601_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 188605,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b770092a-1ce0-5014-9f26-6a1cc683c601/b770092a-1ce0-5014-9f26-6a1cc683c601_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 201869,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b770092a-1ce0-5014-9f26-6a1cc683c601/b770092a-1ce0-5014-9f26-6a1cc683c601_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 173714,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b770092a-1ce0-5014-9f26-6a1cc683c601/b770092a-1ce0-5014-9f26-6a1cc683c601_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 199668,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b770092a-1ce0-5014-9f26-6a1cc683c601/b770092a-1ce0-5014-9f26-6a1cc683c601_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 210382,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b770092a-1ce0-5014-9f26-6a1cc683c601/b770092a-1ce0-5014-9f26-6a1cc683c601_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 270972,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b770092a-1ce0-5014-9f26-6a1cc683c601/b770092a-1ce0-5014-9f26-6a1cc683c601_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 224444,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b770092a-1ce0-5014-9f26-6a1cc683c601/b770092a-1ce0-5014-9f26-6a1cc683c601_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 246446,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b770092a-1ce0-5014-9f26-6a1cc683c601/b770092a-1ce0-5014-9f26-6a1cc683c601_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 159162,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/10bdb0b2-44a2-4e7c-b78a-86d4f3ba1271_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b770092a-1ce0-5014-9f26-6a1cc683c601/b770092a-1ce0-5014-9f26-6a1cc683c601_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 348924,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3377309-4008333-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b770092a-1ce0-5014-9f26-6a1cc683c601/b770092a-1ce0-5014-9f26-6a1cc683c601_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 277813,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3377309-4008333-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b770092a-1ce0-5014-9f26-6a1cc683c601/b770092a-1ce0-5014-9f26-6a1cc683c601_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 179685,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3377309-4008333-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b770092a-1ce0-5014-9f26-6a1cc683c601/b770092a-1ce0-5014-9f26-6a1cc683c601_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 240135,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3377309-4008333-1002.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-22',
 'seller_name': 'Lloyd Motor Group',
 'title': 'CITROEN C3 1.2 PureTech Shine 5dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech Shine 5dr',
 'year': 2021}
2025-12-05 06:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273377309%27 HTTP/1.1" 200 None
2025-12-05 06:07:55 [manheim.gb] INFO: Saving data for 3377309: {'created_time': 1764914875.494567, 'last_price_update_time': 1764914875.494578, 'auction_closing_time': 1765184400.0}
2025-12-05 06:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3377309') HTTP/1.1" 204 0
2025-12-05 06:07:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/KIA/SPORTAGE?id=3331358&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233331358&indx=192> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:07:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:07:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b87fc71-453b-5a1f-aa37-712fdbbc99e1 with identifier: 3331358
2025-12-05 06:07:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b87fc71-453b-5a1f-aa37-712fdbbc99e1 with scrape type 2
2025-12-05 06:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0b87fc71-453b-5a1f-aa37-712fdbbc99e1 with scrape type 2
2025-12-05 06:07:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 0b87fc71-453b-5a1f-aa37-712fdbbc99e1, identifier: 3331358
2025-12-05 06:07:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 0b87fc71-453b-5a1f-aa37-712fdbbc99e1 with identifier: 3331358
2025-12-05 06:07:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 0b87fc71-453b-5a1f-aa37-712fdbbc99e1 with identifier: 3331358
2025-12-05 06:07:57 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 0b87fc71-453b-5a1f-aa37-712fdbbc99e1 with identifier: 3331358 to the API
2025-12-05 06:07:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 06:07:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 06:07:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/KIA/SPORTAGE?id=3331358&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233331358&indx=192>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003331358-01968284-005.pdf',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Petrol/Hybrid',
 'id': '0b87fc71-453b-5a1f-aa37-712fdbbc99e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'ML73PNY',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/KIA/SPORTAGE?id=3331358',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'KIA',
 'model': 'SPORTAGE',
 'odometer': 23964,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-09-25',
 'seller_name': 'FCA Group',
 'title': 'KIA SPORTAGE 1.6T GDi HEV GT-Line 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.6T GDi HEV GT-Line 5dr Auto',
 'year': 2023}
2025-12-05 06:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273331358%27 HTTP/1.1" 200 None
2025-12-05 06:07:57 [manheim.gb] INFO: Saving data for 3331358: {'auction_closing_time': 1765184400.0, 'created_time': 1764792311.816407, 'last_price_update_time': 1764914877.226083}
2025-12-05 06:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3331358') HTTP/1.1" 204 0
2025-12-05 06:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/JEEP/COMPASS?id=3300121&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233300121&indx=187> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:07:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:07:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24d28cde-02e8-5cff-89aa-927884884bd9 with identifier: 3300121
2025-12-05 06:07:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24d28cde-02e8-5cff-89aa-927884884bd9 with scrape type 2
2025-12-05 06:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 24d28cde-02e8-5cff-89aa-927884884bd9 with scrape type 2
2025-12-05 06:07:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 24d28cde-02e8-5cff-89aa-927884884bd9, identifier: 3300121
2025-12-05 06:07:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 24d28cde-02e8-5cff-89aa-927884884bd9 with identifier: 3300121
2025-12-05 06:07:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 24d28cde-02e8-5cff-89aa-927884884bd9 with identifier: 3300121
2025-12-05 06:07:57 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 24d28cde-02e8-5cff-89aa-927884884bd9 with identifier: 3300121 to the API
2025-12-05 06:07:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 06:07:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 06:07:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/JEEP/COMPASS?id=3300121&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233300121&indx=187>
{'auction_title': '',
 'c_o_2_emission_value': 172,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003300121-01973233-003.pdf',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.4L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '24d28cde-02e8-5cff-89aa-927884884bd9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'BX70TFO',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/JEEP/COMPASS?id=3300121',
 'listing': 'auction',
 'location': 'Bristol',
 'make': 'JEEP',
 'model': 'COMPASS',
 'odometer': 34767,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-01',
 'seller_name': 'Leasys',
 'title': 'JEEP COMPASS 1.4 Multiair 140 Night Eagle 5dr [2WD]',
 'transmission': 'manual',
 'trim': '1.4 Multiair 140 Night Eagle 5dr [2WD]',
 'year': 2020}
2025-12-05 06:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273300121%27 HTTP/1.1" 200 None
2025-12-05 06:07:57 [manheim.gb] INFO: Saving data for 3300121: {'auction_closing_time': 1765270800.0, 'created_time': 1764792354.933586, 'last_price_update_time': 1764914877.81201}
2025-12-05 06:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3300121') HTTP/1.1" 204 0
2025-12-05 06:08:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/TESLA/MODEL?id=3318690&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233318690&indx=191> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:08:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:08:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71bb103b-33bb-55fe-a814-bc306d56658e with identifier: 3318690
2025-12-05 06:08:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71bb103b-33bb-55fe-a814-bc306d56658e with scrape type 2
2025-12-05 06:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71bb103b-33bb-55fe-a814-bc306d56658e with scrape type 2
2025-12-05 06:08:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 71bb103b-33bb-55fe-a814-bc306d56658e, identifier: 3318690
2025-12-05 06:08:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 71bb103b-33bb-55fe-a814-bc306d56658e with identifier: 3318690
2025-12-05 06:08:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 71bb103b-33bb-55fe-a814-bc306d56658e with identifier: 3318690
2025-12-05 06:08:00 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 71bb103b-33bb-55fe-a814-bc306d56658e with identifier: 3318690 to the API
2025-12-05 06:08:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 06:08:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 06:08:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/TESLA/MODEL?id=3318690&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233318690&indx=191>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003318690-01979457-005.pdf',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '0.0L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Electric',
 'id': '71bb103b-33bb-55fe-a814-bc306d56658e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'SH71EYF',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/TESLA/MODEL?id=3318690',
 'listing': 'auction',
 'location': 'Bristol',
 'make': 'TESLA',
 'model': 'MODEL',
 'odometer': 40027,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-21',
 'seller_name': 'Novuna Vehicle Solutions',
 'title': 'TESLA MODEL Long Range AWD 4dr Auto',
 'transmission': 'automatic',
 'trim': 'Long Range AWD 4dr Auto',
 'year': 2021}
2025-12-05 06:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273318690%27 HTTP/1.1" 200 None
2025-12-05 06:08:01 [manheim.gb] INFO: Saving data for 3318690: {'auction_closing_time': 1765270800.0, 'created_time': 1764792354.563977, 'last_price_update_time': 1764914881.881543}
2025-12-05 06:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3318690') HTTP/1.1" 204 0
2025-12-05 06:08:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/AUDI/A7?id=3292131&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233292131&indx=186> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:08:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/KIA/SPORTAGE?id=3303034&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233303034&indx=188> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:08:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:08:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:08:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1473f10a-e80c-53b5-bb85-c4b003e71ec0 with identifier: 3292131
2025-12-05 06:08:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1473f10a-e80c-53b5-bb85-c4b003e71ec0 with scrape type 2
2025-12-05 06:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1473f10a-e80c-53b5-bb85-c4b003e71ec0 with scrape type 2
2025-12-05 06:08:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 1473f10a-e80c-53b5-bb85-c4b003e71ec0, identifier: 3292131
2025-12-05 06:08:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 1473f10a-e80c-53b5-bb85-c4b003e71ec0 with identifier: 3292131
2025-12-05 06:08:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 1473f10a-e80c-53b5-bb85-c4b003e71ec0 with identifier: 3292131
2025-12-05 06:08:02 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': False, 'title': 'audi a7 3.0 tdi quattro s line 5dr s tronic [5 seat]', 'price': 0, 'currency': 'gbp', 'make': 'audi', 'model': 'a7', 'transmission': 'automatic', 'engine': '3.0l', 'fuel_type': 'diesel', 'odometer': 140182, 'odometer_reading_unit': 'mi', 'registration_date': '2014-09-26', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/audi/a7?id=3292131', 'location': 'birmingham', 'origin_country_code': 'gb', 'trim': '3.0 tdi quattro s line 5dr s tronic [5 seat]', 'license_plate': 'wr64kwg', 'year': 2014, 'listing': 'auction', 'c_o_2_emission_value': 156, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0003292131-01986678-003.pdf', 'expiration_date': '2025-12-08t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': '1473f10a-e80c-53b5-bb85-c4b003e71ec0', 'current_year_diff': 11, 'age_in_months': 134, 'make_model': 'audi a7', 'sanitized_make': 'audi', 'odometer_in_km': 225600}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 134,
     'auction_title': '',
     'c_o_2_emission_value': 156,
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0003292131-01986678-003.pdf',
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 11,
     'engine': '3.0l',
     'expiration_date': '2025-12-08t09:00:00z',
     'fuel_type': 'diesel',
     'id': '1473f10a-e80c-53b5-bb85-c4b003e71ec0',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'wr64kwg',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/audi/a7?id=3292131',
     'listing': 'auction',
     'location': 'birmingham',
     'make': 'audi',
     'make_model': 'audi a7',
     'model': 'a7',
     'odometer': 140182,
     'odometer_in_km': 225600,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2014-09-26',
     'sanitized_make': 'audi',
     'seller_name': None,
     'title': 'audi a7 3.0 tdi quattro s line 5dr s tronic [5 seat]',
     'transmission': 'automatic',
     'trim': '3.0 tdi quattro s line 5dr s tronic [5 seat]',
     'year': 2014}
2025-12-05 06:08:02 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 1473f10a-e80c-53b5-bb85-c4b003e71ec0 spider: manheim.gb
2025-12-05 06:08:02 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 1473f10a-e80c-53b5-bb85-c4b003e71ec0 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': False, 'title': 'audi a7 3.0 tdi quattro s line 5dr s tronic [5 seat]', 'price': 0, 'currency': 'gbp', 'make': 'audi', 'model': 'a7', 'transmission': 'automatic', 'engine': '3.0l', 'fuel_type': 'diesel', 'odometer': 140182, 'odometer_reading_unit': 'mi', 'registration_date': '2014-09-26', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/audi/a7?id=3292131', 'location': 'birmingham', 'origin_country_code': 'gb', 'trim': '3.0 tdi quattro s line 5dr s tronic [5 seat]', 'license_plate': 'wr64kwg', 'year': 2014, 'listing': 'auction', 'c_o_2_emission_value': 156, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0003292131-01986678-003.pdf', 'expiration_date': '2025-12-08t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': '1473f10a-e80c-53b5-bb85-c4b003e71ec0', 'current_year_diff': 11, 'age_in_months': 134, 'make_model': 'audi a7', 'sanitized_make': 'audi', 'odometer_in_km': 225600}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 134,
     'auction_title': '',
     'c_o_2_emission_value': 156,
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0003292131-01986678-003.pdf',
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 11,
     'engine': '3.0l',
     'expiration_date': '2025-12-08t09:00:00z',
     'fuel_type': 'diesel',
     'id': '1473f10a-e80c-53b5-bb85-c4b003e71ec0',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'wr64kwg',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/audi/a7?id=3292131',
     'listing': 'auction',
     'location': 'birmingham',
     'make': 'audi',
     'make_model': 'audi a7',
     'model': 'a7',
     'odometer': 140182,
     'odometer_in_km': 225600,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2014-09-26',
     'sanitized_make': 'audi',
     'seller_name': None,
     'title': 'audi a7 3.0 tdi quattro s line 5dr s tronic [5 seat]',
     'transmission': 'automatic',
     'trim': '3.0 tdi quattro s line 5dr s tronic [5 seat]',
     'year': 2014}
{'auction_title': '',
 'c_o_2_emission_value': 156,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003292131-01986678-003.pdf',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '3.0L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '1473f10a-e80c-53b5-bb85-c4b003e71ec0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'WR64KWG',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/AUDI/A7?id=3292131',
 'listing': 'auction',
 'location': 'Birmingham',
 'make': 'AUDI',
 'model': 'A7',
 'odometer': 140182,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-26',
 'seller_name': None,
 'title': 'AUDI A7 3.0 TDI Quattro S Line 5dr S Tronic [5 Seat]',
 'transmission': 'automatic',
 'trim': '3.0 TDI Quattro S Line 5dr S Tronic [5 Seat]',
 'year': 2014}
2025-12-05 06:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273292131%27 HTTP/1.1" 200 None
2025-12-05 06:08:02 [manheim.gb] INFO: Saving data for 3292131: {'auction_closing_time': 1765184400.0, 'created_time': 1764792398.077415, 'last_price_update_time': 1764914882.355942}
2025-12-05 06:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3292131') HTTP/1.1" 204 0
2025-12-05 06:08:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e6d270e-d071-54b9-9c05-85f90b378f32 with identifier: 3303034
2025-12-05 06:08:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e6d270e-d071-54b9-9c05-85f90b378f32 with scrape type 2
2025-12-05 06:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e6d270e-d071-54b9-9c05-85f90b378f32 with scrape type 2
2025-12-05 06:08:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 5e6d270e-d071-54b9-9c05-85f90b378f32, identifier: 3303034
2025-12-05 06:08:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 5e6d270e-d071-54b9-9c05-85f90b378f32 with identifier: 3303034
2025-12-05 06:08:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 5e6d270e-d071-54b9-9c05-85f90b378f32 with identifier: 3303034
2025-12-05 06:08:02 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 11 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    11
2025-12-05 06:08:02 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: 5e6d270e-d071-54b9-9c05-85f90b378f32 spider: manheim.gb
2025-12-05 06:08:02 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 5e6d270e-d071-54b9-9c05-85f90b378f32 due to rule: registration_date_old.json, error: 11 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    11
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003303034-01989772-004.pdf',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.7L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '5e6d270e-d071-54b9-9c05-85f90b378f32',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'FG14KUR',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/KIA/SPORTAGE?id=3303034',
 'listing': 'auction',
 'location': 'Washington',
 'make': 'KIA',
 'model': 'SPORTAGE',
 'odometer': 91414,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-18',
 'seller_name': 'MotoNovo Finance',
 'title': 'KIA SPORTAGE 1.7 CRDi ISG 1 5dr',
 'transmission': 'manual',
 'trim': '1.7 CRDi ISG 1 5dr',
 'year': 2014}
2025-12-05 06:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273303034%27 HTTP/1.1" 200 None
2025-12-05 06:08:02 [manheim.gb] INFO: Saving data for 3303034: {'auction_closing_time': 1765184400.0, 'created_time': 1764792357.54382, 'last_price_update_time': 1764914882.736448}
2025-12-05 06:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3303034') HTTP/1.1" 204 0
2025-12-05 06:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VAUXHALL/CORSA?id=3290272&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233290272&indx=185> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:08:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:08:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f51048b-6e4b-575c-a2ca-3534f4cca3f6 with identifier: 3290272
2025-12-05 06:08:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f51048b-6e4b-575c-a2ca-3534f4cca3f6 with scrape type 2
2025-12-05 06:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f51048b-6e4b-575c-a2ca-3534f4cca3f6 with scrape type 2
2025-12-05 06:08:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 8f51048b-6e4b-575c-a2ca-3534f4cca3f6, identifier: 3290272
2025-12-05 06:08:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 8f51048b-6e4b-575c-a2ca-3534f4cca3f6 with identifier: 3290272
2025-12-05 06:08:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 8f51048b-6e4b-575c-a2ca-3534f4cca3f6 with identifier: 3290272
2025-12-05 06:08:16 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 8f51048b-6e4b-575c-a2ca-3534f4cca3f6 with identifier: 3290272 to the API
2025-12-05 06:08:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 06:08:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 06:08:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/VAUXHALL/CORSA?id=3290272&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233290272&indx=185>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003290272-01899755-009.pdf',
 'color': 'RED',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '8f51048b-6e4b-575c-a2ca-3534f4cca3f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'DE20XMX',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VAUXHALL/CORSA?id=3290272',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'VAUXHALL',
 'model': 'CORSA',
 'odometer': 46545,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-20',
 'seller_name': 'FCA Group',
 'title': 'VAUXHALL CORSA 1.2 Turbo Elite Nav 5dr',
 'transmission': 'manual',
 'trim': '1.2 Turbo Elite Nav 5dr',
 'year': 2020}
2025-12-05 06:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273290272%27 HTTP/1.1" 200 None
2025-12-05 06:08:17 [manheim.gb] INFO: Saving data for 3290272: {'auction_closing_time': 1765184400.0, 'created_time': 1764792401.182518, 'last_price_update_time': 1764914897.032795}
2025-12-05 06:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3290272') HTTP/1.1" 204 0
2025-12-05 06:08:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/FORD/KUGA?id=3288325&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233288325&indx=184> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:08:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:08:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 057239e4-b67b-5a5c-9cad-0120ea22f635 with identifier: 3288325
2025-12-05 06:08:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 057239e4-b67b-5a5c-9cad-0120ea22f635 with scrape type 2
2025-12-05 06:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 057239e4-b67b-5a5c-9cad-0120ea22f635 with scrape type 2
2025-12-05 06:08:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 057239e4-b67b-5a5c-9cad-0120ea22f635, identifier: 3288325
2025-12-05 06:08:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 057239e4-b67b-5a5c-9cad-0120ea22f635 with identifier: 3288325
2025-12-05 06:08:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 06:08:22 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Blue HTTP/1.1" 200 None
2025-12-05 06:08:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 06:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 06:08:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 057239e4-b67b-5a5c-9cad-0120ea22f635 with identifier: 3288325
2025-12-05 06:08:22 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 057239e4-b67b-5a5c-9cad-0120ea22f635 with identifier: 3288325 to the API
2025-12-05 06:08:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 06:08:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 06:08:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/FORD/KUGA?id=3288325&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233288325&indx=184>
{'auction_title': '',
 'c_o_2_emission_value': 164,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003288325-01987461-003.pdf',
 'color': 'Blue',
 'currency': 'GBP',
 'engine': '1.5L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '057239e4-b67b-5a5c-9cad-0120ea22f635',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'FE69JSZ',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FORD/KUGA?id=3288325',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'FORD',
 'model': 'KUGA',
 'odometer': 67528,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-09',
 'seller_name': 'Big Motoring World Ltd',
 'title': 'FORD KUGA 1.5 EcoBoost ST-Line 5dr 2WD',
 'transmission': 'manual',
 'trim': '1.5 EcoBoost ST-Line 5dr 2WD',
 'year': 2019}
2025-12-05 06:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273288325%27 HTTP/1.1" 200 None
2025-12-05 06:08:23 [manheim.gb] INFO: Saving data for 3288325: {'auction_closing_time': 1765270800.0, 'created_time': 1764792401.696652, 'last_price_update_time': 1764914903.550997}
2025-12-05 06:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3288325') HTTP/1.1" 204 0
2025-12-05 06:08:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/PEUGEOT/3008?id=3256779&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233256779&indx=179> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:08:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:08:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69934e4a-46a9-5f37-953d-5d0cc219f8ff with identifier: 3256779
2025-12-05 06:08:23 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 69934e4a-46a9-5f37-953d-5d0cc219f8ff
2025-12-05 06:08:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/HYUNDAI/KONA?id=3252975&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233252975&indx=178> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:08:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:08:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15cff8ab-999c-5277-a525-94dd58c15952 with identifier: 3252975
2025-12-05 06:08:25 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 15cff8ab-999c-5277-a525-94dd58c15952
2025-12-05 06:08:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003256779-01949620-014.pdf> (referer: None)
2025-12-05 06:08:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:08:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:08:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:08:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425c4950>
2025-12-05 06:08:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:08:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:08:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 06:08:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:08:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:08:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:08:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69934e4a-46a9-5f37-953d-5d0cc219f8ff/69934e4a-46a9-5f37-953d-5d0cc219f8ff_expert_report_file_839f2847-8cb8-4435-8bec-d7275f059230.pdf HTTP/1.1" 201 0
2025-12-05 06:08:26 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 69934e4a-46a9-5f37-953d-5d0cc219f8ff
2025-12-05 06:08:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 69934e4a-46a9-5f37-953d-5d0cc219f8ff, skipping ID generation
2025-12-05 06:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 69934e4a-46a9-5f37-953d-5d0cc219f8ff
2025-12-05 06:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F603eb55c-6ba5-4cc0-8607-307930aa0f3e_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/603eb55c-6ba5-4cc0-8607-307930aa0f3e_ext_7.jpg already downloaded
2025-12-05 06:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F603eb55c-6ba5-4cc0-8607-307930aa0f3e_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/603eb55c-6ba5-4cc0-8607-307930aa0f3e_ext_7.jpg already downloaded
2025-12-05 06:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F603eb55c-6ba5-4cc0-8607-307930aa0f3e_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/603eb55c-6ba5-4cc0-8607-307930aa0f3e_ext_6.jpg already downloaded
2025-12-05 06:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F603eb55c-6ba5-4cc0-8607-307930aa0f3e_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/603eb55c-6ba5-4cc0-8607-307930aa0f3e_ext_1.jpg already downloaded
2025-12-05 06:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F603eb55c-6ba5-4cc0-8607-307930aa0f3e_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/603eb55c-6ba5-4cc0-8607-307930aa0f3e_5.jpg already downloaded
2025-12-05 06:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F603eb55c-6ba5-4cc0-8607-307930aa0f3e_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/603eb55c-6ba5-4cc0-8607-307930aa0f3e_4.jpg already downloaded
2025-12-05 06:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F603eb55c-6ba5-4cc0-8607-307930aa0f3e_11.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/603eb55c-6ba5-4cc0-8607-307930aa0f3e_11.jpg already downloaded
2025-12-05 06:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F603eb55c-6ba5-4cc0-8607-307930aa0f3e_10.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/603eb55c-6ba5-4cc0-8607-307930aa0f3e_10.jpg already downloaded
2025-12-05 06:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F603eb55c-6ba5-4cc0-8607-307930aa0f3e_9.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/603eb55c-6ba5-4cc0-8607-307930aa0f3e_9.jpg already downloaded
2025-12-05 06:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F603eb55c-6ba5-4cc0-8607-307930aa0f3e_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/603eb55c-6ba5-4cc0-8607-307930aa0f3e_ext_2.jpg already downloaded
2025-12-05 06:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F603eb55c-6ba5-4cc0-8607-307930aa0f3e_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/603eb55c-6ba5-4cc0-8607-307930aa0f3e_ext_5.jpg already downloaded
2025-12-05 06:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F603eb55c-6ba5-4cc0-8607-307930aa0f3e_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/603eb55c-6ba5-4cc0-8607-307930aa0f3e_ext_3.jpg already downloaded
2025-12-05 06:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F603eb55c-6ba5-4cc0-8607-307930aa0f3e_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/603eb55c-6ba5-4cc0-8607-307930aa0f3e_ext_4.jpg already downloaded
2025-12-05 06:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3256779-3979420-13.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3256779-3979420-13.jpg already downloaded
2025-12-05 06:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3256779-3979420-1000.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3256779-3979420-1000.jpg already downloaded
2025-12-05 06:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3256779-3979420-1001.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3256779-3979420-1001.jpg already downloaded
2025-12-05 06:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3256779-3979420-1002.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3256779-3979420-1002.jpg already downloaded
2025-12-05 06:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3256779-3979420-1003.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3256779-3979420-1003.jpg already downloaded
2025-12-05 06:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3256779-3979420-1004.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3256779-3979420-1004.jpg already downloaded
2025-12-05 06:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3256779-3979420-1005.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3256779-3979420-1005.jpg already downloaded
2025-12-05 06:08:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 69934e4a-46a9-5f37-953d-5d0cc219f8ff, identifier: 3256779
2025-12-05 06:08:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 69934e4a-46a9-5f37-953d-5d0cc219f8ff with identifier: 3256779
2025-12-05 06:08:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 69934e4a-46a9-5f37-953d-5d0cc219f8ff with identifier: 3256779
2025-12-05 06:08:27 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 130871 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    130871
2025-12-05 06:08:27 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 69934e4a-46a9-5f37-953d-5d0cc219f8ff spider: manheim.gb
2025-12-05 06:08:27 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 69934e4a-46a9-5f37-953d-5d0cc219f8ff due to rule: high_mileage_for_make.json, error: 130871 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    130871
{'auction_title': '',
 'c_o_2_emission_value': 31,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69934e4a-46a9-5f37-953d-5d0cc219f8ff/69934e4a-46a9-5f37-953d-5d0cc219f8ff_expert_report_file_839f2847-8cb8-4435-8bec-d7275f059230.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003256779-01949620-014.pdf',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Petrol/Hybrid',
 'id': '69934e4a-46a9-5f37-953d-5d0cc219f8ff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'YF20HPX',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/PEUGEOT/3008?id=3256779',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 81320,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 26,
 'photo_urls': ['http://images.manheim.co.uk/images/units/zoom/603eb55c-6ba5-4cc0-8607-307930aa0f3e_ext_7.jpg',
                'http://images.manheim.co.uk/images/units/zoom/603eb55c-6ba5-4cc0-8607-307930aa0f3e_ext_7.jpg',
                'http://images.manheim.co.uk/images/units/zoom/603eb55c-6ba5-4cc0-8607-307930aa0f3e_ext_6.jpg',
                'http://images.manheim.co.uk/images/units/zoom/603eb55c-6ba5-4cc0-8607-307930aa0f3e_ext_1.jpg',
                'http://images.manheim.co.uk/images/units/zoom/603eb55c-6ba5-4cc0-8607-307930aa0f3e_5.jpg',
                'http://images.manheim.co.uk/images/units/zoom/603eb55c-6ba5-4cc0-8607-307930aa0f3e_4.jpg',
                'http://images.manheim.co.uk/images/units/zoom/603eb55c-6ba5-4cc0-8607-307930aa0f3e_11.jpg',
                'http://images.manheim.co.uk/images/units/zoom/603eb55c-6ba5-4cc0-8607-307930aa0f3e_10.jpg',
                'http://images.manheim.co.uk/images/units/zoom/603eb55c-6ba5-4cc0-8607-307930aa0f3e_9.jpg',
                'http://images.manheim.co.uk/images/units/zoom/603eb55c-6ba5-4cc0-8607-307930aa0f3e_ext_2.jpg',
                'http://images.manheim.co.uk/images/units/zoom/603eb55c-6ba5-4cc0-8607-307930aa0f3e_ext_5.jpg',
                'http://images.manheim.co.uk/images/units/zoom/603eb55c-6ba5-4cc0-8607-307930aa0f3e_ext_3.jpg',
                'http://images.manheim.co.uk/images/units/zoom/603eb55c-6ba5-4cc0-8607-307930aa0f3e_ext_4.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3256779-3979420-13.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3256779-3979420-1000.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3256779-3979420-1001.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3256779-3979420-1002.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3256779-3979420-1003.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3256779-3979420-1004.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3256779-3979420-1005.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69934e4a-46a9-5f37-953d-5d0cc219f8ff/69934e4a-46a9-5f37-953d-5d0cc219f8ff_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 176441,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/603eb55c-6ba5-4cc0-8607-307930aa0f3e_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69934e4a-46a9-5f37-953d-5d0cc219f8ff/69934e4a-46a9-5f37-953d-5d0cc219f8ff_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 176441,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/603eb55c-6ba5-4cc0-8607-307930aa0f3e_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69934e4a-46a9-5f37-953d-5d0cc219f8ff/69934e4a-46a9-5f37-953d-5d0cc219f8ff_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 290381,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/603eb55c-6ba5-4cc0-8607-307930aa0f3e_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69934e4a-46a9-5f37-953d-5d0cc219f8ff/69934e4a-46a9-5f37-953d-5d0cc219f8ff_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 186281,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/603eb55c-6ba5-4cc0-8607-307930aa0f3e_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69934e4a-46a9-5f37-953d-5d0cc219f8ff/69934e4a-46a9-5f37-953d-5d0cc219f8ff_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 164375,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/603eb55c-6ba5-4cc0-8607-307930aa0f3e_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69934e4a-46a9-5f37-953d-5d0cc219f8ff/69934e4a-46a9-5f37-953d-5d0cc219f8ff_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 161160,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/603eb55c-6ba5-4cc0-8607-307930aa0f3e_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69934e4a-46a9-5f37-953d-5d0cc219f8ff/69934e4a-46a9-5f37-953d-5d0cc219f8ff_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 160984,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/603eb55c-6ba5-4cc0-8607-307930aa0f3e_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69934e4a-46a9-5f37-953d-5d0cc219f8ff/69934e4a-46a9-5f37-953d-5d0cc219f8ff_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 152597,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/603eb55c-6ba5-4cc0-8607-307930aa0f3e_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69934e4a-46a9-5f37-953d-5d0cc219f8ff/69934e4a-46a9-5f37-953d-5d0cc219f8ff_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 165127,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/603eb55c-6ba5-4cc0-8607-307930aa0f3e_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69934e4a-46a9-5f37-953d-5d0cc219f8ff/69934e4a-46a9-5f37-953d-5d0cc219f8ff_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 299903,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/603eb55c-6ba5-4cc0-8607-307930aa0f3e_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69934e4a-46a9-5f37-953d-5d0cc219f8ff/69934e4a-46a9-5f37-953d-5d0cc219f8ff_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 262872,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/603eb55c-6ba5-4cc0-8607-307930aa0f3e_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69934e4a-46a9-5f37-953d-5d0cc219f8ff/69934e4a-46a9-5f37-953d-5d0cc219f8ff_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 263133,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/603eb55c-6ba5-4cc0-8607-307930aa0f3e_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69934e4a-46a9-5f37-953d-5d0cc219f8ff/69934e4a-46a9-5f37-953d-5d0cc219f8ff_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257779,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/603eb55c-6ba5-4cc0-8607-307930aa0f3e_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69934e4a-46a9-5f37-953d-5d0cc219f8ff/69934e4a-46a9-5f37-953d-5d0cc219f8ff_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 334525,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3256779-3979420-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69934e4a-46a9-5f37-953d-5d0cc219f8ff/69934e4a-46a9-5f37-953d-5d0cc219f8ff_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 349540,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3256779-3979420-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69934e4a-46a9-5f37-953d-5d0cc219f8ff/69934e4a-46a9-5f37-953d-5d0cc219f8ff_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 344548,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3256779-3979420-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69934e4a-46a9-5f37-953d-5d0cc219f8ff/69934e4a-46a9-5f37-953d-5d0cc219f8ff_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 178624,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3256779-3979420-1002.jpg',
             'Width': 749},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69934e4a-46a9-5f37-953d-5d0cc219f8ff/69934e4a-46a9-5f37-953d-5d0cc219f8ff_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 313595,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3256779-3979420-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69934e4a-46a9-5f37-953d-5d0cc219f8ff/69934e4a-46a9-5f37-953d-5d0cc219f8ff_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 228113,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3256779-3979420-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69934e4a-46a9-5f37-953d-5d0cc219f8ff/69934e4a-46a9-5f37-953d-5d0cc219f8ff_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 263728,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3256779-3979420-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-17',
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.6 Hybrid 225 GT Line 5dr e-EAT8',
 'transmission': 'automatic',
 'trim': '1.6 Hybrid 225 GT Line 5dr e-EAT8',
 'year': 2020}
2025-12-05 06:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273256779%27 HTTP/1.1" 200 None
2025-12-05 06:08:27 [manheim.gb] INFO: Saving data for 3256779: {'created_time': 1764914907.618342, 'last_price_update_time': 1764914907.618358, 'auction_closing_time': 1765270800.0}
2025-12-05 06:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3256779') HTTP/1.1" 204 0
2025-12-05 06:08:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=3272956&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233272956&indx=182> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:08:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:08:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003252975-01985223-004.pdf> (referer: None)
2025-12-05 06:08:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db3b829a-0593-5269-b60c-32959218c484 with identifier: 3272956
2025-12-05 06:08:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db3b829a-0593-5269-b60c-32959218c484 with scrape type 2
2025-12-05 06:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db3b829a-0593-5269-b60c-32959218c484 with scrape type 2
2025-12-05 06:08:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: db3b829a-0593-5269-b60c-32959218c484, identifier: 3272956
2025-12-05 06:08:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: db3b829a-0593-5269-b60c-32959218c484 with identifier: 3272956
2025-12-05 06:08:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: db3b829a-0593-5269-b60c-32959218c484 with identifier: 3272956
2025-12-05 06:08:27 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 0, 'seller_name': 'croyland car megastore', 'price_includes_vat': False, 'title': 'nissan qashqai 1.5 dci 115 n-connecta 5dr', 'price': 0, 'currency': 'gbp', 'make': 'nissan', 'model': 'qashqai', 'transmission': 'manual', 'engine': '1.5l', 'fuel_type': 'diesel', 'odometer': 135782, 'odometer_reading_unit': 'mi', 'registration_date': '2019-01-14', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/nissan/qashqai?id=3272956', 'location': 'northampton', 'origin_country_code': 'gb', 'trim': '1.5 dci 115 n-connecta 5dr', 'license_plate': 'bl68ufh', 'year': 2019, 'listing': 'auction', 'c_o_2_emission_value': 110, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0003272956-01987297-003.pdf', 'expiration_date': '2025-12-09t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': 'db3b829a-0593-5269-b60c-32959218c484', 'current_year_diff': 6, 'age_in_months': 82, 'make_model': 'nissan qashqai', 'sanitized_make': 'nissan', 'odometer_in_km': 218519}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 82,
     'auction_title': '',
     'c_o_2_emission_value': 110,
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0003272956-01987297-003.pdf',
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 6,
     'engine': '1.5l',
     'expiration_date': '2025-12-09t09:00:00z',
     'fuel_type': 'diesel',
     'id': 'db3b829a-0593-5269-b60c-32959218c484',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'bl68ufh',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/nissan/qashqai?id=3272956',
     'listing': 'auction',
     'location': 'northampton',
     'make': 'nissan',
     'make_model': 'nissan qashqai',
     'model': 'qashqai',
     'odometer': 135782,
     'odometer_in_km': 218519,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2019-01-14',
     'sanitized_make': 'nissan',
     'seller_name': 'croyland car megastore',
     'title': 'nissan qashqai 1.5 dci 115 n-connecta 5dr',
     'transmission': 'manual',
     'trim': '1.5 dci 115 n-connecta 5dr',
     'year': 2019}
2025-12-05 06:08:27 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: db3b829a-0593-5269-b60c-32959218c484 spider: manheim.gb
2025-12-05 06:08:28 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: db3b829a-0593-5269-b60c-32959218c484 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 0, 'seller_name': 'croyland car megastore', 'price_includes_vat': False, 'title': 'nissan qashqai 1.5 dci 115 n-connecta 5dr', 'price': 0, 'currency': 'gbp', 'make': 'nissan', 'model': 'qashqai', 'transmission': 'manual', 'engine': '1.5l', 'fuel_type': 'diesel', 'odometer': 135782, 'odometer_reading_unit': 'mi', 'registration_date': '2019-01-14', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/nissan/qashqai?id=3272956', 'location': 'northampton', 'origin_country_code': 'gb', 'trim': '1.5 dci 115 n-connecta 5dr', 'license_plate': 'bl68ufh', 'year': 2019, 'listing': 'auction', 'c_o_2_emission_value': 110, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0003272956-01987297-003.pdf', 'expiration_date': '2025-12-09t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': 'db3b829a-0593-5269-b60c-32959218c484', 'current_year_diff': 6, 'age_in_months': 82, 'make_model': 'nissan qashqai', 'sanitized_make': 'nissan', 'odometer_in_km': 218519}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 82,
     'auction_title': '',
     'c_o_2_emission_value': 110,
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0003272956-01987297-003.pdf',
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 6,
     'engine': '1.5l',
     'expiration_date': '2025-12-09t09:00:00z',
     'fuel_type': 'diesel',
     'id': 'db3b829a-0593-5269-b60c-32959218c484',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'bl68ufh',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/nissan/qashqai?id=3272956',
     'listing': 'auction',
     'location': 'northampton',
     'make': 'nissan',
     'make_model': 'nissan qashqai',
     'model': 'qashqai',
     'odometer': 135782,
     'odometer_in_km': 218519,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2019-01-14',
     'sanitized_make': 'nissan',
     'seller_name': 'croyland car megastore',
     'title': 'nissan qashqai 1.5 dci 115 n-connecta 5dr',
     'transmission': 'manual',
     'trim': '1.5 dci 115 n-connecta 5dr',
     'year': 2019}
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003272956-01987297-003.pdf',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '1.5L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'db3b829a-0593-5269-b60c-32959218c484',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'BL68UFH',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=3272956',
 'listing': 'auction',
 'location': 'Northampton',
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 135782,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-14',
 'seller_name': 'Croyland Car Megastore',
 'title': 'NISSAN QASHQAI 1.5 dCi 115 N-Connecta 5dr',
 'transmission': 'manual',
 'trim': '1.5 dCi 115 N-Connecta 5dr',
 'year': 2019}
2025-12-05 06:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273272956%27 HTTP/1.1" 200 None
2025-12-05 06:08:28 [manheim.gb] INFO: Saving data for 3272956: {'auction_closing_time': 1765270800.0, 'created_time': 1764792397.829461, 'last_price_update_time': 1764914908.099489}
2025-12-05 06:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3272956') HTTP/1.1" 204 0
2025-12-05 06:08:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=3267329&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233267329&indx=181> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:08:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:08:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:08:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:08:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:08:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23426db650>
2025-12-05 06:08:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:08:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:08:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:08:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:08:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_expert_report_file_6eb54a6b-101a-4189-9d8a-abd49b692191.pdf HTTP/1.1" 201 0
2025-12-05 06:08:28 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 15cff8ab-999c-5277-a525-94dd58c15952
2025-12-05 06:08:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 15cff8ab-999c-5277-a525-94dd58c15952, skipping ID generation
2025-12-05 06:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 15cff8ab-999c-5277-a525-94dd58c15952
2025-12-05 06:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbdb94328-4ee7-4c88-9f79-918553802f24_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_ext_7.jpg not downloaded yet
2025-12-05 06:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbdb94328-4ee7-4c88-9f79-918553802f24_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_ext_7.jpg not downloaded yet
2025-12-05 06:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbdb94328-4ee7-4c88-9f79-918553802f24_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_ext_6.jpg not downloaded yet
2025-12-05 06:08:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20bedaec-e4d7-587e-9f56-f3565efe352f with identifier: 3267329
2025-12-05 06:08:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20bedaec-e4d7-587e-9f56-f3565efe352f with scrape type 2
2025-12-05 06:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20bedaec-e4d7-587e-9f56-f3565efe352f with scrape type 2
2025-12-05 06:08:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 20bedaec-e4d7-587e-9f56-f3565efe352f, identifier: 3267329
2025-12-05 06:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbdb94328-4ee7-4c88-9f79-918553802f24_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_ext_1.jpg not downloaded yet
2025-12-05 06:08:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 20bedaec-e4d7-587e-9f56-f3565efe352f with identifier: 3267329
2025-12-05 06:08:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 20bedaec-e4d7-587e-9f56-f3565efe352f with identifier: 3267329
2025-12-05 06:08:28 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 20bedaec-e4d7-587e-9f56-f3565efe352f with identifier: 3267329 to the API
2025-12-05 06:08:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 06:08:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 06:08:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=3267329&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233267329&indx=181>
{'auction_title': '',
 'c_o_2_emission_value': 153,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003267329-01980177-002.pdf',
 'color': 'RED',
 'currency': 'GBP',
 'engine': '1.3L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '20bedaec-e4d7-587e-9f56-f3565efe352f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'BV20SXW',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=3267329',
 'listing': 'auction',
 'location': 'Leeds',
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 45996,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-04',
 'seller_name': 'Mobilize Financial Services',
 'title': 'NISSAN QASHQAI 1.3 DiG-T Acenta Premium 5dr',
 'transmission': 'manual',
 'trim': '1.3 DiG-T Acenta Premium 5dr',
 'year': 2020}
2025-12-05 06:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273267329%27 HTTP/1.1" 200 None
2025-12-05 06:08:29 [manheim.gb] INFO: Saving data for 3267329: {'auction_closing_time': 1765184400.0, 'created_time': 1764792405.610795, 'last_price_update_time': 1764914909.515955}
2025-12-05 06:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3267329') HTTP/1.1" 204 0
2025-12-05 06:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbdb94328-4ee7-4c88-9f79-918553802f24_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_5.jpg not downloaded yet
2025-12-05 06:08:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VAUXHALL/ASTRAGTC?id=3243502&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233243502&indx=177> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbdb94328-4ee7-4c88-9f79-918553802f24_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_4.jpg not downloaded yet
2025-12-05 06:08:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbdb94328-4ee7-4c88-9f79-918553802f24_11.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_11.jpg not downloaded yet
2025-12-05 06:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbdb94328-4ee7-4c88-9f79-918553802f24_10.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_10.jpg not downloaded yet
2025-12-05 06:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbdb94328-4ee7-4c88-9f79-918553802f24_9.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_9.jpg not downloaded yet
2025-12-05 06:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbdb94328-4ee7-4c88-9f79-918553802f24_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_ext_2.jpg not downloaded yet
2025-12-05 06:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbdb94328-4ee7-4c88-9f79-918553802f24_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_ext_5.jpg not downloaded yet
2025-12-05 06:08:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20047556-3b07-5182-baf8-ce495aa44fa9 with identifier: 3243502
2025-12-05 06:08:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20047556-3b07-5182-baf8-ce495aa44fa9 with scrape type 2
2025-12-05 06:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20047556-3b07-5182-baf8-ce495aa44fa9 with scrape type 2
2025-12-05 06:08:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 20047556-3b07-5182-baf8-ce495aa44fa9, identifier: 3243502
2025-12-05 06:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbdb94328-4ee7-4c88-9f79-918553802f24_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_ext_3.jpg not downloaded yet
2025-12-05 06:08:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 20047556-3b07-5182-baf8-ce495aa44fa9 with identifier: 3243502
2025-12-05 06:08:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 20047556-3b07-5182-baf8-ce495aa44fa9 with identifier: 3243502
2025-12-05 06:08:29 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 13 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    13
2025-12-05 06:08:29 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: 20047556-3b07-5182-baf8-ce495aa44fa9 spider: manheim.gb
2025-12-05 06:08:30 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 20047556-3b07-5182-baf8-ce495aa44fa9 due to rule: registration_date_old.json, error: 13 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    13
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003243502-01966585-003.pdf',
 'color': 'RED',
 'currency': 'GBP',
 'engine': '1.4L',
 'expiration_date': '2025-12-05T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '20047556-3b07-5182-baf8-ce495aa44fa9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'SD12VSY',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VAUXHALL/ASTRA%20GTC?id=3243502',
 'listing': 'auction',
 'location': 'Washington',
 'make': 'VAUXHALL',
 'model': 'ASTRA GTC',
 'odometer': 65215,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-30',
 'seller_name': 'S G Petch',
 'title': 'VAUXHALL ASTRA GTC 1.4T 16V Sport 3dr',
 'transmission': 'manual',
 'trim': '1.4T 16V Sport 3dr',
 'year': 2012}
2025-12-05 06:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273243502%27 HTTP/1.1" 200 None
2025-12-05 06:08:30 [manheim.gb] INFO: Saving data for 3243502: {'auction_closing_time': 1764925200.0, 'created_time': 1764792393.70757, 'last_price_update_time': 1764914910.102013}
2025-12-05 06:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3243502') HTTP/1.1" 204 0
2025-12-05 06:08:30 [scrapy.extensions.logstats] INFO: Crawled 151 pages (at 17 pages/min), scraped 56 items (at 11 items/min)
2025-12-05 06:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbdb94328-4ee7-4c88-9f79-918553802f24_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_ext_4.jpg not downloaded yet
2025-12-05 06:08:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003252975-01985223-004.pdf)
2025-12-05 06:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3252975-4004971-13.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3252975-4004971-13.jpg not downloaded yet
2025-12-05 06:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3252975-4004971-1000.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3252975-4004971-1000.jpg not downloaded yet
2025-12-05 06:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3252975-4004971-1001.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3252975-4004971-1001.jpg not downloaded yet
2025-12-05 06:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3252975-4004971-1002.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3252975-4004971-1002.jpg not downloaded yet
2025-12-05 06:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3252975-4004971-1003.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3252975-4004971-1003.jpg not downloaded yet
2025-12-05 06:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3252975-4004971-1004.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3252975-4004971-1004.jpg not downloaded yet
2025-12-05 06:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3252975-4004971-1005.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3252975-4004971-1005.jpg not downloaded yet
2025-12-05 06:08:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:08:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:08:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:08:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341ee6f90>
2025-12-05 06:08:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:08:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:08:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 06:08:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:08:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:08:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:08:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_4.jpg HTTP/1.1" 201 0
2025-12-05 06:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbdb94328-4ee7-4c88-9f79-918553802f24_5.jpg') HTTP/1.1" 204 0
2025-12-05 06:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_5.jpg saved to cache
2025-12-05 06:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 15cff8ab-999c-5277-a525-94dd58c15952
2025-12-05 06:08:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003252975-01985223-004.pdf)
2025-12-05 06:08:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:08:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:08:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:08:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341ef5890>
2025-12-05 06:08:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:08:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:08:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:08:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:08:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:08:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:08:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_12.jpg HTTP/1.1" 201 0
2025-12-05 06:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbdb94328-4ee7-4c88-9f79-918553802f24_ext_4.jpg') HTTP/1.1" 204 0
2025-12-05 06:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_ext_4.jpg saved to cache
2025-12-05 06:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 15cff8ab-999c-5277-a525-94dd58c15952
2025-12-05 06:08:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3252975-4004971-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003252975-01985223-004.pdf)
2025-12-05 06:08:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:08:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:08:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:08:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23427bbed0>
2025-12-05 06:08:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:08:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:08:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 06:08:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:08:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:08:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:08:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_19.jpg HTTP/1.1" 201 0
2025-12-05 06:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3252975-4004971-1005.jpg') HTTP/1.1" 204 0
2025-12-05 06:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3252975-4004971-1005.jpg saved to cache
2025-12-05 06:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 15cff8ab-999c-5277-a525-94dd58c15952
2025-12-05 06:08:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3252975-4004971-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003252975-01985223-004.pdf)
2025-12-05 06:08:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:08:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:08:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:08:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23415c61d0>
2025-12-05 06:08:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:08:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:08:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:08:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:08:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:08:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:08:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_18.jpg HTTP/1.1" 201 0
2025-12-05 06:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3252975-4004971-1004.jpg') HTTP/1.1" 204 0
2025-12-05 06:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3252975-4004971-1004.jpg saved to cache
2025-12-05 06:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 15cff8ab-999c-5277-a525-94dd58c15952
2025-12-05 06:08:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3252975-4004971-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003252975-01985223-004.pdf)
2025-12-05 06:08:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:08:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:08:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:08:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341f24590>
2025-12-05 06:08:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:08:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:08:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:08:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:08:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:08:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:08:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_17.jpg HTTP/1.1" 201 0
2025-12-05 06:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3252975-4004971-1003.jpg') HTTP/1.1" 204 0
2025-12-05 06:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3252975-4004971-1003.jpg saved to cache
2025-12-05 06:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 15cff8ab-999c-5277-a525-94dd58c15952
2025-12-05 06:08:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3252975-4004971-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003252975-01985223-004.pdf)
2025-12-05 06:08:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:08:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:08:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:08:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23428e3890>
2025-12-05 06:08:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:08:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:08:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:08:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:08:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:08:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:08:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_16.jpg HTTP/1.1" 201 0
2025-12-05 06:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3252975-4004971-1002.jpg') HTTP/1.1" 204 0
2025-12-05 06:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3252975-4004971-1002.jpg saved to cache
2025-12-05 06:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 15cff8ab-999c-5277-a525-94dd58c15952
2025-12-05 06:08:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3252975-4004971-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003252975-01985223-004.pdf)
2025-12-05 06:08:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:08:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:08:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:08:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342892510>
2025-12-05 06:08:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:08:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:08:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:08:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:08:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:08:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:08:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_15.jpg HTTP/1.1" 201 0
2025-12-05 06:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3252975-4004971-1001.jpg') HTTP/1.1" 204 0
2025-12-05 06:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3252975-4004971-1001.jpg saved to cache
2025-12-05 06:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 15cff8ab-999c-5277-a525-94dd58c15952
2025-12-05 06:08:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3252975-4004971-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003252975-01985223-004.pdf)
2025-12-05 06:08:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:08:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:08:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:08:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425c44d0>
2025-12-05 06:08:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:08:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:08:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:08:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:08:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:08:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:08:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_14.jpg HTTP/1.1" 201 0
2025-12-05 06:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3252975-4004971-1000.jpg') HTTP/1.1" 204 0
2025-12-05 06:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3252975-4004971-1000.jpg saved to cache
2025-12-05 06:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 15cff8ab-999c-5277-a525-94dd58c15952
2025-12-05 06:08:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3252975-4004971-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003252975-01985223-004.pdf)
2025-12-05 06:08:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:08:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:08:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:08:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234256b790>
2025-12-05 06:08:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:08:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:08:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:08:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:08:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:08:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:08:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_13.jpg HTTP/1.1" 201 0
2025-12-05 06:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3252975-4004971-13.jpg') HTTP/1.1" 204 0
2025-12-05 06:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3252975-4004971-13.jpg saved to cache
2025-12-05 06:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 15cff8ab-999c-5277-a525-94dd58c15952
2025-12-05 06:08:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003252975-01985223-004.pdf)
2025-12-05 06:08:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:08:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:08:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:08:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342a25e90>
2025-12-05 06:08:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:08:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:08:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:08:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:08:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:08:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:08:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_11.jpg HTTP/1.1" 201 0
2025-12-05 06:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbdb94328-4ee7-4c88-9f79-918553802f24_ext_3.jpg') HTTP/1.1" 204 0
2025-12-05 06:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_ext_3.jpg saved to cache
2025-12-05 06:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 15cff8ab-999c-5277-a525-94dd58c15952
2025-12-05 06:08:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003252975-01985223-004.pdf)
2025-12-05 06:08:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:08:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:08:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:08:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342569710>
2025-12-05 06:08:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:08:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:08:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:08:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:08:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_10.jpg HTTP/1.1" 201 0
2025-12-05 06:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbdb94328-4ee7-4c88-9f79-918553802f24_ext_5.jpg') HTTP/1.1" 204 0
2025-12-05 06:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_ext_5.jpg saved to cache
2025-12-05 06:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 15cff8ab-999c-5277-a525-94dd58c15952
2025-12-05 06:08:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003252975-01985223-004.pdf)
2025-12-05 06:08:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:08:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:08:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:08:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234270c250>
2025-12-05 06:08:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:08:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:08:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:08:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:08:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_9.jpg HTTP/1.1" 201 0
2025-12-05 06:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbdb94328-4ee7-4c88-9f79-918553802f24_ext_2.jpg') HTTP/1.1" 204 0
2025-12-05 06:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_ext_2.jpg saved to cache
2025-12-05 06:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 15cff8ab-999c-5277-a525-94dd58c15952
2025-12-05 06:08:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003252975-01985223-004.pdf)
2025-12-05 06:08:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:08:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:08:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:08:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234269d810>
2025-12-05 06:08:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:08:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:08:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:08:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:08:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_8.jpg HTTP/1.1" 201 0
2025-12-05 06:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbdb94328-4ee7-4c88-9f79-918553802f24_9.jpg') HTTP/1.1" 204 0
2025-12-05 06:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_9.jpg saved to cache
2025-12-05 06:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 15cff8ab-999c-5277-a525-94dd58c15952
2025-12-05 06:08:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003252975-01985223-004.pdf)
2025-12-05 06:08:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:08:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:08:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:08:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341ef6810>
2025-12-05 06:08:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:08:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:08:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:08:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:08:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_7.jpg HTTP/1.1" 201 0
2025-12-05 06:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbdb94328-4ee7-4c88-9f79-918553802f24_10.jpg') HTTP/1.1" 204 0
2025-12-05 06:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_10.jpg saved to cache
2025-12-05 06:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 15cff8ab-999c-5277-a525-94dd58c15952
2025-12-05 06:08:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003252975-01985223-004.pdf)
2025-12-05 06:08:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:08:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:08:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:08:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341f258d0>
2025-12-05 06:08:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:08:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:08:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:08:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:08:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:08:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:08:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_6.jpg HTTP/1.1" 201 0
2025-12-05 06:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbdb94328-4ee7-4c88-9f79-918553802f24_11.jpg') HTTP/1.1" 204 0
2025-12-05 06:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_11.jpg saved to cache
2025-12-05 06:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 15cff8ab-999c-5277-a525-94dd58c15952
2025-12-05 06:08:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003252975-01985223-004.pdf)
2025-12-05 06:08:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:08:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:08:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:08:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425c50d0>
2025-12-05 06:08:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:08:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:08:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:08:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:08:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:08:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:08:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_5.jpg HTTP/1.1" 201 0
2025-12-05 06:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbdb94328-4ee7-4c88-9f79-918553802f24_4.jpg') HTTP/1.1" 204 0
2025-12-05 06:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_4.jpg saved to cache
2025-12-05 06:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 15cff8ab-999c-5277-a525-94dd58c15952
2025-12-05 06:08:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003252975-01985223-004.pdf)
2025-12-05 06:08:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:08:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:08:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:08:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341f24650>
2025-12-05 06:08:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:08:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:08:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:08:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:08:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:08:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:08:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_3.jpg HTTP/1.1" 201 0
2025-12-05 06:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbdb94328-4ee7-4c88-9f79-918553802f24_ext_1.jpg') HTTP/1.1" 204 0
2025-12-05 06:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_ext_1.jpg saved to cache
2025-12-05 06:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 15cff8ab-999c-5277-a525-94dd58c15952
2025-12-05 06:08:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003252975-01985223-004.pdf)
2025-12-05 06:08:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:08:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:08:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:08:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23423b3150>
2025-12-05 06:08:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:08:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:08:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:08:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:08:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:08:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:08:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_2.jpg HTTP/1.1" 201 0
2025-12-05 06:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbdb94328-4ee7-4c88-9f79-918553802f24_ext_6.jpg') HTTP/1.1" 204 0
2025-12-05 06:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_ext_6.jpg saved to cache
2025-12-05 06:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 15cff8ab-999c-5277-a525-94dd58c15952
2025-12-05 06:08:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003252975-01985223-004.pdf)
2025-12-05 06:08:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:08:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:08:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:08:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342810f50>
2025-12-05 06:08:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:08:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:08:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:08:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:08:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:08:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:08:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_1.jpg HTTP/1.1" 201 0
2025-12-05 06:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbdb94328-4ee7-4c88-9f79-918553802f24_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 06:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_ext_7.jpg saved to cache
2025-12-05 06:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 15cff8ab-999c-5277-a525-94dd58c15952
2025-12-05 06:08:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003252975-01985223-004.pdf)
2025-12-05 06:08:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:08:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:08:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:08:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342630e50>
2025-12-05 06:08:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:08:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:08:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:08:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:08:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:08:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:08:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_0.jpg HTTP/1.1" 201 0
2025-12-05 06:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbdb94328-4ee7-4c88-9f79-918553802f24_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 06:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_ext_7.jpg saved to cache
2025-12-05 06:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 15cff8ab-999c-5277-a525-94dd58c15952
2025-12-05 06:08:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 15cff8ab-999c-5277-a525-94dd58c15952, skipping ID generation
2025-12-05 06:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 15cff8ab-999c-5277-a525-94dd58c15952 from tracking dictionaries
2025-12-05 06:08:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 15cff8ab-999c-5277-a525-94dd58c15952 sending to next pipeline
2025-12-05 06:08:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 15cff8ab-999c-5277-a525-94dd58c15952, identifier: 3252975
2025-12-05 06:08:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 15cff8ab-999c-5277-a525-94dd58c15952 with identifier: 3252975
2025-12-05 06:08:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 15cff8ab-999c-5277-a525-94dd58c15952 with identifier: 3252975
2025-12-05 06:08:39 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 27, 'seller_name': 'smiths motor group', 'price_includes_vat': False, 'title': 'hyundai kona 150kw premium 64kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'hyundai', 'model': 'kona', 'transmission': 'automatic', 'engine': '0.0l', 'fuel_type': 'electric', 'odometer': 35814, 'odometer_reading_unit': 'mi', 'registration_date': '2020-07-27', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/hyundai/kona?id=3252975', 'location': 'colchester', 'origin_country_code': 'gb', 'trim': '150kw premium 64kwh 5dr auto', 'license_plate': 'sm20bvd', 'year': 2020, 'listing': 'auction', 'c_o_2_emission_value': 0, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0003252975-01985223-004.pdf', 'expiration_date': '2025-12-09t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': '15cff8ab-999c-5277-a525-94dd58c15952', 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_expert_report_file_6eb54a6b-101a-4189-9d8a-abd49b692191.pdf', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_0.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_ext_7.jpg', 'Width': 1499, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 154144}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_1.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_ext_7.jpg', 'Width': 1499, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 154144}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_2.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_ext_6.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 253518}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_3.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_ext_1.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 145785}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_4.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_5.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 153009}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_5.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_4.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 156795}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_6.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_11.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 152356}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_7.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_10.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 151265}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_8.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_9.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 153653}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_9.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_ext_2.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 256867}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_10.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_ext_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 247965}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_11.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_ext_3.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 222811}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_12.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_ext_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 245871}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_13.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3252975-4004971-13.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 312838}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_14.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3252975-4004971-1000.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 275032}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_15.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3252975-4004971-1001.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 291713}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_16.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3252975-4004971-1002.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 377208}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_17.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3252975-4004971-1003.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 229663}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_18.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3252975-4004971-1004.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 273551}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_19.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3252975-4004971-1005.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 209753}], 'current_year_diff': 5, 'age_in_months': 64, 'make_model': 'hyundai kona', 'sanitized_make': 'hyundai', 'odometer_in_km': 57636} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 64,
     'auction_title': '',
     'c_o_2_emission_value': 0,
     'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_expert_report_file_6eb54a6b-101a-4189-9d8a-abd49b692191.pdf',
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0003252975-01985223-004.pdf',
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 5,
     'engine': '0.0l',
     'expiration_date': '2025-12-09t09:00:00z',
     'fuel_type': 'electric',
     'id': '15cff8ab-999c-5277-a525-94dd58c15952',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'sm20bvd',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/hyundai/kona?id=3252975',
     'listing': 'auction',
     'location': 'colchester',
     'make': 'hyundai',
     'make_model': 'hyundai kona',
     'model': 'kona',
     'odometer': 35814,
     'odometer_in_km': 57636,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 27,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 154144,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_ext_7.jpg',
                 'Width': 1499},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 154144,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_ext_7.jpg',
                 'Width': 1499},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 253518,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_ext_6.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 145785,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_ext_1.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 153009,
                 'Height': 999,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_5.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 156795,
                 'Height': 999,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_4.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 152356,
                 'Height': 999,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_11.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 151265,
                 'Height': 999,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_10.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 153653,
                 'Height': 999,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_9.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 256867,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_ext_2.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 247965,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_ext_5.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 222811,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_ext_3.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 245871,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_ext_4.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 312838,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3252975-4004971-13.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 275032,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3252975-4004971-1000.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_15.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 291713,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3252975-4004971-1001.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_16.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 377208,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3252975-4004971-1002.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_17.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 229663,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3252975-4004971-1003.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_18.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 273551,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3252975-4004971-1004.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_19.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 209753,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3252975-4004971-1005.jpg',
                 'Width': 1333}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2020-07-27',
     'sanitized_make': 'hyundai',
     'seller_name': 'smiths motor group',
     'title': 'hyundai kona 150kw premium 64kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '150kw premium 64kwh 5dr auto',
     'year': 2020}
2025-12-05 06:08:39 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 15cff8ab-999c-5277-a525-94dd58c15952 spider: manheim.gb
2025-12-05 06:08:39 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 15cff8ab-999c-5277-a525-94dd58c15952 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 27, 'seller_name': 'smiths motor group', 'price_includes_vat': False, 'title': 'hyundai kona 150kw premium 64kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'hyundai', 'model': 'kona', 'transmission': 'automatic', 'engine': '0.0l', 'fuel_type': 'electric', 'odometer': 35814, 'odometer_reading_unit': 'mi', 'registration_date': '2020-07-27', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/hyundai/kona?id=3252975', 'location': 'colchester', 'origin_country_code': 'gb', 'trim': '150kw premium 64kwh 5dr auto', 'license_plate': 'sm20bvd', 'year': 2020, 'listing': 'auction', 'c_o_2_emission_value': 0, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0003252975-01985223-004.pdf', 'expiration_date': '2025-12-09t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': '15cff8ab-999c-5277-a525-94dd58c15952', 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_expert_report_file_6eb54a6b-101a-4189-9d8a-abd49b692191.pdf', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_0.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_ext_7.jpg', 'Width': 1499, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 154144}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_1.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_ext_7.jpg', 'Width': 1499, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 154144}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_2.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_ext_6.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 253518}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_3.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_ext_1.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 145785}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_4.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_5.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 153009}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_5.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_4.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 156795}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_6.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_11.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 152356}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_7.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_10.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 151265}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_8.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_9.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 153653}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_9.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_ext_2.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 256867}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_10.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_ext_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 247965}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_11.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_ext_3.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 222811}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_12.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_ext_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 245871}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_13.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3252975-4004971-13.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 312838}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_14.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3252975-4004971-1000.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 275032}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_15.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3252975-4004971-1001.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 291713}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_16.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3252975-4004971-1002.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 377208}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_17.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3252975-4004971-1003.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 229663}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_18.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3252975-4004971-1004.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 273551}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_19.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3252975-4004971-1005.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 209753}], 'current_year_diff': 5, 'age_in_months': 64, 'make_model': 'hyundai kona', 'sanitized_make': 'hyundai', 'odometer_in_km': 57636} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 64,
     'auction_title': '',
     'c_o_2_emission_value': 0,
     'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_expert_report_file_6eb54a6b-101a-4189-9d8a-abd49b692191.pdf',
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0003252975-01985223-004.pdf',
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 5,
     'engine': '0.0l',
     'expiration_date': '2025-12-09t09:00:00z',
     'fuel_type': 'electric',
     'id': '15cff8ab-999c-5277-a525-94dd58c15952',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'sm20bvd',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/hyundai/kona?id=3252975',
     'listing': 'auction',
     'location': 'colchester',
     'make': 'hyundai',
     'make_model': 'hyundai kona',
     'model': 'kona',
     'odometer': 35814,
     'odometer_in_km': 57636,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 27,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 154144,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_ext_7.jpg',
                 'Width': 1499},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 154144,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_ext_7.jpg',
                 'Width': 1499},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 253518,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_ext_6.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 145785,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_ext_1.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 153009,
                 'Height': 999,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_5.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 156795,
                 'Height': 999,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_4.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 152356,
                 'Height': 999,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_11.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 151265,
                 'Height': 999,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_10.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 153653,
                 'Height': 999,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_9.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 256867,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_ext_2.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 247965,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_ext_5.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 222811,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_ext_3.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 245871,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_ext_4.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 312838,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3252975-4004971-13.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 275032,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3252975-4004971-1000.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_15.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 291713,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3252975-4004971-1001.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_16.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 377208,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3252975-4004971-1002.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_17.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 229663,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3252975-4004971-1003.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_18.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 273551,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3252975-4004971-1004.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_19.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 209753,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3252975-4004971-1005.jpg',
                 'Width': 1333}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2020-07-27',
     'sanitized_make': 'hyundai',
     'seller_name': 'smiths motor group',
     'title': 'hyundai kona 150kw premium 64kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '150kw premium 64kwh 5dr auto',
     'year': 2020}
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_expert_report_file_6eb54a6b-101a-4189-9d8a-abd49b692191.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003252975-01985223-004.pdf',
 'color': 'Grey',
 'currency': 'GBP',
 'engine': '0.0L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Electric',
 'id': '15cff8ab-999c-5277-a525-94dd58c15952',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'SM20BVD',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/HYUNDAI/KONA?id=3252975',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'HYUNDAI',
 'model': 'KONA',
 'odometer': 35814,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 27,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 154144,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 154144,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 253518,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 145785,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 153009,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_5.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 156795,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_4.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 152356,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_11.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 151265,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_10.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 153653,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_9.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 256867,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 247965,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 222811,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 245871,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bdb94328-4ee7-4c88-9f79-918553802f24_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 312838,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3252975-4004971-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 275032,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3252975-4004971-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 291713,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3252975-4004971-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 377208,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3252975-4004971-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 229663,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3252975-4004971-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 273551,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3252975-4004971-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15cff8ab-999c-5277-a525-94dd58c15952/15cff8ab-999c-5277-a525-94dd58c15952_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 209753,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3252975-4004971-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-27',
 'seller_name': 'Smiths Motor Group',
 'title': 'HYUNDAI KONA 150kW Premium 64kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '150kW Premium 64kWh 5dr Auto',
 'year': 2020}
2025-12-05 06:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273252975%27 HTTP/1.1" 200 None
2025-12-05 06:08:39 [manheim.gb] INFO: Saving data for 3252975: {'created_time': 1764914919.875175, 'last_price_update_time': 1764914919.875189, 'auction_closing_time': 1765270800.0}
2025-12-05 06:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3252975') HTTP/1.1" 204 0
2025-12-05 06:08:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/DACIA/SANDEROSTEPWAY?id=3227836&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233227836&indx=175> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:08:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:08:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9c65c2b-1112-503a-afef-380703addfc0 with identifier: 3227836
2025-12-05 06:08:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9c65c2b-1112-503a-afef-380703addfc0 with scrape type 2
2025-12-05 06:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9c65c2b-1112-503a-afef-380703addfc0 with scrape type 2
2025-12-05 06:08:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: f9c65c2b-1112-503a-afef-380703addfc0, identifier: 3227836
2025-12-05 06:08:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: f9c65c2b-1112-503a-afef-380703addfc0 with identifier: 3227836
2025-12-05 06:08:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: f9c65c2b-1112-503a-afef-380703addfc0 with identifier: 3227836
2025-12-05 06:08:43 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: f9c65c2b-1112-503a-afef-380703addfc0 with identifier: 3227836 to the API
2025-12-05 06:08:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 06:08:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 06:08:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/DACIA/SANDEROSTEPWAY?id=3227836&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233227836&indx=175>
{'auction_title': '',
 'c_o_2_emission_value': 98,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003227836-01992307-002.pdf',
 'color': 'SILVER',
 'currency': 'GBP',
 'engine': '1.5L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'f9c65c2b-1112-503a-afef-380703addfc0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'SA66XDX',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/DACIA/SANDERO%20STEPWAY?id=3227836',
 'listing': 'auction',
 'location': 'Shotts',
 'make': 'DACIA',
 'model': 'SANDERO STEPWAY',
 'odometer': 47864,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-22',
 'seller_name': 'MotoNovo Finance',
 'title': 'DACIA SANDERO STEPWAY 1.5 dCi Ambiance 5dr',
 'transmission': 'manual',
 'trim': '1.5 dCi Ambiance 5dr',
 'year': 2016}
2025-12-05 06:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273227836%27 HTTP/1.1" 200 None
2025-12-05 06:08:44 [manheim.gb] INFO: Saving data for 3227836: {'auction_closing_time': 1765270800.0, 'created_time': 1764792479.687492, 'last_price_update_time': 1764914924.540233}
2025-12-05 06:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3227836') HTTP/1.1" 204 0
2025-12-05 06:08:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/LAND%20ROVER/DISCOVERYSPORT?id=3193354&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233193354&indx=170> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:08:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:08:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 213f1993-2937-56fb-92c0-c52a95a423e7 with identifier: 3193354
2025-12-05 06:08:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 213f1993-2937-56fb-92c0-c52a95a423e7 with scrape type 2
2025-12-05 06:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 213f1993-2937-56fb-92c0-c52a95a423e7 with scrape type 2
2025-12-05 06:08:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 213f1993-2937-56fb-92c0-c52a95a423e7, identifier: 3193354
2025-12-05 06:08:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 213f1993-2937-56fb-92c0-c52a95a423e7 with identifier: 3193354
2025-12-05 06:08:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 213f1993-2937-56fb-92c0-c52a95a423e7 with identifier: 3193354
2025-12-05 06:08:51 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 159810 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    159810
2025-12-05 06:08:51 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 213f1993-2937-56fb-92c0-c52a95a423e7 spider: manheim.gb
2025-12-05 06:08:51 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 213f1993-2937-56fb-92c0-c52a95a423e7 due to rule: high_mileage_for_country.json, error: 159810 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    159810
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003193354-01990155-005.pdf',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '213f1993-2937-56fb-92c0-c52a95a423e7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'OY16ABX',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/LAND%20ROVER/DISCOVERY%20SPORT?id=3193354',
 'listing': 'auction',
 'location': 'Birmingham',
 'make': 'LAND ROVER',
 'model': 'DISCOVERY SPORT',
 'odometer': 99302,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-03',
 'seller_name': 'Big Motoring World Ltd',
 'title': 'LAND ROVER DISCOVERY SPORT 2.0 TD4 180 SE Tech 5dr',
 'transmission': 'manual',
 'trim': '2.0 TD4 180 SE Tech 5dr',
 'year': 2016}
2025-12-05 06:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273193354%27 HTTP/1.1" 200 None
2025-12-05 06:08:51 [manheim.gb] INFO: Saving data for 3193354: {'auction_closing_time': 1765184400.0, 'created_time': 1764792436.012174, 'last_price_update_time': 1764914931.842318}
2025-12-05 06:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3193354') HTTP/1.1" 204 0
2025-12-05 06:08:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/GOLF?id=3234444&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233234444&indx=176> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:08:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:08:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 339a0e40-8690-5ad6-8f08-9969622dc81f with identifier: 3234444
2025-12-05 06:08:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 339a0e40-8690-5ad6-8f08-9969622dc81f with scrape type 2
2025-12-05 06:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 339a0e40-8690-5ad6-8f08-9969622dc81f with scrape type 2
2025-12-05 06:08:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 339a0e40-8690-5ad6-8f08-9969622dc81f, identifier: 3234444
2025-12-05 06:08:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 339a0e40-8690-5ad6-8f08-9969622dc81f with identifier: 3234444
2025-12-05 06:08:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 339a0e40-8690-5ad6-8f08-9969622dc81f with identifier: 3234444
2025-12-05 06:08:52 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 12 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    12
2025-12-05 06:08:52 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: 339a0e40-8690-5ad6-8f08-9969622dc81f spider: manheim.gb
2025-12-05 06:08:52 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 339a0e40-8690-5ad6-8f08-9969622dc81f due to rule: registration_date_old.json, error: 12 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    12
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003234444-01984577-002.pdf',
 'color': 'SILVER',
 'currency': 'GBP',
 'engine': '1.4L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '339a0e40-8690-5ad6-8f08-9969622dc81f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'DG13XSN',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/GOLF?id=3234444',
 'listing': 'auction',
 'location': 'Leeds',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF',
 'odometer': 84835,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-19',
 'seller_name': 'Lloyd Motor Group',
 'title': 'VOLKSWAGEN GOLF 1.4 TSI SE 5dr',
 'transmission': 'manual',
 'trim': '1.4 TSI SE 5dr',
 'year': 2013}
2025-12-05 06:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273234444%27 HTTP/1.1" 200 None
2025-12-05 06:08:52 [manheim.gb] INFO: Saving data for 3234444: {'auction_closing_time': 1765184400.0, 'created_time': 1764792438.905671, 'last_price_update_time': 1764914932.321387}
2025-12-05 06:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3234444') HTTP/1.1" 204 0
2025-12-05 06:08:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/BMW/2SERIES?id=3213348&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233213348&indx=174> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:08:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:08:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0bbcf39-56be-5dab-bb34-f5f12a007b37 with identifier: 3213348
2025-12-05 06:08:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0bbcf39-56be-5dab-bb34-f5f12a007b37 with scrape type 2
2025-12-05 06:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d0bbcf39-56be-5dab-bb34-f5f12a007b37 with scrape type 2
2025-12-05 06:08:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: d0bbcf39-56be-5dab-bb34-f5f12a007b37, identifier: 3213348
2025-12-05 06:08:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: d0bbcf39-56be-5dab-bb34-f5f12a007b37 with identifier: 3213348
2025-12-05 06:08:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: d0bbcf39-56be-5dab-bb34-f5f12a007b37 with identifier: 3213348
2025-12-05 06:08:55 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 10 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    10
2025-12-05 06:08:55 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: d0bbcf39-56be-5dab-bb34-f5f12a007b37 spider: manheim.gb
2025-12-05 06:08:55 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: d0bbcf39-56be-5dab-bb34-f5f12a007b37 due to rule: registration_date_old.json, error: 10 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    10
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003213348-01974602-002.pdf',
 'color': 'BLUE',
 'currency': 'GBP',
 'engine': '1.5L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'd0bbcf39-56be-5dab-bb34-f5f12a007b37',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'PE15ZTW',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/BMW/2%20SERIES?id=3213348',
 'listing': 'directbuy',
 'location': 'Leeds',
 'make': 'BMW',
 'model': '2 SERIES',
 'odometer': 81871,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-31',
 'seller_name': 'Lookers',
 'title': 'BMW 2 SERIES 218i Sport 5dr',
 'transmission': 'manual',
 'trim': '218i Sport 5dr',
 'year': 2015}
2025-12-05 06:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273213348%27 HTTP/1.1" 200 None
2025-12-05 06:08:55 [manheim.gb] INFO: Saving data for 3213348: {'auction_closing_time': 1765184400.0, 'created_time': 1764792405.884034, 'last_price_update_time': 1764914935.636998}
2025-12-05 06:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3213348') HTTP/1.1" 204 0
2025-12-05 06:08:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VAUXHALL/MOKKA?id=3210152&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233210152&indx=173> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:08:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:08:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73db8c21-b886-5baa-9846-748d497a4941 with identifier: 3210152
2025-12-05 06:08:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73db8c21-b886-5baa-9846-748d497a4941 with scrape type 2
2025-12-05 06:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 73db8c21-b886-5baa-9846-748d497a4941 with scrape type 2
2025-12-05 06:08:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 73db8c21-b886-5baa-9846-748d497a4941, identifier: 3210152
2025-12-05 06:08:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 73db8c21-b886-5baa-9846-748d497a4941 with identifier: 3210152
2025-12-05 06:08:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 73db8c21-b886-5baa-9846-748d497a4941 with identifier: 3210152
2025-12-05 06:08:55 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 11 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    11
2025-12-05 06:08:55 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: 73db8c21-b886-5baa-9846-748d497a4941 spider: manheim.gb
2025-12-05 06:08:56 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 73db8c21-b886-5baa-9846-748d497a4941 due to rule: registration_date_old.json, error: 11 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    11
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003210152-01984660-005.pdf',
 'color': 'BLUE',
 'currency': 'GBP',
 'engine': '1.4L',
 'expiration_date': '2025-12-05T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '73db8c21-b886-5baa-9846-748d497a4941',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'BP14DYX',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VAUXHALL/MOKKA?id=3210152',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'VAUXHALL',
 'model': 'MOKKA',
 'odometer': 70540,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-30',
 'seller_name': 'Oplo CF Limited',
 'title': 'VAUXHALL MOKKA 1.4T SE 5dr',
 'transmission': 'manual',
 'trim': '1.4T SE 5dr',
 'year': 2014}
2025-12-05 06:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273210152%27 HTTP/1.1" 200 None
2025-12-05 06:08:56 [manheim.gb] INFO: Saving data for 3210152: {'auction_closing_time': 1764925200.0, 'created_time': 1764792414.719806, 'last_price_update_time': 1764914936.107342}
2025-12-05 06:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3210152') HTTP/1.1" 204 0
2025-12-05 06:08:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/LAND%20ROVER/DEFENDER?id=3171741&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233171741&indx=168> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:08:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:08:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/JAGUAR/IPACE?id=3174678&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233174678&indx=169> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:08:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:08:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec2c93dc-9068-5aa0-a8ce-a73ab083ac79 with identifier: 3171741
2025-12-05 06:08:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec2c93dc-9068-5aa0-a8ce-a73ab083ac79 with scrape type 2
2025-12-05 06:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec2c93dc-9068-5aa0-a8ce-a73ab083ac79 with scrape type 2
2025-12-05 06:08:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: ec2c93dc-9068-5aa0-a8ce-a73ab083ac79, identifier: 3171741
2025-12-05 06:08:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: ec2c93dc-9068-5aa0-a8ce-a73ab083ac79 with identifier: 3171741
2025-12-05 06:08:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: ec2c93dc-9068-5aa0-a8ce-a73ab083ac79 with identifier: 3171741
2025-12-05 06:08:56 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: ec2c93dc-9068-5aa0-a8ce-a73ab083ac79 with identifier: 3171741 to the API
2025-12-05 06:08:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 06:08:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 06:08:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/LAND%20ROVER/DEFENDER?id=3171741&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233171741&indx=168>
{'auction_title': '',
 'c_o_2_emission_value': 250,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003171741-01974417-002.pdf',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'ec2c93dc-9068-5aa0-a8ce-a73ab083ac79',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'OY70UEU',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/LAND%20ROVER/DEFENDER?id=3171741',
 'listing': 'directbuy',
 'location': 'Leeds',
 'make': 'LAND ROVER',
 'model': 'DEFENDER',
 'odometer': 33556,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-01',
 'seller_name': 'Lloyd Motor Group',
 'title': 'LAND ROVER DEFENDER 2.0 D240 SE 110 5dr Auto',
 'transmission': 'automatic',
 'trim': '2.0 D240 SE 110 5dr Auto',
 'year': 2020}
2025-12-05 06:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273171741%27 HTTP/1.1" 200 None
2025-12-05 06:08:57 [manheim.gb] INFO: Saving data for 3171741: {'auction_closing_time': 1765184400.0, 'created_time': 1764792443.877885, 'last_price_update_time': 1764914937.107356}
2025-12-05 06:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3171741') HTTP/1.1" 204 0
2025-12-05 06:08:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c22f6b1-1e22-53f7-bac3-4868825241f1 with identifier: 3174678
2025-12-05 06:08:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c22f6b1-1e22-53f7-bac3-4868825241f1 with scrape type 2
2025-12-05 06:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c22f6b1-1e22-53f7-bac3-4868825241f1 with scrape type 2
2025-12-05 06:08:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 8c22f6b1-1e22-53f7-bac3-4868825241f1, identifier: 3174678
2025-12-05 06:08:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 8c22f6b1-1e22-53f7-bac3-4868825241f1 with identifier: 3174678
2025-12-05 06:08:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 8c22f6b1-1e22-53f7-bac3-4868825241f1 with identifier: 3174678
2025-12-05 06:08:57 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': 'fca group', 'price_includes_vat': False, 'title': 'jaguar i-pace 294kw ev400 hse 90kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'jaguar', 'model': 'i-pace', 'transmission': 'automatic', 'engine': '0.0l', 'fuel_type': 'electric', 'odometer': 41623, 'odometer_reading_unit': 'mi', 'registration_date': '2019-06-06', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/jaguar/i-pace?id=3174678', 'location': 'bruntingthorpe', 'origin_country_code': 'gb', 'trim': '294kw ev400 hse 90kwh 5dr auto', 'license_plate': 'ra19nhj', 'year': 2019, 'listing': 'auction', 'c_o_2_emission_value': 0, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0003174678-01860333-007.pdf', 'expiration_date': '2025-12-05t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': '8c22f6b1-1e22-53f7-bac3-4868825241f1', 'current_year_diff': 6, 'age_in_months': 77, 'make_model': 'jaguar i-pace', 'sanitized_make': 'jaguar', 'odometer_in_km': 66985} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 77,
     'auction_title': '',
     'c_o_2_emission_value': 0,
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0003174678-01860333-007.pdf',
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 6,
     'engine': '0.0l',
     'expiration_date': '2025-12-05t09:00:00z',
     'fuel_type': 'electric',
     'id': '8c22f6b1-1e22-53f7-bac3-4868825241f1',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'ra19nhj',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/jaguar/i-pace?id=3174678',
     'listing': 'auction',
     'location': 'bruntingthorpe',
     'make': 'jaguar',
     'make_model': 'jaguar i-pace',
     'model': 'i-pace',
     'odometer': 41623,
     'odometer_in_km': 66985,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2019-06-06',
     'sanitized_make': 'jaguar',
     'seller_name': 'fca group',
     'title': 'jaguar i-pace 294kw ev400 hse 90kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '294kw ev400 hse 90kwh 5dr auto',
     'year': 2019}
2025-12-05 06:08:57 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 8c22f6b1-1e22-53f7-bac3-4868825241f1 spider: manheim.gb
2025-12-05 06:08:57 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 8c22f6b1-1e22-53f7-bac3-4868825241f1 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': 'fca group', 'price_includes_vat': False, 'title': 'jaguar i-pace 294kw ev400 hse 90kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'jaguar', 'model': 'i-pace', 'transmission': 'automatic', 'engine': '0.0l', 'fuel_type': 'electric', 'odometer': 41623, 'odometer_reading_unit': 'mi', 'registration_date': '2019-06-06', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/jaguar/i-pace?id=3174678', 'location': 'bruntingthorpe', 'origin_country_code': 'gb', 'trim': '294kw ev400 hse 90kwh 5dr auto', 'license_plate': 'ra19nhj', 'year': 2019, 'listing': 'auction', 'c_o_2_emission_value': 0, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0003174678-01860333-007.pdf', 'expiration_date': '2025-12-05t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': '8c22f6b1-1e22-53f7-bac3-4868825241f1', 'current_year_diff': 6, 'age_in_months': 77, 'make_model': 'jaguar i-pace', 'sanitized_make': 'jaguar', 'odometer_in_km': 66985} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 77,
     'auction_title': '',
     'c_o_2_emission_value': 0,
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0003174678-01860333-007.pdf',
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 6,
     'engine': '0.0l',
     'expiration_date': '2025-12-05t09:00:00z',
     'fuel_type': 'electric',
     'id': '8c22f6b1-1e22-53f7-bac3-4868825241f1',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'ra19nhj',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/jaguar/i-pace?id=3174678',
     'listing': 'auction',
     'location': 'bruntingthorpe',
     'make': 'jaguar',
     'make_model': 'jaguar i-pace',
     'model': 'i-pace',
     'odometer': 41623,
     'odometer_in_km': 66985,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2019-06-06',
     'sanitized_make': 'jaguar',
     'seller_name': 'fca group',
     'title': 'jaguar i-pace 294kw ev400 hse 90kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '294kw ev400 hse 90kwh 5dr auto',
     'year': 2019}
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003174678-01860333-007.pdf',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '0.0L',
 'expiration_date': '2025-12-05T09:00:00Z',
 'fuel_type': 'Electric',
 'id': '8c22f6b1-1e22-53f7-bac3-4868825241f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'RA19NHJ',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/JAGUAR/I-PACE?id=3174678',
 'listing': 'auction',
 'location': 'Bruntingthorpe',
 'make': 'JAGUAR',
 'model': 'I-PACE',
 'odometer': 41623,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-06',
 'seller_name': 'FCA Group',
 'title': 'JAGUAR I-PACE 294kW EV400 HSE 90kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '294kW EV400 HSE 90kWh 5dr Auto',
 'year': 2019}
2025-12-05 06:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273174678%27 HTTP/1.1" 200 None
2025-12-05 06:08:57 [manheim.gb] INFO: Saving data for 3174678: {'auction_closing_time': 1764925200.0, 'created_time': 1764792425.323743, 'last_price_update_time': 1764914937.464472}
2025-12-05 06:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3174678') HTTP/1.1" 204 0
2025-12-05 06:08:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/LAND%20ROVER/RANGEROVERSPORT?id=3167377&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233167377&indx=167> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:08:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:08:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c076ef0-692c-52c2-93d1-1a2b77e3bbbc with identifier: 3167377
2025-12-05 06:08:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c076ef0-692c-52c2-93d1-1a2b77e3bbbc with scrape type 2
2025-12-05 06:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6c076ef0-692c-52c2-93d1-1a2b77e3bbbc with scrape type 2
2025-12-05 06:08:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 6c076ef0-692c-52c2-93d1-1a2b77e3bbbc, identifier: 3167377
2025-12-05 06:08:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 6c076ef0-692c-52c2-93d1-1a2b77e3bbbc with identifier: 3167377
2025-12-05 06:08:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 6c076ef0-692c-52c2-93d1-1a2b77e3bbbc with identifier: 3167377
2025-12-05 06:08:59 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 189433 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    189433
2025-12-05 06:08:59 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 6c076ef0-692c-52c2-93d1-1a2b77e3bbbc spider: manheim.gb
2025-12-05 06:09:00 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 6c076ef0-692c-52c2-93d1-1a2b77e3bbbc due to rule: high_mileage_for_country.json, error: 189433 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    189433
{'auction_title': '',
 'c_o_2_emission_value': 202,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003167377-01950357-003.pdf',
 'color': 'SILVER',
 'currency': 'GBP',
 'engine': '3.0L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '6c076ef0-692c-52c2-93d1-1a2b77e3bbbc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'HJ68VVZ',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/LAND%20ROVER/RANGE%20ROVER%20SPORT?id=3167377',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER SPORT',
 'odometer': 117709,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-14',
 'seller_name': 'FCA Group',
 'title': 'LAND ROVER RANGE ROVER SPORT 3.0 SDV6 Autobiography Dynamic 5dr '
          'Auto',
 'transmission': 'automatic',
 'trim': '3.0 SDV6 Autobiography Dynamic 5dr Auto',
 'year': 2018}
2025-12-05 06:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273167377%27 HTTP/1.1" 200 None
2025-12-05 06:09:00 [manheim.gb] INFO: Saving data for 3167377: {'auction_closing_time': 1765184400.0, 'created_time': 1764792448.386717, 'last_price_update_time': 1764914940.067258}
2025-12-05 06:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3167377') HTTP/1.1" 204 0
2025-12-05 06:09:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/FIAT/500?id=3163606&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233163606&indx=166> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:09:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:09:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a41abfdb-15e7-54c3-b155-2cf640fa2cb4 with identifier: 3163606
2025-12-05 06:09:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a41abfdb-15e7-54c3-b155-2cf640fa2cb4 with scrape type 2
2025-12-05 06:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a41abfdb-15e7-54c3-b155-2cf640fa2cb4 with scrape type 2
2025-12-05 06:09:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: a41abfdb-15e7-54c3-b155-2cf640fa2cb4, identifier: 3163606
2025-12-05 06:09:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: a41abfdb-15e7-54c3-b155-2cf640fa2cb4 with identifier: 3163606
2025-12-05 06:09:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: a41abfdb-15e7-54c3-b155-2cf640fa2cb4 with identifier: 3163606
2025-12-05 06:09:11 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 14 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    14
2025-12-05 06:09:11 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: a41abfdb-15e7-54c3-b155-2cf640fa2cb4 spider: manheim.gb
2025-12-05 06:09:11 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: a41abfdb-15e7-54c3-b155-2cf640fa2cb4 due to rule: registration_date_old.json, error: 14 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    14
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003163606-01978484-002.pdf',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': '2025-12-11T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'a41abfdb-15e7-54c3-b155-2cf640fa2cb4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'YP11RUY',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FIAT/500?id=3163606',
 'listing': 'auction',
 'location': 'Bristol',
 'make': 'FIAT',
 'model': '500',
 'odometer': 86999,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-27',
 'seller_name': 'Mon Motors',
 'title': 'FIAT 500 1.2 Lounge 3dr [Start Stop]',
 'transmission': 'manual',
 'trim': '1.2 Lounge 3dr [Start Stop]',
 'year': 2011}
2025-12-05 06:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273163606%27 HTTP/1.1" 200 None
2025-12-05 06:09:11 [manheim.gb] INFO: Saving data for 3163606: {'auction_closing_time': 1765443600.0, 'created_time': 1764792458.736194, 'last_price_update_time': 1764914951.465608}
2025-12-05 06:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3163606') HTTP/1.1" 204 0
2025-12-05 06:09:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/GOLF?id=3161787&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233161787&indx=165> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:09:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:09:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b88a2b5-9e15-5854-89e9-281431c94a3a with identifier: 3161787
2025-12-05 06:09:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b88a2b5-9e15-5854-89e9-281431c94a3a with scrape type 2
2025-12-05 06:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b88a2b5-9e15-5854-89e9-281431c94a3a with scrape type 2
2025-12-05 06:09:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 2b88a2b5-9e15-5854-89e9-281431c94a3a, identifier: 3161787
2025-12-05 06:09:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 2b88a2b5-9e15-5854-89e9-281431c94a3a with identifier: 3161787
2025-12-05 06:09:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 2b88a2b5-9e15-5854-89e9-281431c94a3a with identifier: 3161787
2025-12-05 06:09:17 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 2b88a2b5-9e15-5854-89e9-281431c94a3a with identifier: 3161787 to the API
2025-12-05 06:09:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 06:09:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 06:09:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/GOLF?id=3161787&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233161787&indx=165>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003161787-01981413-002.pdf',
 'color': 'SILVER',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '2b88a2b5-9e15-5854-89e9-281431c94a3a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'YD21UZO',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/GOLF?id=3161787',
 'listing': 'auction',
 'location': 'Leeds',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF',
 'odometer': 40095,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-31',
 'seller_name': 'Novuna Vehicle Solutions',
 'title': 'VOLKSWAGEN GOLF 2.0 TDI 200 GTD 5dr DSG',
 'transmission': 'automatic',
 'trim': '2.0 TDI 200 GTD 5dr DSG',
 'year': 2021}
2025-12-05 06:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273161787%27 HTTP/1.1" 200 None
2025-12-05 06:09:17 [manheim.gb] INFO: Saving data for 3161787: {'auction_closing_time': 1765184400.0, 'created_time': 1764792480.063237, 'last_price_update_time': 1764914957.724477}
2025-12-05 06:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3161787') HTTP/1.1" 204 0
2025-12-05 06:09:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VAUXHALL/CORSA?id=3135542&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233135542&indx=163> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:09:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:09:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c3248f4-6c83-56f0-9760-c7fd8e4af8b1 with identifier: 3135542
2025-12-05 06:09:19 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 6c3248f4-6c83-56f0-9760-c7fd8e4af8b1
2025-12-05 06:09:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/DS/DS7?id=3076903&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233076903&indx=160> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:09:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:09:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ee7b29f-1fa0-5e83-baa7-07d6d49f05b1 with identifier: 3076903
2025-12-05 06:09:21 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 5ee7b29f-1fa0-5e83-baa7-07d6d49f05b1
2025-12-05 06:09:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003135542-01992447-003.pdf> (referer: None)
2025-12-05 06:09:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:09:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:09:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:09:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23426d8250>
2025-12-05 06:09:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:09:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:09:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:09:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:09:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:09:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:09:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c3248f4-6c83-56f0-9760-c7fd8e4af8b1/6c3248f4-6c83-56f0-9760-c7fd8e4af8b1_expert_report_file_39ecd7e0-1e5d-4811-9a69-03adbc435841.pdf HTTP/1.1" 201 0
2025-12-05 06:09:22 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 6c3248f4-6c83-56f0-9760-c7fd8e4af8b1
2025-12-05 06:09:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6c3248f4-6c83-56f0-9760-c7fd8e4af8b1, skipping ID generation
2025-12-05 06:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 6c3248f4-6c83-56f0-9760-c7fd8e4af8b1
2025-12-05 06:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6938a0fa-104a-4dc5-b6cc-027ca94f7395_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6938a0fa-104a-4dc5-b6cc-027ca94f7395_ext_7.jpg not downloaded yet
2025-12-05 06:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6938a0fa-104a-4dc5-b6cc-027ca94f7395_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6938a0fa-104a-4dc5-b6cc-027ca94f7395_ext_7.jpg not downloaded yet
2025-12-05 06:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6938a0fa-104a-4dc5-b6cc-027ca94f7395_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6938a0fa-104a-4dc5-b6cc-027ca94f7395_ext_6.jpg not downloaded yet
2025-12-05 06:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6938a0fa-104a-4dc5-b6cc-027ca94f7395_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6938a0fa-104a-4dc5-b6cc-027ca94f7395_ext_1.jpg not downloaded yet
2025-12-05 06:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6938a0fa-104a-4dc5-b6cc-027ca94f7395_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6938a0fa-104a-4dc5-b6cc-027ca94f7395_5.jpg not downloaded yet
2025-12-05 06:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6938a0fa-104a-4dc5-b6cc-027ca94f7395_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6938a0fa-104a-4dc5-b6cc-027ca94f7395_4.jpg not downloaded yet
2025-12-05 06:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6938a0fa-104a-4dc5-b6cc-027ca94f7395_11.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6938a0fa-104a-4dc5-b6cc-027ca94f7395_11.jpg not downloaded yet
2025-12-05 06:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6938a0fa-104a-4dc5-b6cc-027ca94f7395_10.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6938a0fa-104a-4dc5-b6cc-027ca94f7395_10.jpg not downloaded yet
2025-12-05 06:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6938a0fa-104a-4dc5-b6cc-027ca94f7395_9.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6938a0fa-104a-4dc5-b6cc-027ca94f7395_9.jpg not downloaded yet
2025-12-05 06:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6938a0fa-104a-4dc5-b6cc-027ca94f7395_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6938a0fa-104a-4dc5-b6cc-027ca94f7395_ext_2.jpg not downloaded yet
2025-12-05 06:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6938a0fa-104a-4dc5-b6cc-027ca94f7395_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6938a0fa-104a-4dc5-b6cc-027ca94f7395_ext_5.jpg not downloaded yet
2025-12-05 06:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6938a0fa-104a-4dc5-b6cc-027ca94f7395_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6938a0fa-104a-4dc5-b6cc-027ca94f7395_ext_3.jpg not downloaded yet
2025-12-05 06:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6938a0fa-104a-4dc5-b6cc-027ca94f7395_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6938a0fa-104a-4dc5-b6cc-027ca94f7395_ext_4.jpg not downloaded yet
2025-12-05 06:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3135542-4008753-13.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3135542-4008753-13.jpg not downloaded yet
2025-12-05 06:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3135542-4008753-1000.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3135542-4008753-1000.jpg not downloaded yet
2025-12-05 06:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3135542-4008753-1001.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3135542-4008753-1001.jpg not downloaded yet
2025-12-05 06:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3135542-4008753-1002.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3135542-4008753-1002.jpg not downloaded yet
2025-12-05 06:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3135542-4008753-1003.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3135542-4008753-1003.jpg not downloaded yet
2025-12-05 06:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3135542-4008753-1004.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3135542-4008753-1004.jpg not downloaded yet
2025-12-05 06:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3135542-4008753-1005.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3135542-4008753-1005.jpg not downloaded yet
2025-12-05 06:09:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003076903-01942114-003.pdf> (referer: None)
2025-12-05 06:09:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:09:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:09:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:09:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341f26410>
2025-12-05 06:09:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:09:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:09:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:09:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:09:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:09:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:09:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ee7b29f-1fa0-5e83-baa7-07d6d49f05b1/5ee7b29f-1fa0-5e83-baa7-07d6d49f05b1_expert_report_file_f5430048-e4b4-4873-99fa-c73323996350.pdf HTTP/1.1" 201 0
2025-12-05 06:09:23 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 5ee7b29f-1fa0-5e83-baa7-07d6d49f05b1
2025-12-05 06:09:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5ee7b29f-1fa0-5e83-baa7-07d6d49f05b1, skipping ID generation
2025-12-05 06:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 5ee7b29f-1fa0-5e83-baa7-07d6d49f05b1
2025-12-05 06:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F576d175a-7614-406b-a36b-088ac4738eb6_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/576d175a-7614-406b-a36b-088ac4738eb6_ext_7.jpg already downloaded
2025-12-05 06:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F576d175a-7614-406b-a36b-088ac4738eb6_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/576d175a-7614-406b-a36b-088ac4738eb6_ext_7.jpg already downloaded
2025-12-05 06:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F576d175a-7614-406b-a36b-088ac4738eb6_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/576d175a-7614-406b-a36b-088ac4738eb6_ext_6.jpg already downloaded
2025-12-05 06:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F576d175a-7614-406b-a36b-088ac4738eb6_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/576d175a-7614-406b-a36b-088ac4738eb6_ext_1.jpg already downloaded
2025-12-05 06:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F576d175a-7614-406b-a36b-088ac4738eb6_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/576d175a-7614-406b-a36b-088ac4738eb6_5.jpg already downloaded
2025-12-05 06:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F576d175a-7614-406b-a36b-088ac4738eb6_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/576d175a-7614-406b-a36b-088ac4738eb6_4.jpg already downloaded
2025-12-05 06:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F576d175a-7614-406b-a36b-088ac4738eb6_11.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/576d175a-7614-406b-a36b-088ac4738eb6_11.jpg already downloaded
2025-12-05 06:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F576d175a-7614-406b-a36b-088ac4738eb6_10.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/576d175a-7614-406b-a36b-088ac4738eb6_10.jpg already downloaded
2025-12-05 06:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F576d175a-7614-406b-a36b-088ac4738eb6_9.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/576d175a-7614-406b-a36b-088ac4738eb6_9.jpg already downloaded
2025-12-05 06:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F576d175a-7614-406b-a36b-088ac4738eb6_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/576d175a-7614-406b-a36b-088ac4738eb6_ext_2.jpg already downloaded
2025-12-05 06:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F576d175a-7614-406b-a36b-088ac4738eb6_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/576d175a-7614-406b-a36b-088ac4738eb6_ext_5.jpg already downloaded
2025-12-05 06:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F576d175a-7614-406b-a36b-088ac4738eb6_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/576d175a-7614-406b-a36b-088ac4738eb6_ext_3.jpg already downloaded
2025-12-05 06:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F576d175a-7614-406b-a36b-088ac4738eb6_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/576d175a-7614-406b-a36b-088ac4738eb6_ext_4.jpg already downloaded
2025-12-05 06:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3076903-3952525-13.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3076903-3952525-13.jpg already downloaded
2025-12-05 06:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3076903-3952525-1000.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3076903-3952525-1000.jpg already downloaded
2025-12-05 06:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3076903-3952525-1001.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3076903-3952525-1001.jpg already downloaded
2025-12-05 06:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3076903-3952525-1002.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3076903-3952525-1002.jpg already downloaded
2025-12-05 06:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3076903-3952525-1003.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3076903-3952525-1003.jpg already downloaded
2025-12-05 06:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3076903-3952525-1004.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3076903-3952525-1004.jpg already downloaded
2025-12-05 06:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3076903-3952525-1005.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3076903-3952525-1005.jpg already downloaded
2025-12-05 06:09:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 5ee7b29f-1fa0-5e83-baa7-07d6d49f05b1, identifier: 3076903
2025-12-05 06:09:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 5ee7b29f-1fa0-5e83-baa7-07d6d49f05b1 with identifier: 3076903
2025-12-05 06:09:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 5ee7b29f-1fa0-5e83-baa7-07d6d49f05b1 with identifier: 3076903
2025-12-05 06:09:24 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 5ee7b29f-1fa0-5e83-baa7-07d6d49f05b1 with identifier: 3076903 to the API
2025-12-05 06:09:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 06:09:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 06:09:24 [scrapy.core.scraper] DEBUG: Scraped from <200 http://ecr.manheim.co.uk/pdf/MOL-0003076903-01942114-003.pdf>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ee7b29f-1fa0-5e83-baa7-07d6d49f05b1/5ee7b29f-1fa0-5e83-baa7-07d6d49f05b1_expert_report_file_f5430048-e4b4-4873-99fa-c73323996350.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003076903-01942114-003.pdf',
 'color': 'Black',
 'currency': 'GBP',
 'engine': '1.5L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '5ee7b29f-1fa0-5e83-baa7-07d6d49f05b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'AY69WVM',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/DS/DS%207?id=3076903',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'DS',
 'model': 'DS 7',
 'odometer': 71062,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 39,
 'photo_urls': ['http://images.manheim.co.uk/images/units/zoom/576d175a-7614-406b-a36b-088ac4738eb6_ext_7.jpg',
                'http://images.manheim.co.uk/images/units/zoom/576d175a-7614-406b-a36b-088ac4738eb6_ext_7.jpg',
                'http://images.manheim.co.uk/images/units/zoom/576d175a-7614-406b-a36b-088ac4738eb6_ext_6.jpg',
                'http://images.manheim.co.uk/images/units/zoom/576d175a-7614-406b-a36b-088ac4738eb6_ext_1.jpg',
                'http://images.manheim.co.uk/images/units/zoom/576d175a-7614-406b-a36b-088ac4738eb6_5.jpg',
                'http://images.manheim.co.uk/images/units/zoom/576d175a-7614-406b-a36b-088ac4738eb6_4.jpg',
                'http://images.manheim.co.uk/images/units/zoom/576d175a-7614-406b-a36b-088ac4738eb6_11.jpg',
                'http://images.manheim.co.uk/images/units/zoom/576d175a-7614-406b-a36b-088ac4738eb6_10.jpg',
                'http://images.manheim.co.uk/images/units/zoom/576d175a-7614-406b-a36b-088ac4738eb6_9.jpg',
                'http://images.manheim.co.uk/images/units/zoom/576d175a-7614-406b-a36b-088ac4738eb6_ext_2.jpg',
                'http://images.manheim.co.uk/images/units/zoom/576d175a-7614-406b-a36b-088ac4738eb6_ext_5.jpg',
                'http://images.manheim.co.uk/images/units/zoom/576d175a-7614-406b-a36b-088ac4738eb6_ext_3.jpg',
                'http://images.manheim.co.uk/images/units/zoom/576d175a-7614-406b-a36b-088ac4738eb6_ext_4.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3076903-3952525-13.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3076903-3952525-1000.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3076903-3952525-1001.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3076903-3952525-1002.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3076903-3952525-1003.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3076903-3952525-1004.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3076903-3952525-1005.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ee7b29f-1fa0-5e83-baa7-07d6d49f05b1/5ee7b29f-1fa0-5e83-baa7-07d6d49f05b1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 122505,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/576d175a-7614-406b-a36b-088ac4738eb6_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ee7b29f-1fa0-5e83-baa7-07d6d49f05b1/5ee7b29f-1fa0-5e83-baa7-07d6d49f05b1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 122505,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/576d175a-7614-406b-a36b-088ac4738eb6_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ee7b29f-1fa0-5e83-baa7-07d6d49f05b1/5ee7b29f-1fa0-5e83-baa7-07d6d49f05b1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 262408,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/576d175a-7614-406b-a36b-088ac4738eb6_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ee7b29f-1fa0-5e83-baa7-07d6d49f05b1/5ee7b29f-1fa0-5e83-baa7-07d6d49f05b1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 125202,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/576d175a-7614-406b-a36b-088ac4738eb6_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ee7b29f-1fa0-5e83-baa7-07d6d49f05b1/5ee7b29f-1fa0-5e83-baa7-07d6d49f05b1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 123338,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/576d175a-7614-406b-a36b-088ac4738eb6_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ee7b29f-1fa0-5e83-baa7-07d6d49f05b1/5ee7b29f-1fa0-5e83-baa7-07d6d49f05b1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120941,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/576d175a-7614-406b-a36b-088ac4738eb6_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ee7b29f-1fa0-5e83-baa7-07d6d49f05b1/5ee7b29f-1fa0-5e83-baa7-07d6d49f05b1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 126943,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/576d175a-7614-406b-a36b-088ac4738eb6_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ee7b29f-1fa0-5e83-baa7-07d6d49f05b1/5ee7b29f-1fa0-5e83-baa7-07d6d49f05b1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121528,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/576d175a-7614-406b-a36b-088ac4738eb6_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ee7b29f-1fa0-5e83-baa7-07d6d49f05b1/5ee7b29f-1fa0-5e83-baa7-07d6d49f05b1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 123760,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/576d175a-7614-406b-a36b-088ac4738eb6_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ee7b29f-1fa0-5e83-baa7-07d6d49f05b1/5ee7b29f-1fa0-5e83-baa7-07d6d49f05b1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 275024,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/576d175a-7614-406b-a36b-088ac4738eb6_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ee7b29f-1fa0-5e83-baa7-07d6d49f05b1/5ee7b29f-1fa0-5e83-baa7-07d6d49f05b1_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 273184,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/576d175a-7614-406b-a36b-088ac4738eb6_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ee7b29f-1fa0-5e83-baa7-07d6d49f05b1/5ee7b29f-1fa0-5e83-baa7-07d6d49f05b1_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 262556,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/576d175a-7614-406b-a36b-088ac4738eb6_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ee7b29f-1fa0-5e83-baa7-07d6d49f05b1/5ee7b29f-1fa0-5e83-baa7-07d6d49f05b1_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 263597,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/576d175a-7614-406b-a36b-088ac4738eb6_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ee7b29f-1fa0-5e83-baa7-07d6d49f05b1/5ee7b29f-1fa0-5e83-baa7-07d6d49f05b1_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 409574,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3076903-3952525-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ee7b29f-1fa0-5e83-baa7-07d6d49f05b1/5ee7b29f-1fa0-5e83-baa7-07d6d49f05b1_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 403152,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3076903-3952525-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ee7b29f-1fa0-5e83-baa7-07d6d49f05b1/5ee7b29f-1fa0-5e83-baa7-07d6d49f05b1_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 368262,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3076903-3952525-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ee7b29f-1fa0-5e83-baa7-07d6d49f05b1/5ee7b29f-1fa0-5e83-baa7-07d6d49f05b1_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 302750,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3076903-3952525-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ee7b29f-1fa0-5e83-baa7-07d6d49f05b1/5ee7b29f-1fa0-5e83-baa7-07d6d49f05b1_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 457947,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3076903-3952525-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ee7b29f-1fa0-5e83-baa7-07d6d49f05b1/5ee7b29f-1fa0-5e83-baa7-07d6d49f05b1_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 315258,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3076903-3952525-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ee7b29f-1fa0-5e83-baa7-07d6d49f05b1/5ee7b29f-1fa0-5e83-baa7-07d6d49f05b1_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 265841,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3076903-3952525-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-29',
 'seller_name': 'John Banks',
 'title': 'DS DS 7 1.5 BlueHDi Performance Line 5dr EAT8',
 'transmission': 'automatic',
 'trim': '1.5 BlueHDi Performance Line 5dr EAT8',
 'year': 2019}
2025-12-05 06:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273076903%27 HTTP/1.1" 200 None
2025-12-05 06:09:24 [manheim.gb] INFO: Saving data for 3076903: {'created_time': 1764914964.493661, 'last_price_update_time': 1764914964.493673, 'auction_closing_time': 1765270800.0}
2025-12-05 06:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3076903') HTTP/1.1" 204 0
2025-12-05 06:09:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3135542-4008753-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003135542-01992447-003.pdf)
2025-12-05 06:09:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:09:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:09:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:09:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234158a890>
2025-12-05 06:09:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:09:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:09:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:09:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:09:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:09:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:09:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c3248f4-6c83-56f0-9760-c7fd8e4af8b1/6c3248f4-6c83-56f0-9760-c7fd8e4af8b1_image_19.jpg HTTP/1.1" 201 0
2025-12-05 06:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3135542-4008753-1005.jpg') HTTP/1.1" 204 0
2025-12-05 06:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3135542-4008753-1005.jpg saved to cache
2025-12-05 06:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 6c3248f4-6c83-56f0-9760-c7fd8e4af8b1
2025-12-05 06:09:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3135542-4008753-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003135542-01992447-003.pdf)
2025-12-05 06:09:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:09:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:09:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:09:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342891bd0>
2025-12-05 06:09:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:09:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:09:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:09:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:09:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:09:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:09:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c3248f4-6c83-56f0-9760-c7fd8e4af8b1/6c3248f4-6c83-56f0-9760-c7fd8e4af8b1_image_18.jpg HTTP/1.1" 201 0
2025-12-05 06:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3135542-4008753-1004.jpg') HTTP/1.1" 204 0
2025-12-05 06:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3135542-4008753-1004.jpg saved to cache
2025-12-05 06:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 6c3248f4-6c83-56f0-9760-c7fd8e4af8b1
2025-12-05 06:09:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VOLVO/V90?id=3066375&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233066375&indx=159> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:09:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:09:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3135542-4008753-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003135542-01992447-003.pdf)
2025-12-05 06:09:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dbf77d7d-605a-50a8-94f3-08cb5e8c2d9c with identifier: 3066375
2025-12-05 06:09:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbf77d7d-605a-50a8-94f3-08cb5e8c2d9c with scrape type 2
2025-12-05 06:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dbf77d7d-605a-50a8-94f3-08cb5e8c2d9c with scrape type 2
2025-12-05 06:09:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: dbf77d7d-605a-50a8-94f3-08cb5e8c2d9c, identifier: 3066375
2025-12-05 06:09:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: dbf77d7d-605a-50a8-94f3-08cb5e8c2d9c with identifier: 3066375
2025-12-05 06:09:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: dbf77d7d-605a-50a8-94f3-08cb5e8c2d9c with identifier: 3066375
2025-12-05 06:09:25 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': 'lloyd motor group', 'price_includes_vat': False, 'title': 'volvo v90 2.0 d4 inscription 5dr geartronic', 'price': 0, 'currency': 'gbp', 'make': 'volvo', 'model': 'v90', 'transmission': 'automatic', 'engine': '2.0l', 'fuel_type': 'diesel', 'odometer': 126533, 'odometer_reading_unit': 'mi', 'registration_date': '2019-09-27', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/volvo/v90?id=3066375', 'location': 'leeds', 'origin_country_code': 'gb', 'trim': '2.0 d4 inscription 5dr geartronic', 'license_plate': 'sk69wzx', 'year': 2019, 'listing': 'directbuy', 'c_o_2_emission_value': 129, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0003066375-01966881-002.pdf', 'expiration_date': '2025-12-10t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': 'dbf77d7d-605a-50a8-94f3-08cb5e8c2d9c', 'current_year_diff': 6, 'age_in_months': 74, 'make_model': 'volvo v90', 'sanitized_make': 'volvo', 'odometer_in_km': 203634}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 74,
     'auction_title': '',
     'c_o_2_emission_value': 129,
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0003066375-01966881-002.pdf',
     'color': 'blue',
     'currency': 'gbp',
     'current_year_diff': 6,
     'engine': '2.0l',
     'expiration_date': '2025-12-10t09:00:00z',
     'fuel_type': 'diesel',
     'id': 'dbf77d7d-605a-50a8-94f3-08cb5e8c2d9c',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'sk69wzx',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/volvo/v90?id=3066375',
     'listing': 'directbuy',
     'location': 'leeds',
     'make': 'volvo',
     'make_model': 'volvo v90',
     'model': 'v90',
     'odometer': 126533,
     'odometer_in_km': 203634,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2019-09-27',
     'sanitized_make': 'volvo',
     'seller_name': 'lloyd motor group',
     'title': 'volvo v90 2.0 d4 inscription 5dr geartronic',
     'transmission': 'automatic',
     'trim': '2.0 d4 inscription 5dr geartronic',
     'year': 2019}
2025-12-05 06:09:25 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: dbf77d7d-605a-50a8-94f3-08cb5e8c2d9c spider: manheim.gb
2025-12-05 06:09:25 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: dbf77d7d-605a-50a8-94f3-08cb5e8c2d9c due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': 'lloyd motor group', 'price_includes_vat': False, 'title': 'volvo v90 2.0 d4 inscription 5dr geartronic', 'price': 0, 'currency': 'gbp', 'make': 'volvo', 'model': 'v90', 'transmission': 'automatic', 'engine': '2.0l', 'fuel_type': 'diesel', 'odometer': 126533, 'odometer_reading_unit': 'mi', 'registration_date': '2019-09-27', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/volvo/v90?id=3066375', 'location': 'leeds', 'origin_country_code': 'gb', 'trim': '2.0 d4 inscription 5dr geartronic', 'license_plate': 'sk69wzx', 'year': 2019, 'listing': 'directbuy', 'c_o_2_emission_value': 129, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0003066375-01966881-002.pdf', 'expiration_date': '2025-12-10t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': 'dbf77d7d-605a-50a8-94f3-08cb5e8c2d9c', 'current_year_diff': 6, 'age_in_months': 74, 'make_model': 'volvo v90', 'sanitized_make': 'volvo', 'odometer_in_km': 203634}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 74,
     'auction_title': '',
     'c_o_2_emission_value': 129,
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0003066375-01966881-002.pdf',
     'color': 'blue',
     'currency': 'gbp',
     'current_year_diff': 6,
     'engine': '2.0l',
     'expiration_date': '2025-12-10t09:00:00z',
     'fuel_type': 'diesel',
     'id': 'dbf77d7d-605a-50a8-94f3-08cb5e8c2d9c',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'sk69wzx',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/volvo/v90?id=3066375',
     'listing': 'directbuy',
     'location': 'leeds',
     'make': 'volvo',
     'make_model': 'volvo v90',
     'model': 'v90',
     'odometer': 126533,
     'odometer_in_km': 203634,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2019-09-27',
     'sanitized_make': 'volvo',
     'seller_name': 'lloyd motor group',
     'title': 'volvo v90 2.0 d4 inscription 5dr geartronic',
     'transmission': 'automatic',
     'trim': '2.0 d4 inscription 5dr geartronic',
     'year': 2019}
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003066375-01966881-002.pdf',
 'color': 'BLUE',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': '2025-12-10T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'dbf77d7d-605a-50a8-94f3-08cb5e8c2d9c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'SK69WZX',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VOLVO/V90?id=3066375',
 'listing': 'directbuy',
 'location': 'Leeds',
 'make': 'VOLVO',
 'model': 'V90',
 'odometer': 126533,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-27',
 'seller_name': 'Lloyd Motor Group',
 'title': 'VOLVO V90 2.0 D4 Inscription 5dr Geartronic',
 'transmission': 'automatic',
 'trim': '2.0 D4 Inscription 5dr Geartronic',
 'year': 2019}
2025-12-05 06:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273066375%27 HTTP/1.1" 200 None
2025-12-05 06:09:25 [manheim.gb] INFO: Saving data for 3066375: {'auction_closing_time': 1765357200.0, 'created_time': 1764792495.161918, 'last_price_update_time': 1764914965.929443}
2025-12-05 06:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3066375') HTTP/1.1" 204 0
2025-12-05 06:09:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:09:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:09:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:09:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23428cd750>
2025-12-05 06:09:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:09:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:09:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:09:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:09:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:09:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:09:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c3248f4-6c83-56f0-9760-c7fd8e4af8b1/6c3248f4-6c83-56f0-9760-c7fd8e4af8b1_image_17.jpg HTTP/1.1" 201 0
2025-12-05 06:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3135542-4008753-1003.jpg') HTTP/1.1" 204 0
2025-12-05 06:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3135542-4008753-1003.jpg saved to cache
2025-12-05 06:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 6c3248f4-6c83-56f0-9760-c7fd8e4af8b1
2025-12-05 06:09:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3135542-4008753-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003135542-01992447-003.pdf)
2025-12-05 06:09:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3135542-4008753-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003135542-01992447-003.pdf)
2025-12-05 06:09:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:09:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:09:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:09:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23426af0d0>
2025-12-05 06:09:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:09:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:09:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:09:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:09:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:09:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:09:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c3248f4-6c83-56f0-9760-c7fd8e4af8b1/6c3248f4-6c83-56f0-9760-c7fd8e4af8b1_image_15.jpg HTTP/1.1" 201 0
2025-12-05 06:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3135542-4008753-1001.jpg') HTTP/1.1" 204 0
2025-12-05 06:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3135542-4008753-1001.jpg saved to cache
2025-12-05 06:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 6c3248f4-6c83-56f0-9760-c7fd8e4af8b1
2025-12-05 06:09:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:09:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:09:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:09:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23427c3fd0>
2025-12-05 06:09:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:09:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:09:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:09:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:09:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:09:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:09:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c3248f4-6c83-56f0-9760-c7fd8e4af8b1/6c3248f4-6c83-56f0-9760-c7fd8e4af8b1_image_16.jpg HTTP/1.1" 201 0
2025-12-05 06:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3135542-4008753-1002.jpg') HTTP/1.1" 204 0
2025-12-05 06:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3135542-4008753-1002.jpg saved to cache
2025-12-05 06:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 6c3248f4-6c83-56f0-9760-c7fd8e4af8b1
2025-12-05 06:09:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3135542-4008753-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003135542-01992447-003.pdf)
2025-12-05 06:09:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3135542-4008753-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003135542-01992447-003.pdf)
2025-12-05 06:09:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:09:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:09:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:09:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23424f77d0>
2025-12-05 06:09:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:09:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:09:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:09:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:09:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:09:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:09:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c3248f4-6c83-56f0-9760-c7fd8e4af8b1/6c3248f4-6c83-56f0-9760-c7fd8e4af8b1_image_14.jpg HTTP/1.1" 201 0
2025-12-05 06:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3135542-4008753-1000.jpg') HTTP/1.1" 204 0
2025-12-05 06:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3135542-4008753-1000.jpg saved to cache
2025-12-05 06:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 6c3248f4-6c83-56f0-9760-c7fd8e4af8b1
2025-12-05 06:09:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/MAZDA/CX5?id=3004217&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233004217&indx=153> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:09:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:09:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:09:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:09:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23427c1210>
2025-12-05 06:09:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:09:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:09:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:09:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:09:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:09:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:09:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c3248f4-6c83-56f0-9760-c7fd8e4af8b1/6c3248f4-6c83-56f0-9760-c7fd8e4af8b1_image_13.jpg HTTP/1.1" 201 0
2025-12-05 06:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3135542-4008753-13.jpg') HTTP/1.1" 204 0
2025-12-05 06:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3135542-4008753-13.jpg saved to cache
2025-12-05 06:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 6c3248f4-6c83-56f0-9760-c7fd8e4af8b1
2025-12-05 06:09:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:09:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/6938a0fa-104a-4dc5-b6cc-027ca94f7395_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003135542-01992447-003.pdf)
2025-12-05 06:09:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/6938a0fa-104a-4dc5-b6cc-027ca94f7395_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003135542-01992447-003.pdf)
2025-12-05 06:09:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0c54a04-921a-5d40-8011-f4191f63cc27 with identifier: 3004217
2025-12-05 06:09:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0c54a04-921a-5d40-8011-f4191f63cc27 with scrape type 2
2025-12-05 06:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b0c54a04-921a-5d40-8011-f4191f63cc27 with scrape type 2
2025-12-05 06:09:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: b0c54a04-921a-5d40-8011-f4191f63cc27, identifier: 3004217
2025-12-05 06:09:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: b0c54a04-921a-5d40-8011-f4191f63cc27 with identifier: 3004217
2025-12-05 06:09:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: b0c54a04-921a-5d40-8011-f4191f63cc27 with identifier: 3004217
2025-12-05 06:09:27 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 167511 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    167511
2025-12-05 06:09:27 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: b0c54a04-921a-5d40-8011-f4191f63cc27 spider: manheim.gb
2025-12-05 06:09:27 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: b0c54a04-921a-5d40-8011-f4191f63cc27 due to rule: high_mileage_for_country.json, error: 167511 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    167511
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003004217-01989667-004.pdf',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '2.2L',
 'expiration_date': '2025-12-10T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'b0c54a04-921a-5d40-8011-f4191f63cc27',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'OW62JJU',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MAZDA/CX-5?id=3004217',
 'listing': 'auction',
 'location': 'Plymouth',
 'make': 'MAZDA',
 'model': 'CX-5',
 'odometer': 104087,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-08',
 'seller_name': 'Vospers Group',
 'title': 'MAZDA CX-5 2.2d [175] Sport Nav 5dr AWD',
 'transmission': 'manual',
 'trim': '2.2d [175] Sport Nav 5dr AWD',
 'year': 2013}
2025-12-05 06:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273004217%27 HTTP/1.1" 200 None
2025-12-05 06:09:27 [manheim.gb] INFO: Saving data for 3004217: {'auction_closing_time': 1765357200.0, 'created_time': 1764756203.418337, 'last_price_update_time': 1764914967.947621}
2025-12-05 06:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3004217') HTTP/1.1" 204 0
2025-12-05 06:09:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/6938a0fa-104a-4dc5-b6cc-027ca94f7395_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003135542-01992447-003.pdf)
2025-12-05 06:09:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/6938a0fa-104a-4dc5-b6cc-027ca94f7395_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003135542-01992447-003.pdf)
2025-12-05 06:09:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:09:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:09:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:09:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23426ae210>
2025-12-05 06:09:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:09:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:09:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:09:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:09:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:09:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:09:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c3248f4-6c83-56f0-9760-c7fd8e4af8b1/6c3248f4-6c83-56f0-9760-c7fd8e4af8b1_image_11.jpg HTTP/1.1" 201 0
2025-12-05 06:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6938a0fa-104a-4dc5-b6cc-027ca94f7395_ext_3.jpg') HTTP/1.1" 204 0
2025-12-05 06:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6938a0fa-104a-4dc5-b6cc-027ca94f7395_ext_3.jpg saved to cache
2025-12-05 06:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 6c3248f4-6c83-56f0-9760-c7fd8e4af8b1
2025-12-05 06:09:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:09:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:09:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:09:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23426e4510>
2025-12-05 06:09:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:09:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:09:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:09:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:09:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:09:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:09:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c3248f4-6c83-56f0-9760-c7fd8e4af8b1/6c3248f4-6c83-56f0-9760-c7fd8e4af8b1_image_12.jpg HTTP/1.1" 201 0
2025-12-05 06:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6938a0fa-104a-4dc5-b6cc-027ca94f7395_ext_4.jpg') HTTP/1.1" 204 0
2025-12-05 06:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6938a0fa-104a-4dc5-b6cc-027ca94f7395_ext_4.jpg saved to cache
2025-12-05 06:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 6c3248f4-6c83-56f0-9760-c7fd8e4af8b1
2025-12-05 06:09:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/6938a0fa-104a-4dc5-b6cc-027ca94f7395_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003135542-01992447-003.pdf)
2025-12-05 06:09:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:09:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:09:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:09:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342801810>
2025-12-05 06:09:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:09:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:09:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:09:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:09:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:09:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:09:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c3248f4-6c83-56f0-9760-c7fd8e4af8b1/6c3248f4-6c83-56f0-9760-c7fd8e4af8b1_image_10.jpg HTTP/1.1" 201 0
2025-12-05 06:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6938a0fa-104a-4dc5-b6cc-027ca94f7395_ext_5.jpg') HTTP/1.1" 204 0
2025-12-05 06:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6938a0fa-104a-4dc5-b6cc-027ca94f7395_ext_5.jpg saved to cache
2025-12-05 06:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 6c3248f4-6c83-56f0-9760-c7fd8e4af8b1
2025-12-05 06:09:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:09:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:09:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:09:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342696650>
2025-12-05 06:09:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:09:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:09:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:09:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:09:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:09:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:09:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c3248f4-6c83-56f0-9760-c7fd8e4af8b1/6c3248f4-6c83-56f0-9760-c7fd8e4af8b1_image_8.jpg HTTP/1.1" 201 0
2025-12-05 06:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6938a0fa-104a-4dc5-b6cc-027ca94f7395_9.jpg') HTTP/1.1" 204 0
2025-12-05 06:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6938a0fa-104a-4dc5-b6cc-027ca94f7395_9.jpg saved to cache
2025-12-05 06:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6c3248f4-6c83-56f0-9760-c7fd8e4af8b1
2025-12-05 06:09:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/6938a0fa-104a-4dc5-b6cc-027ca94f7395_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003135542-01992447-003.pdf)
2025-12-05 06:09:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/6938a0fa-104a-4dc5-b6cc-027ca94f7395_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003135542-01992447-003.pdf)
2025-12-05 06:09:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/6938a0fa-104a-4dc5-b6cc-027ca94f7395_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003135542-01992447-003.pdf)
2025-12-05 06:09:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:09:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:09:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:09:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23428e0d10>
2025-12-05 06:09:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:09:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:09:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:09:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:09:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:09:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:09:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c3248f4-6c83-56f0-9760-c7fd8e4af8b1/6c3248f4-6c83-56f0-9760-c7fd8e4af8b1_image_9.jpg HTTP/1.1" 201 0
2025-12-05 06:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6938a0fa-104a-4dc5-b6cc-027ca94f7395_ext_2.jpg') HTTP/1.1" 204 0
2025-12-05 06:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6938a0fa-104a-4dc5-b6cc-027ca94f7395_ext_2.jpg saved to cache
2025-12-05 06:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6c3248f4-6c83-56f0-9760-c7fd8e4af8b1
2025-12-05 06:09:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:09:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:09:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:09:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23415c0c10>
2025-12-05 06:09:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:09:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:09:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:09:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:09:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:09:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:09:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c3248f4-6c83-56f0-9760-c7fd8e4af8b1/6c3248f4-6c83-56f0-9760-c7fd8e4af8b1_image_6.jpg HTTP/1.1" 201 0
2025-12-05 06:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6938a0fa-104a-4dc5-b6cc-027ca94f7395_11.jpg') HTTP/1.1" 204 0
2025-12-05 06:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6938a0fa-104a-4dc5-b6cc-027ca94f7395_11.jpg saved to cache
2025-12-05 06:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6c3248f4-6c83-56f0-9760-c7fd8e4af8b1
2025-12-05 06:09:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:09:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:09:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:09:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342513ed0>
2025-12-05 06:09:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:09:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:09:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:09:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:09:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:09:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:09:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c3248f4-6c83-56f0-9760-c7fd8e4af8b1/6c3248f4-6c83-56f0-9760-c7fd8e4af8b1_image_7.jpg HTTP/1.1" 201 0
2025-12-05 06:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6938a0fa-104a-4dc5-b6cc-027ca94f7395_10.jpg') HTTP/1.1" 204 0
2025-12-05 06:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6938a0fa-104a-4dc5-b6cc-027ca94f7395_10.jpg saved to cache
2025-12-05 06:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6c3248f4-6c83-56f0-9760-c7fd8e4af8b1
2025-12-05 06:09:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:09:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:09:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:09:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23428c7ed0>
2025-12-05 06:09:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:09:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:09:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:09:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:09:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:09:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:09:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c3248f4-6c83-56f0-9760-c7fd8e4af8b1/6c3248f4-6c83-56f0-9760-c7fd8e4af8b1_image_5.jpg HTTP/1.1" 201 0
2025-12-05 06:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6938a0fa-104a-4dc5-b6cc-027ca94f7395_4.jpg') HTTP/1.1" 204 0
2025-12-05 06:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6938a0fa-104a-4dc5-b6cc-027ca94f7395_4.jpg saved to cache
2025-12-05 06:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6c3248f4-6c83-56f0-9760-c7fd8e4af8b1
2025-12-05 06:09:30 [scrapy.extensions.logstats] INFO: Crawled 167 pages (at 16 pages/min), scraped 60 items (at 4 items/min)
2025-12-05 06:09:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/PEUGEOT/2008?id=3107402&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233107402&indx=161> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:09:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/6938a0fa-104a-4dc5-b6cc-027ca94f7395_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003135542-01992447-003.pdf)
2025-12-05 06:09:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:09:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/6938a0fa-104a-4dc5-b6cc-027ca94f7395_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003135542-01992447-003.pdf)
2025-12-05 06:09:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/6938a0fa-104a-4dc5-b6cc-027ca94f7395_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003135542-01992447-003.pdf)
2025-12-05 06:09:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 662d60d8-4d20-5417-8c09-f94055679a8b with identifier: 3107402
2025-12-05 06:09:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 662d60d8-4d20-5417-8c09-f94055679a8b with scrape type 2
2025-12-05 06:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 662d60d8-4d20-5417-8c09-f94055679a8b with scrape type 2
2025-12-05 06:09:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 662d60d8-4d20-5417-8c09-f94055679a8b, identifier: 3107402
2025-12-05 06:09:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 662d60d8-4d20-5417-8c09-f94055679a8b with identifier: 3107402
2025-12-05 06:09:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 662d60d8-4d20-5417-8c09-f94055679a8b with identifier: 3107402
2025-12-05 06:09:30 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 662d60d8-4d20-5417-8c09-f94055679a8b with identifier: 3107402 to the API
2025-12-05 06:09:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 06:09:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 06:09:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/PEUGEOT/2008?id=3107402&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233107402&indx=161>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003107402-41-83486255-001.pdf',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '662d60d8-4d20-5417-8c09-f94055679a8b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'FV68KVU',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/PEUGEOT/2008?id=3107402',
 'listing': 'auction',
 'location': 'Bristol',
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 75232,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-31',
 'seller_name': 'MotoNovo Finance',
 'title': 'PEUGEOT 2008 1.2 PureTech 130 GT Line 5dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech 130 GT Line 5dr',
 'year': 2018}
2025-12-05 06:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273107402%27 HTTP/1.1" 200 None
2025-12-05 06:09:31 [manheim.gb] INFO: Saving data for 3107402: {'auction_closing_time': 1765270800.0, 'created_time': 1764792477.027595, 'last_price_update_time': 1764914971.296124}
2025-12-05 06:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3107402') HTTP/1.1" 204 0
2025-12-05 06:09:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:09:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:09:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:09:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23426e4a90>
2025-12-05 06:09:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:09:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:09:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:09:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:09:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:09:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:09:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c3248f4-6c83-56f0-9760-c7fd8e4af8b1/6c3248f4-6c83-56f0-9760-c7fd8e4af8b1_image_4.jpg HTTP/1.1" 201 0
2025-12-05 06:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6938a0fa-104a-4dc5-b6cc-027ca94f7395_5.jpg') HTTP/1.1" 204 0
2025-12-05 06:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6938a0fa-104a-4dc5-b6cc-027ca94f7395_5.jpg saved to cache
2025-12-05 06:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6c3248f4-6c83-56f0-9760-c7fd8e4af8b1
2025-12-05 06:09:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/6938a0fa-104a-4dc5-b6cc-027ca94f7395_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003135542-01992447-003.pdf)
2025-12-05 06:09:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/6938a0fa-104a-4dc5-b6cc-027ca94f7395_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003135542-01992447-003.pdf)
2025-12-05 06:09:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:09:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:09:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:09:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341eb2fd0>
2025-12-05 06:09:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:09:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:09:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:09:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:09:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:09:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:09:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c3248f4-6c83-56f0-9760-c7fd8e4af8b1/6c3248f4-6c83-56f0-9760-c7fd8e4af8b1_image_2.jpg HTTP/1.1" 201 0
2025-12-05 06:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6938a0fa-104a-4dc5-b6cc-027ca94f7395_ext_6.jpg') HTTP/1.1" 204 0
2025-12-05 06:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6938a0fa-104a-4dc5-b6cc-027ca94f7395_ext_6.jpg saved to cache
2025-12-05 06:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6c3248f4-6c83-56f0-9760-c7fd8e4af8b1
2025-12-05 06:09:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:09:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:09:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:09:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2343d33790>
2025-12-05 06:09:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:09:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:09:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:09:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:09:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:09:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:09:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c3248f4-6c83-56f0-9760-c7fd8e4af8b1/6c3248f4-6c83-56f0-9760-c7fd8e4af8b1_image_3.jpg HTTP/1.1" 201 0
2025-12-05 06:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6938a0fa-104a-4dc5-b6cc-027ca94f7395_ext_1.jpg') HTTP/1.1" 204 0
2025-12-05 06:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6938a0fa-104a-4dc5-b6cc-027ca94f7395_ext_1.jpg saved to cache
2025-12-05 06:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6c3248f4-6c83-56f0-9760-c7fd8e4af8b1
2025-12-05 06:09:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:09:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:09:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:09:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342893a50>
2025-12-05 06:09:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:09:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:09:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:09:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:09:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:09:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:09:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c3248f4-6c83-56f0-9760-c7fd8e4af8b1/6c3248f4-6c83-56f0-9760-c7fd8e4af8b1_image_1.jpg HTTP/1.1" 201 0
2025-12-05 06:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6938a0fa-104a-4dc5-b6cc-027ca94f7395_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 06:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6938a0fa-104a-4dc5-b6cc-027ca94f7395_ext_7.jpg saved to cache
2025-12-05 06:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6c3248f4-6c83-56f0-9760-c7fd8e4af8b1
2025-12-05 06:09:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:09:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:09:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:09:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234158d910>
2025-12-05 06:09:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:09:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:09:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:09:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:09:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:09:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:09:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c3248f4-6c83-56f0-9760-c7fd8e4af8b1/6c3248f4-6c83-56f0-9760-c7fd8e4af8b1_image_0.jpg HTTP/1.1" 201 0
2025-12-05 06:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6938a0fa-104a-4dc5-b6cc-027ca94f7395_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 06:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6938a0fa-104a-4dc5-b6cc-027ca94f7395_ext_7.jpg saved to cache
2025-12-05 06:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6c3248f4-6c83-56f0-9760-c7fd8e4af8b1
2025-12-05 06:09:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6c3248f4-6c83-56f0-9760-c7fd8e4af8b1, skipping ID generation
2025-12-05 06:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 6c3248f4-6c83-56f0-9760-c7fd8e4af8b1 from tracking dictionaries
2025-12-05 06:09:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6c3248f4-6c83-56f0-9760-c7fd8e4af8b1 sending to next pipeline
2025-12-05 06:09:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 6c3248f4-6c83-56f0-9760-c7fd8e4af8b1, identifier: 3135542
2025-12-05 06:09:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 6c3248f4-6c83-56f0-9760-c7fd8e4af8b1 with identifier: 3135542
2025-12-05 06:09:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 6c3248f4-6c83-56f0-9760-c7fd8e4af8b1 with identifier: 3135542
2025-12-05 06:09:32 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 160771 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    160771
2025-12-05 06:09:32 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 6c3248f4-6c83-56f0-9760-c7fd8e4af8b1 spider: manheim.gb
2025-12-05 06:09:33 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 6c3248f4-6c83-56f0-9760-c7fd8e4af8b1 due to rule: high_mileage_for_country.json, error: 160771 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    160771
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c3248f4-6c83-56f0-9760-c7fd8e4af8b1/6c3248f4-6c83-56f0-9760-c7fd8e4af8b1_expert_report_file_39ecd7e0-1e5d-4811-9a69-03adbc435841.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003135542-01992447-003.pdf',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '1.0L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '6c3248f4-6c83-56f0-9760-c7fd8e4af8b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'LR16OKX',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VAUXHALL/CORSA?id=3135542',
 'listing': 'auction',
 'location': 'Manchester',
 'make': 'VAUXHALL',
 'model': 'CORSA',
 'odometer': 99899,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 39,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c3248f4-6c83-56f0-9760-c7fd8e4af8b1/6c3248f4-6c83-56f0-9760-c7fd8e4af8b1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 193675,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/6938a0fa-104a-4dc5-b6cc-027ca94f7395_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c3248f4-6c83-56f0-9760-c7fd8e4af8b1/6c3248f4-6c83-56f0-9760-c7fd8e4af8b1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 193675,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/6938a0fa-104a-4dc5-b6cc-027ca94f7395_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c3248f4-6c83-56f0-9760-c7fd8e4af8b1/6c3248f4-6c83-56f0-9760-c7fd8e4af8b1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 213072,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/6938a0fa-104a-4dc5-b6cc-027ca94f7395_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c3248f4-6c83-56f0-9760-c7fd8e4af8b1/6c3248f4-6c83-56f0-9760-c7fd8e4af8b1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 254006,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/6938a0fa-104a-4dc5-b6cc-027ca94f7395_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c3248f4-6c83-56f0-9760-c7fd8e4af8b1/6c3248f4-6c83-56f0-9760-c7fd8e4af8b1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 192057,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/6938a0fa-104a-4dc5-b6cc-027ca94f7395_5.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c3248f4-6c83-56f0-9760-c7fd8e4af8b1/6c3248f4-6c83-56f0-9760-c7fd8e4af8b1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 196757,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/6938a0fa-104a-4dc5-b6cc-027ca94f7395_4.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c3248f4-6c83-56f0-9760-c7fd8e4af8b1/6c3248f4-6c83-56f0-9760-c7fd8e4af8b1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 187239,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/6938a0fa-104a-4dc5-b6cc-027ca94f7395_11.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c3248f4-6c83-56f0-9760-c7fd8e4af8b1/6c3248f4-6c83-56f0-9760-c7fd8e4af8b1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 185765,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/6938a0fa-104a-4dc5-b6cc-027ca94f7395_10.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c3248f4-6c83-56f0-9760-c7fd8e4af8b1/6c3248f4-6c83-56f0-9760-c7fd8e4af8b1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 188039,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/6938a0fa-104a-4dc5-b6cc-027ca94f7395_9.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c3248f4-6c83-56f0-9760-c7fd8e4af8b1/6c3248f4-6c83-56f0-9760-c7fd8e4af8b1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 239149,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/6938a0fa-104a-4dc5-b6cc-027ca94f7395_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c3248f4-6c83-56f0-9760-c7fd8e4af8b1/6c3248f4-6c83-56f0-9760-c7fd8e4af8b1_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 129201,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/6938a0fa-104a-4dc5-b6cc-027ca94f7395_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c3248f4-6c83-56f0-9760-c7fd8e4af8b1/6c3248f4-6c83-56f0-9760-c7fd8e4af8b1_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 207550,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/6938a0fa-104a-4dc5-b6cc-027ca94f7395_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c3248f4-6c83-56f0-9760-c7fd8e4af8b1/6c3248f4-6c83-56f0-9760-c7fd8e4af8b1_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 273726,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/6938a0fa-104a-4dc5-b6cc-027ca94f7395_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c3248f4-6c83-56f0-9760-c7fd8e4af8b1/6c3248f4-6c83-56f0-9760-c7fd8e4af8b1_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 455662,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3135542-4008753-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c3248f4-6c83-56f0-9760-c7fd8e4af8b1/6c3248f4-6c83-56f0-9760-c7fd8e4af8b1_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347012,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3135542-4008753-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c3248f4-6c83-56f0-9760-c7fd8e4af8b1/6c3248f4-6c83-56f0-9760-c7fd8e4af8b1_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 292936,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3135542-4008753-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c3248f4-6c83-56f0-9760-c7fd8e4af8b1/6c3248f4-6c83-56f0-9760-c7fd8e4af8b1_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 453310,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3135542-4008753-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c3248f4-6c83-56f0-9760-c7fd8e4af8b1/6c3248f4-6c83-56f0-9760-c7fd8e4af8b1_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 248325,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3135542-4008753-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c3248f4-6c83-56f0-9760-c7fd8e4af8b1/6c3248f4-6c83-56f0-9760-c7fd8e4af8b1_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 317564,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3135542-4008753-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c3248f4-6c83-56f0-9760-c7fd8e4af8b1/6c3248f4-6c83-56f0-9760-c7fd8e4af8b1_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 292674,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3135542-4008753-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-31',
 'seller_name': 'LSH Auto Group',
 'title': 'VAUXHALL CORSA 1.0T 115 ecoFLEX SRi Vx-line 3dr',
 'transmission': 'manual',
 'trim': '1.0T 115 ecoFLEX SRi Vx-line 3dr',
 'year': 2016}
2025-12-05 06:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273135542%27 HTTP/1.1" 200 None
2025-12-05 06:09:33 [manheim.gb] INFO: Saving data for 3135542: {'created_time': 1764914973.046078, 'last_price_update_time': 1764914973.046089, 'auction_closing_time': 1765270800.0}
2025-12-05 06:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3135542') HTTP/1.1" 204 0
2025-12-05 06:09:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/HYUNDAI/TUCSON?id=2998686&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232998686&indx=152> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:09:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:09:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42e3d5c6-650d-50fc-869c-f49f82247a08 with identifier: 2998686
2025-12-05 06:09:34 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 42e3d5c6-650d-50fc-869c-f49f82247a08
2025-12-05 06:09:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/PEUGEOT/3008?id=3049627&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233049627&indx=156> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:09:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:09:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13167d67-53ca-56aa-b223-f51a7b0227e6 with identifier: 3049627
2025-12-05 06:09:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13167d67-53ca-56aa-b223-f51a7b0227e6 with scrape type 2
2025-12-05 06:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 13167d67-53ca-56aa-b223-f51a7b0227e6 with scrape type 2
2025-12-05 06:09:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 13167d67-53ca-56aa-b223-f51a7b0227e6, identifier: 3049627
2025-12-05 06:09:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 13167d67-53ca-56aa-b223-f51a7b0227e6 with identifier: 3049627
2025-12-05 06:09:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 13167d67-53ca-56aa-b223-f51a7b0227e6 with identifier: 3049627
2025-12-05 06:09:37 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 13167d67-53ca-56aa-b223-f51a7b0227e6 with identifier: 3049627 to the API
2025-12-05 06:09:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 06:09:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 06:09:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/PEUGEOT/3008?id=3049627&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233049627&indx=156>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003049627-01992769-001.pdf',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '13167d67-53ca-56aa-b223-f51a7b0227e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'LT69YVP',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/PEUGEOT/3008?id=3049627',
 'listing': 'auction',
 'location': 'Leeds',
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 45610,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-11',
 'seller_name': 'Mobilize Financial Services',
 'title': 'PEUGEOT 3008 1.6 PureTech 180 GT Line Premium 5dr EAT8',
 'transmission': 'automatic',
 'trim': '1.6 PureTech 180 GT Line Premium 5dr EAT8',
 'year': 2019}
2025-12-05 06:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273049627%27 HTTP/1.1" 200 None
2025-12-05 06:09:37 [manheim.gb] INFO: Saving data for 3049627: {'auction_closing_time': 1765184400.0, 'created_time': 1764792211.597301, 'last_price_update_time': 1764914977.398339}
2025-12-05 06:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3049627') HTTP/1.1" 204 0
2025-12-05 06:09:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0002998686-01989522-002.pdf> (referer: None)
2025-12-05 06:09:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:09:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:09:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:09:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234243fed0>
2025-12-05 06:09:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:09:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:09:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:09:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:09:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:09:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:09:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42e3d5c6-650d-50fc-869c-f49f82247a08/42e3d5c6-650d-50fc-869c-f49f82247a08_expert_report_file_8ff76eb1-175d-48d1-b997-bdd0166bcf9f.pdf HTTP/1.1" 201 0
2025-12-05 06:09:37 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 42e3d5c6-650d-50fc-869c-f49f82247a08
2025-12-05 06:09:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 42e3d5c6-650d-50fc-869c-f49f82247a08, skipping ID generation
2025-12-05 06:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 42e3d5c6-650d-50fc-869c-f49f82247a08
2025-12-05 06:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2998686-9999999-338144855-004.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2998686-9999999-338144855-004.jpg not downloaded yet
2025-12-05 06:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2998686-9999999-338144855-008.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2998686-9999999-338144855-008.jpg not downloaded yet
2025-12-05 06:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2998686-9999999-338144855-001.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2998686-9999999-338144855-001.jpg not downloaded yet
2025-12-05 06:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2998686-9999999-338144855-002.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2998686-9999999-338144855-002.jpg not downloaded yet
2025-12-05 06:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2998686-9999999-338144855-003.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2998686-9999999-338144855-003.jpg not downloaded yet
2025-12-05 06:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2998686-9999999-338144855-005.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2998686-9999999-338144855-005.jpg not downloaded yet
2025-12-05 06:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2998686-9999999-338144855-006.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2998686-9999999-338144855-006.jpg not downloaded yet
2025-12-05 06:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2998686-9999999-338144855-007.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2998686-9999999-338144855-007.jpg not downloaded yet
2025-12-05 06:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2998686-9999999-338144855-009.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2998686-9999999-338144855-009.jpg not downloaded yet
2025-12-05 06:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2998686-9999999-338144855-010.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2998686-9999999-338144855-010.jpg not downloaded yet
2025-12-05 06:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2998686-9999999-338144855-011.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2998686-9999999-338144855-011.jpg not downloaded yet
2025-12-05 06:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2998686-9999999-338144855-012.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2998686-9999999-338144855-012.jpg not downloaded yet
2025-12-05 06:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2998686-4008486-13.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2998686-4008486-13.jpg not downloaded yet
2025-12-05 06:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2998686-4008486-1000.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2998686-4008486-1000.jpg not downloaded yet
2025-12-05 06:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2998686-4008486-1001.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2998686-4008486-1001.jpg not downloaded yet
2025-12-05 06:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2998686-4008486-1002.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2998686-4008486-1002.jpg not downloaded yet
2025-12-05 06:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2998686-4008486-1003.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2998686-4008486-1003.jpg not downloaded yet
2025-12-05 06:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2998686-4008486-1004.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2998686-4008486-1004.jpg not downloaded yet
2025-12-05 06:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2998686-4008486-1005.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2998686-4008486-1005.jpg not downloaded yet
2025-12-05 06:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2998686-4008486-1006.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2998686-4008486-1006.jpg not downloaded yet
2025-12-05 06:09:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=2976938&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232976938&indx=151> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:09:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:09:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 688868aa-228f-5a4c-af61-ab1f8c51287a with identifier: 2976938
2025-12-05 06:09:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 688868aa-228f-5a4c-af61-ab1f8c51287a with scrape type 2
2025-12-05 06:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 688868aa-228f-5a4c-af61-ab1f8c51287a with scrape type 2
2025-12-05 06:09:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 688868aa-228f-5a4c-af61-ab1f8c51287a, identifier: 2976938
2025-12-05 06:09:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 688868aa-228f-5a4c-af61-ab1f8c51287a with identifier: 2976938
2025-12-05 06:09:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 688868aa-228f-5a4c-af61-ab1f8c51287a with identifier: 2976938
2025-12-05 06:09:43 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 164962 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    164962
2025-12-05 06:09:43 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 688868aa-228f-5a4c-af61-ab1f8c51287a spider: manheim.gb
2025-12-05 06:09:43 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 688868aa-228f-5a4c-af61-ab1f8c51287a due to rule: high_mileage_for_country.json, error: 164962 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    164962
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002976938-01947791-001.pdf',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '1.3L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '688868aa-228f-5a4c-af61-ab1f8c51287a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'YF69WDY',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=2976938',
 'listing': 'auction',
 'location': 'Leeds',
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 102503,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-29',
 'seller_name': 'Mobilize Financial Services',
 'title': 'NISSAN QASHQAI 1.3 DiG-T Acenta Premium 5dr',
 'transmission': 'manual',
 'trim': '1.3 DiG-T Acenta Premium 5dr',
 'year': 2019}
2025-12-05 06:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272976938%27 HTTP/1.1" 200 None
2025-12-05 06:09:43 [manheim.gb] INFO: Saving data for 2976938: {'auction_closing_time': 1765184400.0, 'created_time': 1764756190.256305, 'last_price_update_time': 1764914983.606969}
2025-12-05 06:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2976938') HTTP/1.1" 204 0
2025-12-05 06:09:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2998686-4008486-1006.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002998686-01989522-002.pdf)
2025-12-05 06:09:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:09:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:09:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:09:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23426ac590>
2025-12-05 06:09:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:09:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:09:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:09:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:09:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:09:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:09:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42e3d5c6-650d-50fc-869c-f49f82247a08/42e3d5c6-650d-50fc-869c-f49f82247a08_image_19.jpg HTTP/1.1" 201 0
2025-12-05 06:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2998686-4008486-1006.jpg') HTTP/1.1" 204 0
2025-12-05 06:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2998686-4008486-1006.jpg saved to cache
2025-12-05 06:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 42e3d5c6-650d-50fc-869c-f49f82247a08
2025-12-05 06:09:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/ACLASS?id=2968035&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232968035&indx=149> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:09:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2998686-4008486-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002998686-01989522-002.pdf)
2025-12-05 06:09:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:09:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc7ac8f2-5b04-53ad-959e-8f377c9d9114 with identifier: 2968035
2025-12-05 06:09:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc7ac8f2-5b04-53ad-959e-8f377c9d9114 with scrape type 2
2025-12-05 06:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cc7ac8f2-5b04-53ad-959e-8f377c9d9114 with scrape type 2
2025-12-05 06:09:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: cc7ac8f2-5b04-53ad-959e-8f377c9d9114, identifier: 2968035
2025-12-05 06:09:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:09:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:09:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:09:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425a15d0>
2025-12-05 06:09:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:09:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:09:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:09:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:09:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:09:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:09:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42e3d5c6-650d-50fc-869c-f49f82247a08/42e3d5c6-650d-50fc-869c-f49f82247a08_image_18.jpg HTTP/1.1" 201 0
2025-12-05 06:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2998686-4008486-1005.jpg') HTTP/1.1" 204 0
2025-12-05 06:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2998686-4008486-1005.jpg saved to cache
2025-12-05 06:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 42e3d5c6-650d-50fc-869c-f49f82247a08
2025-12-05 06:09:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: cc7ac8f2-5b04-53ad-959e-8f377c9d9114 with identifier: 2968035
2025-12-05 06:09:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: cc7ac8f2-5b04-53ad-959e-8f377c9d9114 with identifier: 2968035
2025-12-05 06:09:44 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: cc7ac8f2-5b04-53ad-959e-8f377c9d9114 with identifier: 2968035 to the API
2025-12-05 06:09:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 06:09:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 06:09:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/ACLASS?id=2968035&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232968035&indx=149>
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002968035-01979078-002.pdf',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '1.5L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'cc7ac8f2-5b04-53ad-959e-8f377c9d9114',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'WD19ZNJ',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/A%20CLASS?id=2968035',
 'listing': 'auction',
 'location': 'Leeds - In Transit',
 'make': 'MERCEDES-BENZ',
 'model': 'A CLASS',
 'odometer': 48068,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-31',
 'seller_name': 'Novuna Vehicle Solutions',
 'title': 'MERCEDES-BENZ A CLASS A180d SE 5dr Auto',
 'transmission': 'automatic',
 'trim': 'A180d SE 5dr Auto',
 'year': 2019}
2025-12-05 06:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272968035%27 HTTP/1.1" 200 None
2025-12-05 06:09:44 [manheim.gb] INFO: Saving data for 2968035: {'auction_closing_time': 1765184400.0, 'created_time': 1764792200.15334, 'last_price_update_time': 1764914984.718275}
2025-12-05 06:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2968035') HTTP/1.1" 204 0
2025-12-05 06:09:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2998686-4008486-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002998686-01989522-002.pdf)
2025-12-05 06:09:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2998686-4008486-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002998686-01989522-002.pdf)
2025-12-05 06:09:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:09:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:09:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:09:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23426e7390>
2025-12-05 06:09:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:09:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:09:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:09:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:09:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42e3d5c6-650d-50fc-869c-f49f82247a08/42e3d5c6-650d-50fc-869c-f49f82247a08_image_16.jpg HTTP/1.1" 201 0
2025-12-05 06:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2998686-4008486-1003.jpg') HTTP/1.1" 204 0
2025-12-05 06:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2998686-4008486-1003.jpg saved to cache
2025-12-05 06:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 42e3d5c6-650d-50fc-869c-f49f82247a08
2025-12-05 06:09:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:09:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:09:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:09:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2343b7ec90>
2025-12-05 06:09:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:09:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:09:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:09:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:09:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42e3d5c6-650d-50fc-869c-f49f82247a08/42e3d5c6-650d-50fc-869c-f49f82247a08_image_17.jpg HTTP/1.1" 201 0
2025-12-05 06:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2998686-4008486-1004.jpg') HTTP/1.1" 204 0
2025-12-05 06:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2998686-4008486-1004.jpg saved to cache
2025-12-05 06:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 42e3d5c6-650d-50fc-869c-f49f82247a08
2025-12-05 06:09:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2998686-4008486-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002998686-01989522-002.pdf)
2025-12-05 06:09:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2998686-4008486-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002998686-01989522-002.pdf)
2025-12-05 06:09:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:09:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:09:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:09:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234238b150>
2025-12-05 06:09:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:09:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:09:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:09:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:09:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42e3d5c6-650d-50fc-869c-f49f82247a08/42e3d5c6-650d-50fc-869c-f49f82247a08_image_15.jpg HTTP/1.1" 201 0
2025-12-05 06:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2998686-4008486-1002.jpg') HTTP/1.1" 204 0
2025-12-05 06:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2998686-4008486-1002.jpg saved to cache
2025-12-05 06:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 42e3d5c6-650d-50fc-869c-f49f82247a08
2025-12-05 06:09:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:09:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:09:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:09:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341eb4f50>
2025-12-05 06:09:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:09:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:09:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:09:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:09:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:09:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:09:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42e3d5c6-650d-50fc-869c-f49f82247a08/42e3d5c6-650d-50fc-869c-f49f82247a08_image_14.jpg HTTP/1.1" 201 0
2025-12-05 06:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2998686-4008486-1001.jpg') HTTP/1.1" 204 0
2025-12-05 06:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2998686-4008486-1001.jpg saved to cache
2025-12-05 06:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 42e3d5c6-650d-50fc-869c-f49f82247a08
2025-12-05 06:09:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2998686-4008486-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002998686-01989522-002.pdf)
2025-12-05 06:09:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2998686-4008486-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002998686-01989522-002.pdf)
2025-12-05 06:09:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:09:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:09:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:09:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23415e8f90>
2025-12-05 06:09:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:09:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:09:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:09:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:09:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:09:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:09:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42e3d5c6-650d-50fc-869c-f49f82247a08/42e3d5c6-650d-50fc-869c-f49f82247a08_image_13.jpg HTTP/1.1" 201 0
2025-12-05 06:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2998686-4008486-1000.jpg') HTTP/1.1" 204 0
2025-12-05 06:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2998686-4008486-1000.jpg saved to cache
2025-12-05 06:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 42e3d5c6-650d-50fc-869c-f49f82247a08
2025-12-05 06:09:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:09:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:09:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:09:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23428b9010>
2025-12-05 06:09:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:09:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:09:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:09:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:09:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:09:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:09:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42e3d5c6-650d-50fc-869c-f49f82247a08/42e3d5c6-650d-50fc-869c-f49f82247a08_image_12.jpg HTTP/1.1" 201 0
2025-12-05 06:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2998686-4008486-13.jpg') HTTP/1.1" 204 0
2025-12-05 06:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2998686-4008486-13.jpg saved to cache
2025-12-05 06:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 42e3d5c6-650d-50fc-869c-f49f82247a08
2025-12-05 06:09:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2998686-9999999-338144855-012.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002998686-01989522-002.pdf)
2025-12-05 06:09:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2998686-9999999-338144855-011.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002998686-01989522-002.pdf)
2025-12-05 06:09:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:09:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:09:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:09:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23423b3910>
2025-12-05 06:09:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:09:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:09:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:09:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:09:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:09:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:09:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42e3d5c6-650d-50fc-869c-f49f82247a08/42e3d5c6-650d-50fc-869c-f49f82247a08_image_11.jpg HTTP/1.1" 201 0
2025-12-05 06:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2998686-9999999-338144855-012.jpg') HTTP/1.1" 204 0
2025-12-05 06:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2998686-9999999-338144855-012.jpg saved to cache
2025-12-05 06:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 42e3d5c6-650d-50fc-869c-f49f82247a08
2025-12-05 06:09:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:09:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:09:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:09:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23428e0690>
2025-12-05 06:09:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:09:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:09:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:09:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:09:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:09:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:09:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42e3d5c6-650d-50fc-869c-f49f82247a08/42e3d5c6-650d-50fc-869c-f49f82247a08_image_10.jpg HTTP/1.1" 201 0
2025-12-05 06:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2998686-9999999-338144855-011.jpg') HTTP/1.1" 204 0
2025-12-05 06:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2998686-9999999-338144855-011.jpg saved to cache
2025-12-05 06:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 42e3d5c6-650d-50fc-869c-f49f82247a08
2025-12-05 06:09:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2998686-9999999-338144855-010.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002998686-01989522-002.pdf)
2025-12-05 06:09:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2998686-9999999-338144855-009.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002998686-01989522-002.pdf)
2025-12-05 06:09:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:09:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:09:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:09:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342890e90>
2025-12-05 06:09:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:09:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:09:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:09:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:09:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:09:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:09:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42e3d5c6-650d-50fc-869c-f49f82247a08/42e3d5c6-650d-50fc-869c-f49f82247a08_image_9.jpg HTTP/1.1" 201 0
2025-12-05 06:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2998686-9999999-338144855-010.jpg') HTTP/1.1" 204 0
2025-12-05 06:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2998686-9999999-338144855-010.jpg saved to cache
2025-12-05 06:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 42e3d5c6-650d-50fc-869c-f49f82247a08
2025-12-05 06:09:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:09:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:09:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:09:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234158d990>
2025-12-05 06:09:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:09:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:09:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:09:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:09:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:09:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:09:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42e3d5c6-650d-50fc-869c-f49f82247a08/42e3d5c6-650d-50fc-869c-f49f82247a08_image_8.jpg HTTP/1.1" 201 0
2025-12-05 06:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2998686-9999999-338144855-009.jpg') HTTP/1.1" 204 0
2025-12-05 06:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2998686-9999999-338144855-009.jpg saved to cache
2025-12-05 06:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 42e3d5c6-650d-50fc-869c-f49f82247a08
2025-12-05 06:09:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2998686-9999999-338144855-006.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002998686-01989522-002.pdf)
2025-12-05 06:09:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2998686-9999999-338144855-007.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002998686-01989522-002.pdf)
2025-12-05 06:09:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:09:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:09:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:09:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23423b27d0>
2025-12-05 06:09:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:09:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:09:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:09:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:09:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:09:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:09:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42e3d5c6-650d-50fc-869c-f49f82247a08/42e3d5c6-650d-50fc-869c-f49f82247a08_image_6.jpg HTTP/1.1" 201 0
2025-12-05 06:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2998686-9999999-338144855-006.jpg') HTTP/1.1" 204 0
2025-12-05 06:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2998686-9999999-338144855-006.jpg saved to cache
2025-12-05 06:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 42e3d5c6-650d-50fc-869c-f49f82247a08
2025-12-05 06:09:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/CCLASS?id=2936605&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232936605&indx=146> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:09:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:09:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:09:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:09:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425f0fd0>
2025-12-05 06:09:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:09:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:09:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:09:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:09:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:09:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:09:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42e3d5c6-650d-50fc-869c-f49f82247a08/42e3d5c6-650d-50fc-869c-f49f82247a08_image_7.jpg HTTP/1.1" 201 0
2025-12-05 06:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2998686-9999999-338144855-007.jpg') HTTP/1.1" 204 0
2025-12-05 06:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2998686-9999999-338144855-007.jpg saved to cache
2025-12-05 06:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 42e3d5c6-650d-50fc-869c-f49f82247a08
2025-12-05 06:09:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:09:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2998686-9999999-338144855-003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002998686-01989522-002.pdf)
2025-12-05 06:09:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2998686-9999999-338144855-005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002998686-01989522-002.pdf)
2025-12-05 06:09:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94a1c9e8-37de-53ad-9759-4ddb2f392c45 with identifier: 2936605
2025-12-05 06:09:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94a1c9e8-37de-53ad-9759-4ddb2f392c45 with scrape type 2
2025-12-05 06:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94a1c9e8-37de-53ad-9759-4ddb2f392c45 with scrape type 2
2025-12-05 06:09:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 94a1c9e8-37de-53ad-9759-4ddb2f392c45, identifier: 2936605
2025-12-05 06:09:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 94a1c9e8-37de-53ad-9759-4ddb2f392c45 with identifier: 2936605
2025-12-05 06:09:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 94a1c9e8-37de-53ad-9759-4ddb2f392c45 with identifier: 2936605
2025-12-05 06:09:49 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 94a1c9e8-37de-53ad-9759-4ddb2f392c45 with identifier: 2936605 to the API
2025-12-05 06:09:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 06:09:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 06:09:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/CCLASS?id=2936605&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232936605&indx=146>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002936605-01991665-003.pdf',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '94a1c9e8-37de-53ad-9759-4ddb2f392c45',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'KY19FCW',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/C%20CLASS?id=2936605',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'MERCEDES-BENZ',
 'model': 'C CLASS',
 'odometer': 71451,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-28',
 'seller_name': 'MotoNovo Finance',
 'title': 'MERCEDES-BENZ C CLASS C220d AMG Line Premium 5dr 9G-Tronic',
 'transmission': 'automatic',
 'trim': 'C220d AMG Line Premium 5dr 9G-Tronic',
 'year': 2019}
2025-12-05 06:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272936605%27 HTTP/1.1" 200 None
2025-12-05 06:09:49 [manheim.gb] INFO: Saving data for 2936605: {'auction_closing_time': 1765270800.0, 'created_time': 1764792247.727114, 'last_price_update_time': 1764914989.70956}
2025-12-05 06:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2936605') HTTP/1.1" 204 0
2025-12-05 06:09:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2998686-9999999-338144855-002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002998686-01989522-002.pdf)
2025-12-05 06:09:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2998686-9999999-338144855-001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002998686-01989522-002.pdf)
2025-12-05 06:09:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:09:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:09:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:09:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342513290>
2025-12-05 06:09:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:09:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:09:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 06:09:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:09:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:09:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:09:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42e3d5c6-650d-50fc-869c-f49f82247a08/42e3d5c6-650d-50fc-869c-f49f82247a08_image_4.jpg HTTP/1.1" 201 0
2025-12-05 06:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2998686-9999999-338144855-003.jpg') HTTP/1.1" 204 0
2025-12-05 06:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2998686-9999999-338144855-003.jpg saved to cache
2025-12-05 06:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 42e3d5c6-650d-50fc-869c-f49f82247a08
2025-12-05 06:09:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:09:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:09:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:09:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234270f750>
2025-12-05 06:09:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:09:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:09:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:09:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:09:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:09:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:09:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42e3d5c6-650d-50fc-869c-f49f82247a08/42e3d5c6-650d-50fc-869c-f49f82247a08_image_5.jpg HTTP/1.1" 201 0
2025-12-05 06:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2998686-9999999-338144855-005.jpg') HTTP/1.1" 204 0
2025-12-05 06:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2998686-9999999-338144855-005.jpg saved to cache
2025-12-05 06:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 42e3d5c6-650d-50fc-869c-f49f82247a08
2025-12-05 06:09:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2998686-9999999-338144855-008.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002998686-01989522-002.pdf)
2025-12-05 06:09:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:09:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:09:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:09:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23426d9a90>
2025-12-05 06:09:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:09:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:09:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:09:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:09:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:09:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:09:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42e3d5c6-650d-50fc-869c-f49f82247a08/42e3d5c6-650d-50fc-869c-f49f82247a08_image_3.jpg HTTP/1.1" 201 0
2025-12-05 06:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2998686-9999999-338144855-002.jpg') HTTP/1.1" 204 0
2025-12-05 06:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2998686-9999999-338144855-002.jpg saved to cache
2025-12-05 06:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 42e3d5c6-650d-50fc-869c-f49f82247a08
2025-12-05 06:09:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:09:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:09:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:09:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425c7fd0>
2025-12-05 06:09:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:09:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:09:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:09:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:09:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:09:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:09:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42e3d5c6-650d-50fc-869c-f49f82247a08/42e3d5c6-650d-50fc-869c-f49f82247a08_image_2.jpg HTTP/1.1" 201 0
2025-12-05 06:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2998686-9999999-338144855-001.jpg') HTTP/1.1" 204 0
2025-12-05 06:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2998686-9999999-338144855-001.jpg saved to cache
2025-12-05 06:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 42e3d5c6-650d-50fc-869c-f49f82247a08
2025-12-05 06:09:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/PEUGEOT/2008?id=2935429&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232935429&indx=145> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:09:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:09:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2998686-9999999-338144855-004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002998686-01989522-002.pdf)
2025-12-05 06:09:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:09:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:09:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:09:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341efd310>
2025-12-05 06:09:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:09:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:09:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 06:09:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:09:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:09:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:09:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42e3d5c6-650d-50fc-869c-f49f82247a08/42e3d5c6-650d-50fc-869c-f49f82247a08_image_1.jpg HTTP/1.1" 201 0
2025-12-05 06:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2998686-9999999-338144855-008.jpg') HTTP/1.1" 204 0
2025-12-05 06:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2998686-9999999-338144855-008.jpg saved to cache
2025-12-05 06:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 42e3d5c6-650d-50fc-869c-f49f82247a08
2025-12-05 06:09:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba33dd89-c9e6-525f-aeb1-ed84e5756ffa with identifier: 2935429
2025-12-05 06:09:51 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item ba33dd89-c9e6-525f-aeb1-ed84e5756ffa
2025-12-05 06:09:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:09:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:09:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:09:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23423b0f10>
2025-12-05 06:09:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:09:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:09:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:09:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:09:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:09:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:09:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42e3d5c6-650d-50fc-869c-f49f82247a08/42e3d5c6-650d-50fc-869c-f49f82247a08_image_0.jpg HTTP/1.1" 201 0
2025-12-05 06:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2998686-9999999-338144855-004.jpg') HTTP/1.1" 204 0
2025-12-05 06:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2998686-9999999-338144855-004.jpg saved to cache
2025-12-05 06:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 42e3d5c6-650d-50fc-869c-f49f82247a08
2025-12-05 06:09:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 42e3d5c6-650d-50fc-869c-f49f82247a08, skipping ID generation
2025-12-05 06:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 42e3d5c6-650d-50fc-869c-f49f82247a08 from tracking dictionaries
2025-12-05 06:09:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 42e3d5c6-650d-50fc-869c-f49f82247a08 sending to next pipeline
2025-12-05 06:09:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 42e3d5c6-650d-50fc-869c-f49f82247a08, identifier: 2998686
2025-12-05 06:09:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 42e3d5c6-650d-50fc-869c-f49f82247a08 with identifier: 2998686
2025-12-05 06:09:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 42e3d5c6-650d-50fc-869c-f49f82247a08 with identifier: 2998686
2025-12-05 06:09:51 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 42e3d5c6-650d-50fc-869c-f49f82247a08 with identifier: 2998686 to the API
2025-12-05 06:09:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 06:09:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 06:09:52 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/2998686-9999999-338144855-004.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 161,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42e3d5c6-650d-50fc-869c-f49f82247a08/42e3d5c6-650d-50fc-869c-f49f82247a08_expert_report_file_8ff76eb1-175d-48d1-b997-bdd0166bcf9f.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002998686-01989522-002.pdf',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '42e3d5c6-650d-50fc-869c-f49f82247a08',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'YW19RVL',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/HYUNDAI/TUCSON?id=2998686',
 'listing': 'auction',
 'location': 'Washington',
 'make': 'HYUNDAI',
 'model': 'TUCSON',
 'odometer': 35339,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 25,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42e3d5c6-650d-50fc-869c-f49f82247a08/42e3d5c6-650d-50fc-869c-f49f82247a08_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 237359,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2998686-9999999-338144855-004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42e3d5c6-650d-50fc-869c-f49f82247a08/42e3d5c6-650d-50fc-869c-f49f82247a08_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 228703,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2998686-9999999-338144855-008.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42e3d5c6-650d-50fc-869c-f49f82247a08/42e3d5c6-650d-50fc-869c-f49f82247a08_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 195764,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2998686-9999999-338144855-001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42e3d5c6-650d-50fc-869c-f49f82247a08/42e3d5c6-650d-50fc-869c-f49f82247a08_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 256417,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2998686-9999999-338144855-002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42e3d5c6-650d-50fc-869c-f49f82247a08/42e3d5c6-650d-50fc-869c-f49f82247a08_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 244830,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2998686-9999999-338144855-003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42e3d5c6-650d-50fc-869c-f49f82247a08/42e3d5c6-650d-50fc-869c-f49f82247a08_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 266512,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2998686-9999999-338144855-005.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42e3d5c6-650d-50fc-869c-f49f82247a08/42e3d5c6-650d-50fc-869c-f49f82247a08_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 212736,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2998686-9999999-338144855-006.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42e3d5c6-650d-50fc-869c-f49f82247a08/42e3d5c6-650d-50fc-869c-f49f82247a08_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 267816,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2998686-9999999-338144855-007.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42e3d5c6-650d-50fc-869c-f49f82247a08/42e3d5c6-650d-50fc-869c-f49f82247a08_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 251299,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2998686-9999999-338144855-009.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42e3d5c6-650d-50fc-869c-f49f82247a08/42e3d5c6-650d-50fc-869c-f49f82247a08_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 192619,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2998686-9999999-338144855-010.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42e3d5c6-650d-50fc-869c-f49f82247a08/42e3d5c6-650d-50fc-869c-f49f82247a08_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 232852,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2998686-9999999-338144855-011.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42e3d5c6-650d-50fc-869c-f49f82247a08/42e3d5c6-650d-50fc-869c-f49f82247a08_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 221454,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2998686-9999999-338144855-012.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42e3d5c6-650d-50fc-869c-f49f82247a08/42e3d5c6-650d-50fc-869c-f49f82247a08_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 361468,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2998686-4008486-13.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42e3d5c6-650d-50fc-869c-f49f82247a08/42e3d5c6-650d-50fc-869c-f49f82247a08_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 308658,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2998686-4008486-1000.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42e3d5c6-650d-50fc-869c-f49f82247a08/42e3d5c6-650d-50fc-869c-f49f82247a08_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 402433,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2998686-4008486-1001.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42e3d5c6-650d-50fc-869c-f49f82247a08/42e3d5c6-650d-50fc-869c-f49f82247a08_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 265795,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2998686-4008486-1002.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42e3d5c6-650d-50fc-869c-f49f82247a08/42e3d5c6-650d-50fc-869c-f49f82247a08_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 193815,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2998686-4008486-1003.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42e3d5c6-650d-50fc-869c-f49f82247a08/42e3d5c6-650d-50fc-869c-f49f82247a08_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 254156,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2998686-4008486-1004.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42e3d5c6-650d-50fc-869c-f49f82247a08/42e3d5c6-650d-50fc-869c-f49f82247a08_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 170073,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2998686-4008486-1005.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42e3d5c6-650d-50fc-869c-f49f82247a08/42e3d5c6-650d-50fc-869c-f49f82247a08_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 203969,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2998686-4008486-1006.jpg',
             'Width': 1500}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-15',
 'seller_name': 'Parks Motor Group',
 'title': 'HYUNDAI TUCSON 1.6 GDi SE Nav 5dr 2WD',
 'transmission': 'manual',
 'trim': '1.6 GDi SE Nav 5dr 2WD',
 'year': 2019}
2025-12-05 06:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272998686%27 HTTP/1.1" 200 None
2025-12-05 06:09:52 [manheim.gb] INFO: Saving data for 2998686: {'created_time': 1764914992.167535, 'last_price_update_time': 1764914992.167548, 'auction_closing_time': 1765184400.0}
2025-12-05 06:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2998686') HTTP/1.1" 204 0
2025-12-05 06:09:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0002935429-01983568-005.pdf> (referer: None)
2025-12-05 06:09:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VAUXHALL/CORSA?id=2907623&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232907623&indx=142> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:09:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:09:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:09:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:09:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:09:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2343c03f10>
2025-12-05 06:09:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:09:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:09:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:09:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:09:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:09:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:09:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba33dd89-c9e6-525f-aeb1-ed84e5756ffa/ba33dd89-c9e6-525f-aeb1-ed84e5756ffa_expert_report_file_5176aebb-86ab-4bfb-9da7-6ee75b7c55b2.pdf HTTP/1.1" 201 0
2025-12-05 06:09:52 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item ba33dd89-c9e6-525f-aeb1-ed84e5756ffa
2025-12-05 06:09:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ba33dd89-c9e6-525f-aeb1-ed84e5756ffa, skipping ID generation
2025-12-05 06:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item ba33dd89-c9e6-525f-aeb1-ed84e5756ffa
2025-12-05 06:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F73874675-699e-4d9f-9851-ac1ace36abca_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/73874675-699e-4d9f-9851-ac1ace36abca_ext_7.jpg already downloaded
2025-12-05 06:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F73874675-699e-4d9f-9851-ac1ace36abca_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/73874675-699e-4d9f-9851-ac1ace36abca_ext_7.jpg already downloaded
2025-12-05 06:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F73874675-699e-4d9f-9851-ac1ace36abca_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/73874675-699e-4d9f-9851-ac1ace36abca_ext_6.jpg already downloaded
2025-12-05 06:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F73874675-699e-4d9f-9851-ac1ace36abca_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/73874675-699e-4d9f-9851-ac1ace36abca_ext_1.jpg already downloaded
2025-12-05 06:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F73874675-699e-4d9f-9851-ac1ace36abca_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/73874675-699e-4d9f-9851-ac1ace36abca_5.jpg already downloaded
2025-12-05 06:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F73874675-699e-4d9f-9851-ac1ace36abca_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/73874675-699e-4d9f-9851-ac1ace36abca_4.jpg already downloaded
2025-12-05 06:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F73874675-699e-4d9f-9851-ac1ace36abca_11.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/73874675-699e-4d9f-9851-ac1ace36abca_11.jpg already downloaded
2025-12-05 06:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F73874675-699e-4d9f-9851-ac1ace36abca_10.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/73874675-699e-4d9f-9851-ac1ace36abca_10.jpg already downloaded
2025-12-05 06:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F73874675-699e-4d9f-9851-ac1ace36abca_9.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/73874675-699e-4d9f-9851-ac1ace36abca_9.jpg already downloaded
2025-12-05 06:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F73874675-699e-4d9f-9851-ac1ace36abca_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/73874675-699e-4d9f-9851-ac1ace36abca_ext_2.jpg already downloaded
2025-12-05 06:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F73874675-699e-4d9f-9851-ac1ace36abca_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/73874675-699e-4d9f-9851-ac1ace36abca_ext_5.jpg already downloaded
2025-12-05 06:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F73874675-699e-4d9f-9851-ac1ace36abca_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/73874675-699e-4d9f-9851-ac1ace36abca_ext_3.jpg already downloaded
2025-12-05 06:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F73874675-699e-4d9f-9851-ac1ace36abca_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/73874675-699e-4d9f-9851-ac1ace36abca_ext_4.jpg already downloaded
2025-12-05 06:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2935429-3997093-13.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2935429-3997093-13.jpg already downloaded
2025-12-05 06:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2935429-3997093-1000.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2935429-3997093-1000.jpg already downloaded
2025-12-05 06:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2935429-3997093-1001.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2935429-3997093-1001.jpg already downloaded
2025-12-05 06:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2935429-3997093-1002.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2935429-3997093-1002.jpg already downloaded
2025-12-05 06:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2935429-3997093-1003.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2935429-3997093-1003.jpg already downloaded
2025-12-05 06:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2935429-3997093-1004.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2935429-3997093-1004.jpg already downloaded
2025-12-05 06:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2935429-3997093-1005.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2935429-3997093-1005.jpg already downloaded
2025-12-05 06:09:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: ba33dd89-c9e6-525f-aeb1-ed84e5756ffa, identifier: 2935429
2025-12-05 06:09:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: ba33dd89-c9e6-525f-aeb1-ed84e5756ffa with identifier: 2935429
2025-12-05 06:09:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: ba33dd89-c9e6-525f-aeb1-ed84e5756ffa with identifier: 2935429
2025-12-05 06:09:53 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: ba33dd89-c9e6-525f-aeb1-ed84e5756ffa with identifier: 2935429 to the API
2025-12-05 06:09:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 06:09:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 06:09:53 [scrapy.core.scraper] DEBUG: Scraped from <200 http://ecr.manheim.co.uk/pdf/MOL-0002935429-01983568-005.pdf>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba33dd89-c9e6-525f-aeb1-ed84e5756ffa/ba33dd89-c9e6-525f-aeb1-ed84e5756ffa_expert_report_file_5176aebb-86ab-4bfb-9da7-6ee75b7c55b2.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002935429-01983568-005.pdf',
 'color': 'Grey',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'ba33dd89-c9e6-525f-aeb1-ed84e5756ffa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'KN21LJK',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/PEUGEOT/2008?id=2935429',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 48990,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 21,
 'photo_urls': ['http://images.manheim.co.uk/images/units/zoom/73874675-699e-4d9f-9851-ac1ace36abca_ext_7.jpg',
                'http://images.manheim.co.uk/images/units/zoom/73874675-699e-4d9f-9851-ac1ace36abca_ext_7.jpg',
                'http://images.manheim.co.uk/images/units/zoom/73874675-699e-4d9f-9851-ac1ace36abca_ext_6.jpg',
                'http://images.manheim.co.uk/images/units/zoom/73874675-699e-4d9f-9851-ac1ace36abca_ext_1.jpg',
                'http://images.manheim.co.uk/images/units/zoom/73874675-699e-4d9f-9851-ac1ace36abca_5.jpg',
                'http://images.manheim.co.uk/images/units/zoom/73874675-699e-4d9f-9851-ac1ace36abca_4.jpg',
                'http://images.manheim.co.uk/images/units/zoom/73874675-699e-4d9f-9851-ac1ace36abca_11.jpg',
                'http://images.manheim.co.uk/images/units/zoom/73874675-699e-4d9f-9851-ac1ace36abca_10.jpg',
                'http://images.manheim.co.uk/images/units/zoom/73874675-699e-4d9f-9851-ac1ace36abca_9.jpg',
                'http://images.manheim.co.uk/images/units/zoom/73874675-699e-4d9f-9851-ac1ace36abca_ext_2.jpg',
                'http://images.manheim.co.uk/images/units/zoom/73874675-699e-4d9f-9851-ac1ace36abca_ext_5.jpg',
                'http://images.manheim.co.uk/images/units/zoom/73874675-699e-4d9f-9851-ac1ace36abca_ext_3.jpg',
                'http://images.manheim.co.uk/images/units/zoom/73874675-699e-4d9f-9851-ac1ace36abca_ext_4.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-2935429-3997093-13.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-2935429-3997093-1000.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-2935429-3997093-1001.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-2935429-3997093-1002.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-2935429-3997093-1003.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-2935429-3997093-1004.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-2935429-3997093-1005.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba33dd89-c9e6-525f-aeb1-ed84e5756ffa/ba33dd89-c9e6-525f-aeb1-ed84e5756ffa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 175012,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/73874675-699e-4d9f-9851-ac1ace36abca_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba33dd89-c9e6-525f-aeb1-ed84e5756ffa/ba33dd89-c9e6-525f-aeb1-ed84e5756ffa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 175012,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/73874675-699e-4d9f-9851-ac1ace36abca_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba33dd89-c9e6-525f-aeb1-ed84e5756ffa/ba33dd89-c9e6-525f-aeb1-ed84e5756ffa_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 258185,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/73874675-699e-4d9f-9851-ac1ace36abca_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba33dd89-c9e6-525f-aeb1-ed84e5756ffa/ba33dd89-c9e6-525f-aeb1-ed84e5756ffa_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114217,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/73874675-699e-4d9f-9851-ac1ace36abca_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba33dd89-c9e6-525f-aeb1-ed84e5756ffa/ba33dd89-c9e6-525f-aeb1-ed84e5756ffa_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 169401,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/73874675-699e-4d9f-9851-ac1ace36abca_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba33dd89-c9e6-525f-aeb1-ed84e5756ffa/ba33dd89-c9e6-525f-aeb1-ed84e5756ffa_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 166407,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/73874675-699e-4d9f-9851-ac1ace36abca_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba33dd89-c9e6-525f-aeb1-ed84e5756ffa/ba33dd89-c9e6-525f-aeb1-ed84e5756ffa_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 162994,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/73874675-699e-4d9f-9851-ac1ace36abca_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba33dd89-c9e6-525f-aeb1-ed84e5756ffa/ba33dd89-c9e6-525f-aeb1-ed84e5756ffa_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 152806,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/73874675-699e-4d9f-9851-ac1ace36abca_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba33dd89-c9e6-525f-aeb1-ed84e5756ffa/ba33dd89-c9e6-525f-aeb1-ed84e5756ffa_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 162982,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/73874675-699e-4d9f-9851-ac1ace36abca_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba33dd89-c9e6-525f-aeb1-ed84e5756ffa/ba33dd89-c9e6-525f-aeb1-ed84e5756ffa_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 289861,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/73874675-699e-4d9f-9851-ac1ace36abca_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba33dd89-c9e6-525f-aeb1-ed84e5756ffa/ba33dd89-c9e6-525f-aeb1-ed84e5756ffa_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 209632,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/73874675-699e-4d9f-9851-ac1ace36abca_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba33dd89-c9e6-525f-aeb1-ed84e5756ffa/ba33dd89-c9e6-525f-aeb1-ed84e5756ffa_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 238984,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/73874675-699e-4d9f-9851-ac1ace36abca_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba33dd89-c9e6-525f-aeb1-ed84e5756ffa/ba33dd89-c9e6-525f-aeb1-ed84e5756ffa_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 253014,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/73874675-699e-4d9f-9851-ac1ace36abca_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba33dd89-c9e6-525f-aeb1-ed84e5756ffa/ba33dd89-c9e6-525f-aeb1-ed84e5756ffa_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 306944,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2935429-3997093-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba33dd89-c9e6-525f-aeb1-ed84e5756ffa/ba33dd89-c9e6-525f-aeb1-ed84e5756ffa_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 518548,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2935429-3997093-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba33dd89-c9e6-525f-aeb1-ed84e5756ffa/ba33dd89-c9e6-525f-aeb1-ed84e5756ffa_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 174358,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2935429-3997093-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba33dd89-c9e6-525f-aeb1-ed84e5756ffa/ba33dd89-c9e6-525f-aeb1-ed84e5756ffa_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 377521,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2935429-3997093-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba33dd89-c9e6-525f-aeb1-ed84e5756ffa/ba33dd89-c9e6-525f-aeb1-ed84e5756ffa_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 279488,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2935429-3997093-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba33dd89-c9e6-525f-aeb1-ed84e5756ffa/ba33dd89-c9e6-525f-aeb1-ed84e5756ffa_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 235675,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2935429-3997093-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba33dd89-c9e6-525f-aeb1-ed84e5756ffa/ba33dd89-c9e6-525f-aeb1-ed84e5756ffa_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 219080,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2935429-3997093-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-06',
 'seller_name': 'Big Motoring World Ltd',
 'title': 'PEUGEOT 2008 1.2 PureTech Allure Premium 5dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech Allure Premium 5dr',
 'year': 2021}
2025-12-05 06:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272935429%27 HTTP/1.1" 200 None
2025-12-05 06:09:53 [manheim.gb] INFO: Saving data for 2935429: {'created_time': 1764914993.679319, 'last_price_update_time': 1764914993.679332, 'auction_closing_time': 1765270800.0}
2025-12-05 06:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2935429') HTTP/1.1" 204 0
2025-12-05 06:09:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9dca29d0-3245-5508-8d9b-cc23150f7e96 with identifier: 2907623
2025-12-05 06:09:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9dca29d0-3245-5508-8d9b-cc23150f7e96 with scrape type 2
2025-12-05 06:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9dca29d0-3245-5508-8d9b-cc23150f7e96 with scrape type 2
2025-12-05 06:09:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 9dca29d0-3245-5508-8d9b-cc23150f7e96, identifier: 2907623
2025-12-05 06:09:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 9dca29d0-3245-5508-8d9b-cc23150f7e96 with identifier: 2907623
2025-12-05 06:09:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 9dca29d0-3245-5508-8d9b-cc23150f7e96 with identifier: 2907623
2025-12-05 06:09:53 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': 'vauxhall motors limited', 'price_includes_vat': False, 'title': 'vauxhall corsa 100kw se nav 50kwh 5dr auto [7.4kwch]', 'price': 0, 'currency': 'gbp', 'make': 'vauxhall', 'model': 'corsa', 'transmission': 'automatic', 'engine': '0.0l', 'fuel_type': 'electric', 'odometer': 52487, 'odometer_reading_unit': 'mi', 'registration_date': '2021-03-29', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/vauxhall/corsa?id=2907623', 'location': 'colchester', 'origin_country_code': 'gb', 'trim': '100kw se nav 50kwh 5dr auto [7.4kwch]', 'license_plate': 'st21llj', 'year': 2021, 'listing': 'auction', 'c_o_2_emission_value': 0, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002907623-01978228-006.pdf', 'expiration_date': '2025-12-09t09:00:00z', 'is_vat_deductible': True, 'is_vat_included': False, 'id': '9dca29d0-3245-5508-8d9b-cc23150f7e96', 'current_year_diff': 4, 'age_in_months': 56, 'make_model': 'vauxhall corsa', 'sanitized_make': 'vauxhall', 'odometer_in_km': 84469} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 56,
     'auction_title': '',
     'c_o_2_emission_value': 0,
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002907623-01978228-006.pdf',
     'color': 'red',
     'currency': 'gbp',
     'current_year_diff': 4,
     'engine': '0.0l',
     'expiration_date': '2025-12-09t09:00:00z',
     'fuel_type': 'electric',
     'id': '9dca29d0-3245-5508-8d9b-cc23150f7e96',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'st21llj',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/vauxhall/corsa?id=2907623',
     'listing': 'auction',
     'location': 'colchester',
     'make': 'vauxhall',
     'make_model': 'vauxhall corsa',
     'model': 'corsa',
     'odometer': 52487,
     'odometer_in_km': 84469,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-03-29',
     'sanitized_make': 'vauxhall',
     'seller_name': 'vauxhall motors limited',
     'title': 'vauxhall corsa 100kw se nav 50kwh 5dr auto [7.4kwch]',
     'transmission': 'automatic',
     'trim': '100kw se nav 50kwh 5dr auto [7.4kwch]',
     'year': 2021}
2025-12-05 06:09:53 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 9dca29d0-3245-5508-8d9b-cc23150f7e96 spider: manheim.gb
2025-12-05 06:09:54 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 9dca29d0-3245-5508-8d9b-cc23150f7e96 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': 'vauxhall motors limited', 'price_includes_vat': False, 'title': 'vauxhall corsa 100kw se nav 50kwh 5dr auto [7.4kwch]', 'price': 0, 'currency': 'gbp', 'make': 'vauxhall', 'model': 'corsa', 'transmission': 'automatic', 'engine': '0.0l', 'fuel_type': 'electric', 'odometer': 52487, 'odometer_reading_unit': 'mi', 'registration_date': '2021-03-29', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/vauxhall/corsa?id=2907623', 'location': 'colchester', 'origin_country_code': 'gb', 'trim': '100kw se nav 50kwh 5dr auto [7.4kwch]', 'license_plate': 'st21llj', 'year': 2021, 'listing': 'auction', 'c_o_2_emission_value': 0, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002907623-01978228-006.pdf', 'expiration_date': '2025-12-09t09:00:00z', 'is_vat_deductible': True, 'is_vat_included': False, 'id': '9dca29d0-3245-5508-8d9b-cc23150f7e96', 'current_year_diff': 4, 'age_in_months': 56, 'make_model': 'vauxhall corsa', 'sanitized_make': 'vauxhall', 'odometer_in_km': 84469} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 56,
     'auction_title': '',
     'c_o_2_emission_value': 0,
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002907623-01978228-006.pdf',
     'color': 'red',
     'currency': 'gbp',
     'current_year_diff': 4,
     'engine': '0.0l',
     'expiration_date': '2025-12-09t09:00:00z',
     'fuel_type': 'electric',
     'id': '9dca29d0-3245-5508-8d9b-cc23150f7e96',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'st21llj',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/vauxhall/corsa?id=2907623',
     'listing': 'auction',
     'location': 'colchester',
     'make': 'vauxhall',
     'make_model': 'vauxhall corsa',
     'model': 'corsa',
     'odometer': 52487,
     'odometer_in_km': 84469,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-03-29',
     'sanitized_make': 'vauxhall',
     'seller_name': 'vauxhall motors limited',
     'title': 'vauxhall corsa 100kw se nav 50kwh 5dr auto [7.4kwch]',
     'transmission': 'automatic',
     'trim': '100kw se nav 50kwh 5dr auto [7.4kwch]',
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002907623-01978228-006.pdf',
 'color': 'RED',
 'currency': 'GBP',
 'engine': '0.0L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Electric',
 'id': '9dca29d0-3245-5508-8d9b-cc23150f7e96',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'ST21LLJ',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VAUXHALL/CORSA?id=2907623',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'VAUXHALL',
 'model': 'CORSA',
 'odometer': 52487,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-29',
 'seller_name': 'Vauxhall Motors Limited',
 'title': 'VAUXHALL CORSA 100kW SE Nav 50kWh 5dr Auto [7.4kWCh]',
 'transmission': 'automatic',
 'trim': '100kW SE Nav 50kWh 5dr Auto [7.4kWCh]',
 'year': 2021}
2025-12-05 06:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272907623%27 HTTP/1.1" 200 None
2025-12-05 06:09:54 [manheim.gb] INFO: Saving data for 2907623: {'auction_closing_time': 1765270800.0, 'created_time': 1764792249.873898, 'last_price_update_time': 1764914994.104699}
2025-12-05 06:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2907623') HTTP/1.1" 204 0
2025-12-05 06:09:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VAUXHALL/INSIGNIA?id=2886723&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232886723&indx=138> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:09:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:09:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61a606f9-1971-5d93-844d-3da9884cd0b3 with identifier: 2886723
2025-12-05 06:09:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61a606f9-1971-5d93-844d-3da9884cd0b3 with scrape type 2
2025-12-05 06:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61a606f9-1971-5d93-844d-3da9884cd0b3 with scrape type 2
2025-12-05 06:09:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 61a606f9-1971-5d93-844d-3da9884cd0b3, identifier: 2886723
2025-12-05 06:09:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 61a606f9-1971-5d93-844d-3da9884cd0b3 with identifier: 2886723
2025-12-05 06:09:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 61a606f9-1971-5d93-844d-3da9884cd0b3 with identifier: 2886723
2025-12-05 06:09:59 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 61a606f9-1971-5d93-844d-3da9884cd0b3 with identifier: 2886723 to the API
2025-12-05 06:09:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 06:09:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 06:09:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/VAUXHALL/INSIGNIA?id=2886723&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232886723&indx=138>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002886723-01960163-006.pdf',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '61a606f9-1971-5d93-844d-3da9884cd0b3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'DS68XWO',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VAUXHALL/INSIGNIA?id=2886723',
 'listing': 'auction',
 'location': 'Northampton',
 'make': 'VAUXHALL',
 'model': 'INSIGNIA',
 'odometer': 61747,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-30',
 'seller_name': 'GP Car Sales 2',
 'title': 'VAUXHALL INSIGNIA 1.6 Turbo D ecoTec Elite Nav 5dr',
 'transmission': 'manual',
 'trim': '1.6 Turbo D ecoTec Elite Nav 5dr',
 'year': 2018}
2025-12-05 06:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272886723%27 HTTP/1.1" 200 None
2025-12-05 06:09:59 [manheim.gb] INFO: Saving data for 2886723: {'auction_closing_time': 1765270800.0, 'created_time': 1764583540.40781, 'last_price_update_time': 1764914999.851899}
2025-12-05 06:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2886723') HTTP/1.1" 204 0
2025-12-05 06:10:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VAUXHALL/GRANDLANDX?id=2765368&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232765368&indx=131> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:10:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:10:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a806b5e1-4b88-5545-a155-c757f7f736b3 with identifier: 2765368
2025-12-05 06:10:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a806b5e1-4b88-5545-a155-c757f7f736b3 with scrape type 2
2025-12-05 06:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a806b5e1-4b88-5545-a155-c757f7f736b3 with scrape type 2
2025-12-05 06:10:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: a806b5e1-4b88-5545-a155-c757f7f736b3, identifier: 2765368
2025-12-05 06:10:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: a806b5e1-4b88-5545-a155-c757f7f736b3 with identifier: 2765368
2025-12-05 06:10:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: a806b5e1-4b88-5545-a155-c757f7f736b3 with identifier: 2765368
2025-12-05 06:10:04 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: a806b5e1-4b88-5545-a155-c757f7f736b3 with identifier: 2765368 to the API
2025-12-05 06:10:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 06:10:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 06:10:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/VAUXHALL/GRANDLANDX?id=2765368&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232765368&indx=131>
{'auction_title': '',
 'c_o_2_emission_value': 34,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002765368-01979328-006.pdf',
 'color': 'RED',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Petrol PHEV',
 'id': 'a806b5e1-4b88-5545-a155-c757f7f736b3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'OE69WZH',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VAUXHALL/GRANDLAND%20X?id=2765368',
 'listing': 'auction',
 'location': 'Bristol',
 'make': 'VAUXHALL',
 'model': 'GRANDLAND X',
 'odometer': 70669,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-24',
 'seller_name': 'Vauxhall Motors Limited',
 'title': 'VAUXHALL GRANDLAND X 1.6 Hybrid4 300 Ultimate Nav 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.6 Hybrid4 300 Ultimate Nav 5dr Auto',
 'year': 2020}
2025-12-05 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272765368%27 HTTP/1.1" 200 None
2025-12-05 06:10:04 [manheim.gb] INFO: Saving data for 2765368: {'auction_closing_time': 1765270800.0, 'created_time': 1764583633.905488, 'last_price_update_time': 1764915004.47456}
2025-12-05 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2765368') HTTP/1.1" 204 0
2025-12-05 06:10:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VAUXHALL/CORSA?id=2746923&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232746923&indx=130> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:10:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:10:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d74ee97d-07ec-5b7b-882f-670db99a61d8 with identifier: 2746923
2025-12-05 06:10:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d74ee97d-07ec-5b7b-882f-670db99a61d8 with scrape type 2
2025-12-05 06:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d74ee97d-07ec-5b7b-882f-670db99a61d8 with scrape type 2
2025-12-05 06:10:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: d74ee97d-07ec-5b7b-882f-670db99a61d8, identifier: 2746923
2025-12-05 06:10:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: d74ee97d-07ec-5b7b-882f-670db99a61d8 with identifier: 2746923
2025-12-05 06:10:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: d74ee97d-07ec-5b7b-882f-670db99a61d8 with identifier: 2746923
2025-12-05 06:10:10 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 0, 'seller_name': 'vauxhall motors limited', 'price_includes_vat': False, 'title': 'vauxhall corsa 100kw elite nav 50kwh 5dr auto [7.4kwch]', 'price': 0, 'currency': 'gbp', 'make': 'vauxhall', 'model': 'corsa', 'transmission': 'automatic', 'engine': '0.0l', 'fuel_type': 'electric', 'odometer': 70673, 'odometer_reading_unit': 'mi', 'registration_date': '2020-07-31', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/vauxhall/corsa?id=2746923', 'location': 'colchester', 'origin_country_code': 'gb', 'trim': '100kw elite nav 50kwh 5dr auto [7.4kwch]', 'license_plate': 'bn20yae', 'year': 2020, 'listing': 'auction', 'c_o_2_emission_value': 0, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002746923-01978225-008.pdf', 'expiration_date': '2025-12-09t09:00:00z', 'is_vat_deductible': True, 'is_vat_included': False, 'id': 'd74ee97d-07ec-5b7b-882f-670db99a61d8', 'current_year_diff': 5, 'age_in_months': 64, 'make_model': 'vauxhall corsa', 'sanitized_make': 'vauxhall', 'odometer_in_km': 113736} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 64,
     'auction_title': '',
     'c_o_2_emission_value': 0,
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002746923-01978225-008.pdf',
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 5,
     'engine': '0.0l',
     'expiration_date': '2025-12-09t09:00:00z',
     'fuel_type': 'electric',
     'id': 'd74ee97d-07ec-5b7b-882f-670db99a61d8',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'bn20yae',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/vauxhall/corsa?id=2746923',
     'listing': 'auction',
     'location': 'colchester',
     'make': 'vauxhall',
     'make_model': 'vauxhall corsa',
     'model': 'corsa',
     'odometer': 70673,
     'odometer_in_km': 113736,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2020-07-31',
     'sanitized_make': 'vauxhall',
     'seller_name': 'vauxhall motors limited',
     'title': 'vauxhall corsa 100kw elite nav 50kwh 5dr auto [7.4kwch]',
     'transmission': 'automatic',
     'trim': '100kw elite nav 50kwh 5dr auto [7.4kwch]',
     'year': 2020}
2025-12-05 06:10:10 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: d74ee97d-07ec-5b7b-882f-670db99a61d8 spider: manheim.gb
2025-12-05 06:10:10 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: d74ee97d-07ec-5b7b-882f-670db99a61d8 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 0, 'seller_name': 'vauxhall motors limited', 'price_includes_vat': False, 'title': 'vauxhall corsa 100kw elite nav 50kwh 5dr auto [7.4kwch]', 'price': 0, 'currency': 'gbp', 'make': 'vauxhall', 'model': 'corsa', 'transmission': 'automatic', 'engine': '0.0l', 'fuel_type': 'electric', 'odometer': 70673, 'odometer_reading_unit': 'mi', 'registration_date': '2020-07-31', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/vauxhall/corsa?id=2746923', 'location': 'colchester', 'origin_country_code': 'gb', 'trim': '100kw elite nav 50kwh 5dr auto [7.4kwch]', 'license_plate': 'bn20yae', 'year': 2020, 'listing': 'auction', 'c_o_2_emission_value': 0, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002746923-01978225-008.pdf', 'expiration_date': '2025-12-09t09:00:00z', 'is_vat_deductible': True, 'is_vat_included': False, 'id': 'd74ee97d-07ec-5b7b-882f-670db99a61d8', 'current_year_diff': 5, 'age_in_months': 64, 'make_model': 'vauxhall corsa', 'sanitized_make': 'vauxhall', 'odometer_in_km': 113736} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 64,
     'auction_title': '',
     'c_o_2_emission_value': 0,
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002746923-01978225-008.pdf',
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 5,
     'engine': '0.0l',
     'expiration_date': '2025-12-09t09:00:00z',
     'fuel_type': 'electric',
     'id': 'd74ee97d-07ec-5b7b-882f-670db99a61d8',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'bn20yae',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/vauxhall/corsa?id=2746923',
     'listing': 'auction',
     'location': 'colchester',
     'make': 'vauxhall',
     'make_model': 'vauxhall corsa',
     'model': 'corsa',
     'odometer': 70673,
     'odometer_in_km': 113736,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2020-07-31',
     'sanitized_make': 'vauxhall',
     'seller_name': 'vauxhall motors limited',
     'title': 'vauxhall corsa 100kw elite nav 50kwh 5dr auto [7.4kwch]',
     'transmission': 'automatic',
     'trim': '100kw elite nav 50kwh 5dr auto [7.4kwch]',
     'year': 2020}
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002746923-01978225-008.pdf',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '0.0L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Electric',
 'id': 'd74ee97d-07ec-5b7b-882f-670db99a61d8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'BN20YAE',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VAUXHALL/CORSA?id=2746923',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'VAUXHALL',
 'model': 'CORSA',
 'odometer': 70673,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-31',
 'seller_name': 'Vauxhall Motors Limited',
 'title': 'VAUXHALL CORSA 100kW Elite Nav 50kWh 5dr Auto [7.4kWCh]',
 'transmission': 'automatic',
 'trim': '100kW Elite Nav 50kWh 5dr Auto [7.4kWCh]',
 'year': 2020}
2025-12-05 06:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272746923%27 HTTP/1.1" 200 None
2025-12-05 06:10:10 [manheim.gb] INFO: Saving data for 2746923: {'auction_closing_time': 1765270800.0, 'created_time': 1764792532.350718, 'last_price_update_time': 1764915010.136031}
2025-12-05 06:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2746923') HTTP/1.1" 204 0
2025-12-05 06:10:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/PEUGEOT/208?id=2744515&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232744515&indx=129> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:10:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:10:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f34256c-0283-53a1-8b9e-4dd8212837f4 with identifier: 2744515
2025-12-05 06:10:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f34256c-0283-53a1-8b9e-4dd8212837f4 with scrape type 2
2025-12-05 06:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f34256c-0283-53a1-8b9e-4dd8212837f4 with scrape type 2
2025-12-05 06:10:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 1f34256c-0283-53a1-8b9e-4dd8212837f4, identifier: 2744515
2025-12-05 06:10:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 1f34256c-0283-53a1-8b9e-4dd8212837f4 with identifier: 2744515
2025-12-05 06:10:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 1f34256c-0283-53a1-8b9e-4dd8212837f4 with identifier: 2744515
2025-12-05 06:10:10 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': 'mobilize financial services', 'price_includes_vat': False, 'title': 'peugeot 208 100kw allure 50kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'peugeot', 'model': '208', 'transmission': 'automatic', 'engine': '0.0l', 'fuel_type': 'electric', 'odometer': 48515, 'odometer_reading_unit': 'mi', 'registration_date': '2020-06-30', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/peugeot/208?id=2744515', 'location': 'bristol', 'origin_country_code': 'gb', 'trim': '100kw allure 50kwh 5dr auto', 'license_plate': 'wu20rfz', 'year': 2020, 'listing': 'auction', 'c_o_2_emission_value': 0, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002744515-01987446-003.pdf', 'expiration_date': '2025-12-09t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': '1f34256c-0283-53a1-8b9e-4dd8212837f4', 'current_year_diff': 5, 'age_in_months': 65, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 78077} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 65,
     'auction_title': '',
     'c_o_2_emission_value': 0,
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002744515-01987446-003.pdf',
     'color': 'white',
     'currency': 'gbp',
     'current_year_diff': 5,
     'engine': '0.0l',
     'expiration_date': '2025-12-09t09:00:00z',
     'fuel_type': 'electric',
     'id': '1f34256c-0283-53a1-8b9e-4dd8212837f4',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'wu20rfz',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/peugeot/208?id=2744515',
     'listing': 'auction',
     'location': 'bristol',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 48515,
     'odometer_in_km': 78077,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2020-06-30',
     'sanitized_make': 'peugeot',
     'seller_name': 'mobilize financial services',
     'title': 'peugeot 208 100kw allure 50kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '100kw allure 50kwh 5dr auto',
     'year': 2020}
2025-12-05 06:10:10 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 1f34256c-0283-53a1-8b9e-4dd8212837f4 spider: manheim.gb
2025-12-05 06:10:10 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 1f34256c-0283-53a1-8b9e-4dd8212837f4 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': 'mobilize financial services', 'price_includes_vat': False, 'title': 'peugeot 208 100kw allure 50kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'peugeot', 'model': '208', 'transmission': 'automatic', 'engine': '0.0l', 'fuel_type': 'electric', 'odometer': 48515, 'odometer_reading_unit': 'mi', 'registration_date': '2020-06-30', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/peugeot/208?id=2744515', 'location': 'bristol', 'origin_country_code': 'gb', 'trim': '100kw allure 50kwh 5dr auto', 'license_plate': 'wu20rfz', 'year': 2020, 'listing': 'auction', 'c_o_2_emission_value': 0, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002744515-01987446-003.pdf', 'expiration_date': '2025-12-09t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': '1f34256c-0283-53a1-8b9e-4dd8212837f4', 'current_year_diff': 5, 'age_in_months': 65, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 78077} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 65,
     'auction_title': '',
     'c_o_2_emission_value': 0,
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002744515-01987446-003.pdf',
     'color': 'white',
     'currency': 'gbp',
     'current_year_diff': 5,
     'engine': '0.0l',
     'expiration_date': '2025-12-09t09:00:00z',
     'fuel_type': 'electric',
     'id': '1f34256c-0283-53a1-8b9e-4dd8212837f4',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'wu20rfz',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/peugeot/208?id=2744515',
     'listing': 'auction',
     'location': 'bristol',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 48515,
     'odometer_in_km': 78077,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2020-06-30',
     'sanitized_make': 'peugeot',
     'seller_name': 'mobilize financial services',
     'title': 'peugeot 208 100kw allure 50kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '100kw allure 50kwh 5dr auto',
     'year': 2020}
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002744515-01987446-003.pdf',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '0.0L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Electric',
 'id': '1f34256c-0283-53a1-8b9e-4dd8212837f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'WU20RFZ',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/PEUGEOT/208?id=2744515',
 'listing': 'auction',
 'location': 'Bristol',
 'make': 'PEUGEOT',
 'model': '208',
 'odometer': 48515,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-30',
 'seller_name': 'Mobilize Financial Services',
 'title': 'PEUGEOT 208 100kW Allure 50kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '100kW Allure 50kWh 5dr Auto',
 'year': 2020}
2025-12-05 06:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272744515%27 HTTP/1.1" 200 None
2025-12-05 06:10:10 [manheim.gb] INFO: Saving data for 2744515: {'auction_closing_time': 1765270800.0, 'created_time': 1764792518.274724, 'last_price_update_time': 1764915010.603476}
2025-12-05 06:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2744515') HTTP/1.1" 204 0
2025-12-05 06:10:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/SKODA/FABIA?id=2871207&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232871207&indx=137> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:10:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:10:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10e99c2d-5dad-55d1-a2c8-378f73cd6cec with identifier: 2871207
2025-12-05 06:10:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10e99c2d-5dad-55d1-a2c8-378f73cd6cec with scrape type 2
2025-12-05 06:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 10e99c2d-5dad-55d1-a2c8-378f73cd6cec with scrape type 2
2025-12-05 06:10:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 10e99c2d-5dad-55d1-a2c8-378f73cd6cec, identifier: 2871207
2025-12-05 06:10:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 10e99c2d-5dad-55d1-a2c8-378f73cd6cec with identifier: 2871207
2025-12-05 06:10:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 10e99c2d-5dad-55d1-a2c8-378f73cd6cec with identifier: 2871207
2025-12-05 06:10:14 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 10e99c2d-5dad-55d1-a2c8-378f73cd6cec with identifier: 2871207 to the API
2025-12-05 06:10:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 06:10:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 06:10:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/SKODA/FABIA?id=2871207&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232871207&indx=137>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002871207-01981946-003.pdf',
 'color': 'BLUE',
 'currency': 'GBP',
 'engine': '1.0L',
 'expiration_date': '2025-12-10T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '10e99c2d-5dad-55d1-a2c8-378f73cd6cec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'YV68KSY',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/SKODA/FABIA?id=2871207',
 'listing': 'directbuy',
 'location': 'Plymouth',
 'make': 'SKODA',
 'model': 'FABIA',
 'odometer': 43567,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-15',
 'seller_name': 'Murray',
 'title': 'SKODA FABIA 1.0 MPI 75 S 5dr',
 'transmission': 'manual',
 'trim': '1.0 MPI 75 S 5dr',
 'year': 2019}
2025-12-05 06:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272871207%27 HTTP/1.1" 200 None
2025-12-05 06:10:15 [manheim.gb] INFO: Saving data for 2871207: {'auction_closing_time': 1765357200.0, 'created_time': 1764583536.58636, 'last_price_update_time': 1764915015.126326}
2025-12-05 06:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2871207') HTTP/1.1" 204 0
2025-12-05 06:10:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VAUXHALL/CORSA?id=2733772&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232733772&indx=128> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:10:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 06:10:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56e9ac73-6c27-5fba-b1f6-38f12ec2e0a5 with identifier: 2733772
2025-12-05 06:10:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56e9ac73-6c27-5fba-b1f6-38f12ec2e0a5 with scrape type 2
2025-12-05 06:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 56e9ac73-6c27-5fba-b1f6-38f12ec2e0a5 with scrape type 2
2025-12-05 06:10:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 56e9ac73-6c27-5fba-b1f6-38f12ec2e0a5, identifier: 2733772
2025-12-05 06:10:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 56e9ac73-6c27-5fba-b1f6-38f12ec2e0a5 with identifier: 2733772
2025-12-05 06:10:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 56e9ac73-6c27-5fba-b1f6-38f12ec2e0a5 with identifier: 2733772
2025-12-05 06:10:15 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 56e9ac73-6c27-5fba-b1f6-38f12ec2e0a5 with identifier: 2733772 to the API
2025-12-05 06:10:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 06:10:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 06:10:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/VAUXHALL/CORSA?id=2733772&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232733772&indx=128>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002733772-01992468-003.pdf',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '56e9ac73-6c27-5fba-b1f6-38f12ec2e0a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'DS20XXK',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VAUXHALL/CORSA?id=2733772',
 'listing': 'auction',
 'location': 'Shotts',
 'make': 'VAUXHALL',
 'model': 'CORSA',
 'odometer': 48175,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-31',
 'seller_name': 'MotoNovo Finance',
 'title': 'VAUXHALL CORSA 1.2 Turbo SRi Premium 5dr',
 'transmission': 'manual',
 'trim': '1.2 Turbo SRi Premium 5dr',
 'year': 2020}
2025-12-05 06:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272733772%27 HTTP/1.1" 200 None
2025-12-05 06:10:15 [manheim.gb] INFO: Saving data for 2733772: {'auction_closing_time': 1765270800.0, 'created_time': 1764792547.236157, 'last_price_update_time': 1764915015.696959}
2025-12-05 06:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2733772') HTTP/1.1" 204 0
2025-12-05 06:10:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/CITROEN/GRANDC4PICASSO?id=2660446&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232660446&indx=124> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:10:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f7dfe2a-7581-5021-af0a-ac80d728d074 with identifier: 2660446
2025-12-05 06:10:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f7dfe2a-7581-5021-af0a-ac80d728d074 with scrape type 2
2025-12-05 06:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f7dfe2a-7581-5021-af0a-ac80d728d074 with scrape type 2
2025-12-05 06:10:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 1f7dfe2a-7581-5021-af0a-ac80d728d074, identifier: 2660446
2025-12-05 06:10:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 1f7dfe2a-7581-5021-af0a-ac80d728d074 with identifier: 2660446
2025-12-05 06:10:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 1f7dfe2a-7581-5021-af0a-ac80d728d074 with identifier: 2660446
2025-12-05 06:10:17 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 1f7dfe2a-7581-5021-af0a-ac80d728d074 with identifier: 2660446 to the API
2025-12-05 06:10:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 06:10:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 06:10:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/CITROEN/GRANDC4PICASSO?id=2660446&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232660446&indx=124>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002660446-01985389-003.pdf',
 'color': 'RED',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': '2025-12-10T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '1f7dfe2a-7581-5021-af0a-ac80d728d074',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'FH66YSW',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/CITROEN/GRAND%20C4%20PICASSO?id=2660446',
 'listing': 'auction',
 'location': 'Plymouth',
 'make': 'CITROEN',
 'model': 'GRAND C4 PICASSO',
 'odometer': 37059,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-27',
 'seller_name': 'Startline Motor Finance',
 'title': 'CITROEN GRAND C4 PICASSO 1.2 PureTech Flair 5dr EAT6',
 'transmission': 'automatic',
 'trim': '1.2 PureTech Flair 5dr EAT6',
 'year': 2017}
2025-12-05 06:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272660446%27 HTTP/1.1" 200 None
2025-12-05 06:10:17 [manheim.gb] INFO: Saving data for 2660446: {'auction_closing_time': 1765357200.0, 'created_time': 1764669879.424154, 'last_price_update_time': 1764915017.746459}
2025-12-05 06:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2660446') HTTP/1.1" 204 0
2025-12-05 06:10:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/RENAULT/CAPTUR?id=2654910&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232654910&indx=123> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:10:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63d1f1f6-851c-5ced-9450-8799729fdeeb with identifier: 2654910
2025-12-05 06:10:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63d1f1f6-851c-5ced-9450-8799729fdeeb with scrape type 2
2025-12-05 06:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 63d1f1f6-851c-5ced-9450-8799729fdeeb with scrape type 2
2025-12-05 06:10:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 63d1f1f6-851c-5ced-9450-8799729fdeeb, identifier: 2654910
2025-12-05 06:10:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 63d1f1f6-851c-5ced-9450-8799729fdeeb with identifier: 2654910
2025-12-05 06:10:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 63d1f1f6-851c-5ced-9450-8799729fdeeb with identifier: 2654910
2025-12-05 06:10:23 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 63d1f1f6-851c-5ced-9450-8799729fdeeb with identifier: 2654910 to the API
2025-12-05 06:10:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 06:10:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 06:10:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/RENAULT/CAPTUR?id=2654910&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232654910&indx=123>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002654910-01991760-003.pdf',
 'color': 'WHITE AND BLACK',
 'currency': 'GBP',
 'engine': '0.9L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '63d1f1f6-851c-5ced-9450-8799729fdeeb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'EX68WGD',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/RENAULT/CAPTUR?id=2654910',
 'listing': 'auction',
 'location': 'Northampton',
 'make': 'RENAULT',
 'model': 'CAPTUR',
 'odometer': 26884,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-01',
 'seller_name': 'Wollaston',
 'title': 'RENAULT CAPTUR 0.9 TCE 90 Iconic 5dr',
 'transmission': 'manual',
 'trim': '0.9 TCE 90 Iconic 5dr',
 'year': 2018}
2025-12-05 06:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272654910%27 HTTP/1.1" 200 None
2025-12-05 06:10:23 [manheim.gb] INFO: Saving data for 2654910: {'auction_closing_time': 1765270800.0, 'created_time': 1764792565.751545, 'last_price_update_time': 1764915023.741943}
2025-12-05 06:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2654910') HTTP/1.1" 204 0
2025-12-05 06:10:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/AUDI/Q2?id=2699424&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232699424&indx=126> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:10:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1dd80438-1677-58c3-8d1a-65f7c94da149 with identifier: 2699424
2025-12-05 06:10:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1dd80438-1677-58c3-8d1a-65f7c94da149 with scrape type 2
2025-12-05 06:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1dd80438-1677-58c3-8d1a-65f7c94da149 with scrape type 2
2025-12-05 06:10:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 1dd80438-1677-58c3-8d1a-65f7c94da149, identifier: 2699424
2025-12-05 06:10:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 1dd80438-1677-58c3-8d1a-65f7c94da149 with identifier: 2699424
2025-12-05 06:10:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 1dd80438-1677-58c3-8d1a-65f7c94da149 with identifier: 2699424
2025-12-05 06:10:25 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 1dd80438-1677-58c3-8d1a-65f7c94da149 with identifier: 2699424 to the API
2025-12-05 06:10:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 06:10:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 06:10:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/AUDI/Q2?id=2699424&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232699424&indx=126>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002699424-01987556-003.pdf',
 'color': 'RED',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '1dd80438-1677-58c3-8d1a-65f7c94da149',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'AK17MVP',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/AUDI/Q2?id=2699424',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'AUDI',
 'model': 'Q2',
 'odometer': 78547,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-24',
 'seller_name': 'MotoNovo Finance',
 'title': 'AUDI Q2 1.6 TDI S Line 5dr S Tronic',
 'transmission': 'automatic',
 'trim': '1.6 TDI S Line 5dr S Tronic',
 'year': 2017}
2025-12-05 06:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272699424%27 HTTP/1.1" 200 None
2025-12-05 06:10:26 [manheim.gb] INFO: Saving data for 2699424: {'auction_closing_time': 1765270800.0, 'created_time': 1764792568.925052, 'last_price_update_time': 1764915026.982221}
2025-12-05 06:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2699424') HTTP/1.1" 204 0
2025-12-05 06:10:29 [scrapy.extensions.logstats] INFO: Crawled 186 pages (at 19 pages/min), scraped 73 items (at 13 items/min)
2025-12-05 06:10:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=2628170&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232628170&indx=121> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:10:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5050aad-6aff-5c8b-b8c3-3dc42d9d4d5a with identifier: 2628170
2025-12-05 06:10:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5050aad-6aff-5c8b-b8c3-3dc42d9d4d5a with scrape type 2
2025-12-05 06:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e5050aad-6aff-5c8b-b8c3-3dc42d9d4d5a with scrape type 2
2025-12-05 06:10:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: e5050aad-6aff-5c8b-b8c3-3dc42d9d4d5a, identifier: 2628170
2025-12-05 06:10:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: e5050aad-6aff-5c8b-b8c3-3dc42d9d4d5a with identifier: 2628170
2025-12-05 06:10:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: e5050aad-6aff-5c8b-b8c3-3dc42d9d4d5a with identifier: 2628170
2025-12-05 06:10:35 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 150077 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    150077
2025-12-05 06:10:35 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: e5050aad-6aff-5c8b-b8c3-3dc42d9d4d5a spider: manheim.gb
2025-12-05 06:10:35 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: e5050aad-6aff-5c8b-b8c3-3dc42d9d4d5a due to rule: high_mileage_for_country.json, error: 150077 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    150077
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002628170-01990600-003.pdf',
 'color': 'Black',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': '2025-12-05T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'e5050aad-6aff-5c8b-b8c3-3dc42d9d4d5a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'YE15UFN',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=2628170',
 'listing': 'auction',
 'location': 'Birmingham',
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 93254,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-20',
 'seller_name': 'Sandicliffe',
 'title': 'NISSAN QASHQAI 1.6 dCi Tekna 5dr 4WD',
 'transmission': 'manual',
 'trim': '1.6 dCi Tekna 5dr 4WD',
 'year': 2015}
2025-12-05 06:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272628170%27 HTTP/1.1" 200 None
2025-12-05 06:10:35 [manheim.gb] INFO: Saving data for 2628170: {'auction_closing_time': 1764925200.0, 'created_time': 1764792563.808471, 'last_price_update_time': 1764915035.575866}
2025-12-05 06:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2628170') HTTP/1.1" 204 0
2025-12-05 06:10:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/ALFA%20ROMEO/STELVIO?id=2609231&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232609231&indx=119> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:10:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31dc8122-dc86-509b-894f-12f2ed795549 with identifier: 2609231
2025-12-05 06:10:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31dc8122-dc86-509b-894f-12f2ed795549 with scrape type 2
2025-12-05 06:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 31dc8122-dc86-509b-894f-12f2ed795549 with scrape type 2
2025-12-05 06:10:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 31dc8122-dc86-509b-894f-12f2ed795549, identifier: 2609231
2025-12-05 06:10:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 31dc8122-dc86-509b-894f-12f2ed795549 with identifier: 2609231
2025-12-05 06:10:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 31dc8122-dc86-509b-894f-12f2ed795549 with identifier: 2609231
2025-12-05 06:10:37 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 153741 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    153741
2025-12-05 06:10:37 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 31dc8122-dc86-509b-894f-12f2ed795549 spider: manheim.gb
2025-12-05 06:10:37 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 31dc8122-dc86-509b-894f-12f2ed795549 due to rule: high_mileage_for_country.json, error: 153741 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    153741
{'auction_title': '',
 'c_o_2_emission_value': 161,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002609231-01875006-003.pdf',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '31dc8122-dc86-509b-894f-12f2ed795549',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'LO67YGU',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/ALFA%20ROMEO/STELVIO?id=2609231',
 'listing': 'auction',
 'location': 'Bristol',
 'make': 'ALFA ROMEO',
 'model': 'STELVIO',
 'odometer': 95531,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-15',
 'seller_name': 'FCA Group',
 'title': 'ALFA ROMEO STELVIO 2.0 Turbo 280 Speciale 5dr Auto',
 'transmission': 'automatic',
 'trim': '2.0 Turbo 280 Speciale 5dr Auto',
 'year': 2018}
2025-12-05 06:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272609231%27 HTTP/1.1" 200 None
2025-12-05 06:10:37 [manheim.gb] INFO: Saving data for 2609231: {'auction_closing_time': 1765270800.0, 'created_time': 1764583757.529009, 'last_price_update_time': 1764915037.948987}
2025-12-05 06:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2609231') HTTP/1.1" 204 0
2025-12-05 06:10:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/ACLASS?id=2590049&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232590049&indx=115> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:10:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc2682fe-56ca-516e-bc52-bfedae204133 with identifier: 2590049
2025-12-05 06:10:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc2682fe-56ca-516e-bc52-bfedae204133 with scrape type 2
2025-12-05 06:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc2682fe-56ca-516e-bc52-bfedae204133 with scrape type 2
2025-12-05 06:10:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: fc2682fe-56ca-516e-bc52-bfedae204133, identifier: 2590049
2025-12-05 06:10:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: fc2682fe-56ca-516e-bc52-bfedae204133 with identifier: 2590049
2025-12-05 06:10:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: fc2682fe-56ca-516e-bc52-bfedae204133 with identifier: 2590049
2025-12-05 06:10:43 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 194364 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    194364
2025-12-05 06:10:43 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: fc2682fe-56ca-516e-bc52-bfedae204133 spider: manheim.gb
2025-12-05 06:10:43 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: fc2682fe-56ca-516e-bc52-bfedae204133 due to rule: high_mileage_for_country.json, error: 194364 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    194364
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002590049-01989186-003.pdf',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '1.5L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'fc2682fe-56ca-516e-bc52-bfedae204133',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'K800CNH',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/A%20CLASS?id=2590049',
 'listing': 'auction',
 'location': 'Leeds',
 'make': 'MERCEDES-BENZ',
 'model': 'A CLASS',
 'odometer': 120773,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-30',
 'seller_name': 'Big Motoring World Ltd',
 'title': 'MERCEDES-BENZ A CLASS A180d AMG Line 5dr',
 'transmission': 'manual',
 'trim': 'A180d AMG Line 5dr',
 'year': 2017}
2025-12-05 06:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272590049%27 HTTP/1.1" 200 None
2025-12-05 06:10:43 [manheim.gb] INFO: Saving data for 2590049: {'auction_closing_time': 1765184400.0, 'created_time': 1764756182.853128, 'last_price_update_time': 1764915043.534525}
2025-12-05 06:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2590049') HTTP/1.1" 204 0
2025-12-05 06:10:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/NISSAN/JUKE?id=2585181&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232585181&indx=113> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:10:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 458c7121-91e1-5e41-b4a5-065576fc4c04 with identifier: 2585181
2025-12-05 06:10:45 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 458c7121-91e1-5e41-b4a5-065576fc4c04
2025-12-05 06:10:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/CITROEN/C1?id=2652071&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232652071&indx=122> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-05 06:10:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0002585181-01992158-004.pdf> (referer: None)
2025-12-05 06:10:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02 with identifier: 2652071
2025-12-05 06:10:46 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02
2025-12-05 06:10:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:10:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:10:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:10:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234158fa50>
2025-12-05 06:10:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:10:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:10:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:10:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:10:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:10:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:10:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_458c7121-91e1-5e41-b4a5-065576fc4c04/458c7121-91e1-5e41-b4a5-065576fc4c04_expert_report_file_ab409b02-98ff-4a80-bd48-11cedbd720d9.pdf HTTP/1.1" 201 0
2025-12-05 06:10:46 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 458c7121-91e1-5e41-b4a5-065576fc4c04
2025-12-05 06:10:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 458c7121-91e1-5e41-b4a5-065576fc4c04, skipping ID generation
2025-12-05 06:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 458c7121-91e1-5e41-b4a5-065576fc4c04
2025-12-05 06:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe936fc9c-6f44-4e08-8161-19d6479c24c5_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e936fc9c-6f44-4e08-8161-19d6479c24c5_ext_7.jpg not downloaded yet
2025-12-05 06:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe936fc9c-6f44-4e08-8161-19d6479c24c5_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e936fc9c-6f44-4e08-8161-19d6479c24c5_ext_7.jpg not downloaded yet
2025-12-05 06:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe936fc9c-6f44-4e08-8161-19d6479c24c5_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e936fc9c-6f44-4e08-8161-19d6479c24c5_ext_6.jpg not downloaded yet
2025-12-05 06:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe936fc9c-6f44-4e08-8161-19d6479c24c5_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e936fc9c-6f44-4e08-8161-19d6479c24c5_ext_1.jpg not downloaded yet
2025-12-05 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe936fc9c-6f44-4e08-8161-19d6479c24c5_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e936fc9c-6f44-4e08-8161-19d6479c24c5_5.jpg not downloaded yet
2025-12-05 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe936fc9c-6f44-4e08-8161-19d6479c24c5_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e936fc9c-6f44-4e08-8161-19d6479c24c5_4.jpg not downloaded yet
2025-12-05 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe936fc9c-6f44-4e08-8161-19d6479c24c5_11.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e936fc9c-6f44-4e08-8161-19d6479c24c5_11.jpg not downloaded yet
2025-12-05 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe936fc9c-6f44-4e08-8161-19d6479c24c5_10.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e936fc9c-6f44-4e08-8161-19d6479c24c5_10.jpg not downloaded yet
2025-12-05 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe936fc9c-6f44-4e08-8161-19d6479c24c5_9.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e936fc9c-6f44-4e08-8161-19d6479c24c5_9.jpg not downloaded yet
2025-12-05 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe936fc9c-6f44-4e08-8161-19d6479c24c5_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e936fc9c-6f44-4e08-8161-19d6479c24c5_ext_2.jpg not downloaded yet
2025-12-05 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe936fc9c-6f44-4e08-8161-19d6479c24c5_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e936fc9c-6f44-4e08-8161-19d6479c24c5_ext_5.jpg not downloaded yet
2025-12-05 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe936fc9c-6f44-4e08-8161-19d6479c24c5_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e936fc9c-6f44-4e08-8161-19d6479c24c5_ext_3.jpg not downloaded yet
2025-12-05 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe936fc9c-6f44-4e08-8161-19d6479c24c5_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e936fc9c-6f44-4e08-8161-19d6479c24c5_ext_4.jpg not downloaded yet
2025-12-05 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2585181-4008021-13.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2585181-4008021-13.jpg not downloaded yet
2025-12-05 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2585181-4008021-1000.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2585181-4008021-1000.jpg not downloaded yet
2025-12-05 06:10:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0002652071-01990412-002.pdf> (referer: None)
2025-12-05 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2585181-4008021-1001.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2585181-4008021-1001.jpg not downloaded yet
2025-12-05 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2585181-4008021-1002.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2585181-4008021-1002.jpg not downloaded yet
2025-12-05 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2585181-4008021-1003.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2585181-4008021-1003.jpg not downloaded yet
2025-12-05 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2585181-4008021-1004.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2585181-4008021-1004.jpg not downloaded yet
2025-12-05 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2585181-4008021-1005.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2585181-4008021-1005.jpg not downloaded yet
2025-12-05 06:10:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:10:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:10:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:10:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341ed6b50>
2025-12-05 06:10:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:10:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:10:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:10:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:10:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:10:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:10:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02/e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02_expert_report_file_50ace9bc-343b-4e7e-84f7-2fa7eefbdacf.pdf HTTP/1.1" 201 0
2025-12-05 06:10:47 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02
2025-12-05 06:10:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02, skipping ID generation
2025-12-05 06:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02
2025-12-05 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff9a6af01-2d95-41b5-a961-09f86495ccd0_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f9a6af01-2d95-41b5-a961-09f86495ccd0_ext_7.jpg not downloaded yet
2025-12-05 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff9a6af01-2d95-41b5-a961-09f86495ccd0_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f9a6af01-2d95-41b5-a961-09f86495ccd0_ext_7.jpg not downloaded yet
2025-12-05 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff9a6af01-2d95-41b5-a961-09f86495ccd0_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f9a6af01-2d95-41b5-a961-09f86495ccd0_ext_6.jpg not downloaded yet
2025-12-05 06:10:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e936fc9c-6f44-4e08-8161-19d6479c24c5_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002585181-01992158-004.pdf)
2025-12-05 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff9a6af01-2d95-41b5-a961-09f86495ccd0_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f9a6af01-2d95-41b5-a961-09f86495ccd0_ext_1.jpg not downloaded yet
2025-12-05 06:10:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e936fc9c-6f44-4e08-8161-19d6479c24c5_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002585181-01992158-004.pdf)
2025-12-05 06:10:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e936fc9c-6f44-4e08-8161-19d6479c24c5_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002585181-01992158-004.pdf)
2025-12-05 06:10:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e936fc9c-6f44-4e08-8161-19d6479c24c5_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002585181-01992158-004.pdf)
2025-12-05 06:10:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e936fc9c-6f44-4e08-8161-19d6479c24c5_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002585181-01992158-004.pdf)
2025-12-05 06:10:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e936fc9c-6f44-4e08-8161-19d6479c24c5_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002585181-01992158-004.pdf)
2025-12-05 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff9a6af01-2d95-41b5-a961-09f86495ccd0_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f9a6af01-2d95-41b5-a961-09f86495ccd0_5.jpg not downloaded yet
2025-12-05 06:10:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e936fc9c-6f44-4e08-8161-19d6479c24c5_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002585181-01992158-004.pdf)
2025-12-05 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff9a6af01-2d95-41b5-a961-09f86495ccd0_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f9a6af01-2d95-41b5-a961-09f86495ccd0_4.jpg not downloaded yet
2025-12-05 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff9a6af01-2d95-41b5-a961-09f86495ccd0_11.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f9a6af01-2d95-41b5-a961-09f86495ccd0_11.jpg not downloaded yet
2025-12-05 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff9a6af01-2d95-41b5-a961-09f86495ccd0_10.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f9a6af01-2d95-41b5-a961-09f86495ccd0_10.jpg not downloaded yet
2025-12-05 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff9a6af01-2d95-41b5-a961-09f86495ccd0_9.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f9a6af01-2d95-41b5-a961-09f86495ccd0_9.jpg not downloaded yet
2025-12-05 06:10:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e936fc9c-6f44-4e08-8161-19d6479c24c5_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002585181-01992158-004.pdf)
2025-12-05 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff9a6af01-2d95-41b5-a961-09f86495ccd0_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f9a6af01-2d95-41b5-a961-09f86495ccd0_ext_2.jpg not downloaded yet
2025-12-05 06:10:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:10:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:10:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:10:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341eb4510>
2025-12-05 06:10:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:10:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:10:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:10:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:10:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:10:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:10:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_458c7121-91e1-5e41-b4a5-065576fc4c04/458c7121-91e1-5e41-b4a5-065576fc4c04_image_1.jpg HTTP/1.1" 201 0
2025-12-05 06:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe936fc9c-6f44-4e08-8161-19d6479c24c5_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 06:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e936fc9c-6f44-4e08-8161-19d6479c24c5_ext_7.jpg saved to cache
2025-12-05 06:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 458c7121-91e1-5e41-b4a5-065576fc4c04
2025-12-05 06:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff9a6af01-2d95-41b5-a961-09f86495ccd0_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f9a6af01-2d95-41b5-a961-09f86495ccd0_ext_5.jpg not downloaded yet
2025-12-05 06:10:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:10:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:10:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:10:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23427c04d0>
2025-12-05 06:10:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:10:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:10:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 06:10:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:10:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:10:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:10:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_458c7121-91e1-5e41-b4a5-065576fc4c04/458c7121-91e1-5e41-b4a5-065576fc4c04_image_6.jpg HTTP/1.1" 201 0
2025-12-05 06:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe936fc9c-6f44-4e08-8161-19d6479c24c5_11.jpg') HTTP/1.1" 204 0
2025-12-05 06:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e936fc9c-6f44-4e08-8161-19d6479c24c5_11.jpg saved to cache
2025-12-05 06:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 458c7121-91e1-5e41-b4a5-065576fc4c04
2025-12-05 06:10:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:10:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:10:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:10:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342801490>
2025-12-05 06:10:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:10:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:10:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:10:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:10:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:10:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:10:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_458c7121-91e1-5e41-b4a5-065576fc4c04/458c7121-91e1-5e41-b4a5-065576fc4c04_image_4.jpg HTTP/1.1" 201 0
2025-12-05 06:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe936fc9c-6f44-4e08-8161-19d6479c24c5_5.jpg') HTTP/1.1" 204 0
2025-12-05 06:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e936fc9c-6f44-4e08-8161-19d6479c24c5_5.jpg saved to cache
2025-12-05 06:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 458c7121-91e1-5e41-b4a5-065576fc4c04
2025-12-05 06:10:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:10:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:10:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:10:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425f0610>
2025-12-05 06:10:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:10:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:10:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 06:10:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:10:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:10:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:10:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_458c7121-91e1-5e41-b4a5-065576fc4c04/458c7121-91e1-5e41-b4a5-065576fc4c04_image_0.jpg HTTP/1.1" 201 0
2025-12-05 06:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe936fc9c-6f44-4e08-8161-19d6479c24c5_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 06:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e936fc9c-6f44-4e08-8161-19d6479c24c5_ext_7.jpg saved to cache
2025-12-05 06:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 458c7121-91e1-5e41-b4a5-065576fc4c04
2025-12-05 06:10:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:10:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:10:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:10:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23428a46d0>
2025-12-05 06:10:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:10:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:10:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:10:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:10:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:10:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:10:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_458c7121-91e1-5e41-b4a5-065576fc4c04/458c7121-91e1-5e41-b4a5-065576fc4c04_image_7.jpg HTTP/1.1" 201 0
2025-12-05 06:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe936fc9c-6f44-4e08-8161-19d6479c24c5_10.jpg') HTTP/1.1" 204 0
2025-12-05 06:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e936fc9c-6f44-4e08-8161-19d6479c24c5_10.jpg saved to cache
2025-12-05 06:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 458c7121-91e1-5e41-b4a5-065576fc4c04
2025-12-05 06:10:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:10:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:10:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:10:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425f2350>
2025-12-05 06:10:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:10:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:10:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:10:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:10:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:10:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:10:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_458c7121-91e1-5e41-b4a5-065576fc4c04/458c7121-91e1-5e41-b4a5-065576fc4c04_image_2.jpg HTTP/1.1" 201 0
2025-12-05 06:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe936fc9c-6f44-4e08-8161-19d6479c24c5_ext_6.jpg') HTTP/1.1" 204 0
2025-12-05 06:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e936fc9c-6f44-4e08-8161-19d6479c24c5_ext_6.jpg saved to cache
2025-12-05 06:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 458c7121-91e1-5e41-b4a5-065576fc4c04
2025-12-05 06:10:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:10:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:10:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:10:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23426dab90>
2025-12-05 06:10:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:10:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:10:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:10:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:10:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:10:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:10:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_458c7121-91e1-5e41-b4a5-065576fc4c04/458c7121-91e1-5e41-b4a5-065576fc4c04_image_5.jpg HTTP/1.1" 201 0
2025-12-05 06:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe936fc9c-6f44-4e08-8161-19d6479c24c5_4.jpg') HTTP/1.1" 204 0
2025-12-05 06:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e936fc9c-6f44-4e08-8161-19d6479c24c5_4.jpg saved to cache
2025-12-05 06:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 458c7121-91e1-5e41-b4a5-065576fc4c04
2025-12-05 06:10:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:10:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:10:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:10:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234244ec90>
2025-12-05 06:10:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:10:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:10:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:10:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:10:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:10:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:10:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_458c7121-91e1-5e41-b4a5-065576fc4c04/458c7121-91e1-5e41-b4a5-065576fc4c04_image_3.jpg HTTP/1.1" 201 0
2025-12-05 06:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe936fc9c-6f44-4e08-8161-19d6479c24c5_ext_1.jpg') HTTP/1.1" 204 0
2025-12-05 06:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e936fc9c-6f44-4e08-8161-19d6479c24c5_ext_1.jpg saved to cache
2025-12-05 06:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 458c7121-91e1-5e41-b4a5-065576fc4c04
2025-12-05 06:10:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e936fc9c-6f44-4e08-8161-19d6479c24c5_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002585181-01992158-004.pdf)
2025-12-05 06:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff9a6af01-2d95-41b5-a961-09f86495ccd0_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f9a6af01-2d95-41b5-a961-09f86495ccd0_ext_3.jpg not downloaded yet
2025-12-05 06:10:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e936fc9c-6f44-4e08-8161-19d6479c24c5_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002585181-01992158-004.pdf)
2025-12-05 06:10:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e936fc9c-6f44-4e08-8161-19d6479c24c5_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002585181-01992158-004.pdf)
2025-12-05 06:10:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e936fc9c-6f44-4e08-8161-19d6479c24c5_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002585181-01992158-004.pdf)
2025-12-05 06:10:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2585181-4008021-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002585181-01992158-004.pdf)
2025-12-05 06:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff9a6af01-2d95-41b5-a961-09f86495ccd0_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f9a6af01-2d95-41b5-a961-09f86495ccd0_ext_4.jpg not downloaded yet
2025-12-05 06:10:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e936fc9c-6f44-4e08-8161-19d6479c24c5_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002585181-01992158-004.pdf)
2025-12-05 06:10:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2585181-4008021-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002585181-01992158-004.pdf)
2025-12-05 06:10:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2585181-4008021-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002585181-01992158-004.pdf)
2025-12-05 06:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2652071-4008559-13.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2652071-4008559-13.jpg not downloaded yet
2025-12-05 06:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2652071-4008559-1000.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2652071-4008559-1000.jpg not downloaded yet
2025-12-05 06:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2652071-4008559-1001.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2652071-4008559-1001.jpg not downloaded yet
2025-12-05 06:10:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:10:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:10:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:10:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341ef0290>
2025-12-05 06:10:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:10:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:10:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:10:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:10:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:10:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:10:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_458c7121-91e1-5e41-b4a5-065576fc4c04/458c7121-91e1-5e41-b4a5-065576fc4c04_image_11.jpg HTTP/1.1" 201 0
2025-12-05 06:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe936fc9c-6f44-4e08-8161-19d6479c24c5_ext_3.jpg') HTTP/1.1" 204 0
2025-12-05 06:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e936fc9c-6f44-4e08-8161-19d6479c24c5_ext_3.jpg saved to cache
2025-12-05 06:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 458c7121-91e1-5e41-b4a5-065576fc4c04
2025-12-05 06:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2652071-4008559-1002.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2652071-4008559-1002.jpg not downloaded yet
2025-12-05 06:10:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:10:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:10:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:10:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234157de10>
2025-12-05 06:10:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:10:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:10:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:10:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:10:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:10:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:10:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_458c7121-91e1-5e41-b4a5-065576fc4c04/458c7121-91e1-5e41-b4a5-065576fc4c04_image_8.jpg HTTP/1.1" 201 0
2025-12-05 06:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe936fc9c-6f44-4e08-8161-19d6479c24c5_9.jpg') HTTP/1.1" 204 0
2025-12-05 06:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e936fc9c-6f44-4e08-8161-19d6479c24c5_9.jpg saved to cache
2025-12-05 06:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 458c7121-91e1-5e41-b4a5-065576fc4c04
2025-12-05 06:10:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:10:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:10:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:10:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341ea8fd0>
2025-12-05 06:10:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:10:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:10:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:10:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:10:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:10:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:10:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_458c7121-91e1-5e41-b4a5-065576fc4c04/458c7121-91e1-5e41-b4a5-065576fc4c04_image_10.jpg HTTP/1.1" 201 0
2025-12-05 06:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe936fc9c-6f44-4e08-8161-19d6479c24c5_ext_5.jpg') HTTP/1.1" 204 0
2025-12-05 06:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e936fc9c-6f44-4e08-8161-19d6479c24c5_ext_5.jpg saved to cache
2025-12-05 06:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 458c7121-91e1-5e41-b4a5-065576fc4c04
2025-12-05 06:10:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2585181-4008021-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002585181-01992158-004.pdf)
2025-12-05 06:10:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2585181-4008021-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002585181-01992158-004.pdf)
2025-12-05 06:10:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2585181-4008021-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002585181-01992158-004.pdf)
2025-12-05 06:10:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f9a6af01-2d95-41b5-a961-09f86495ccd0_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002652071-01990412-002.pdf)
2025-12-05 06:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2652071-4008559-1003.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2652071-4008559-1003.jpg not downloaded yet
2025-12-05 06:10:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f9a6af01-2d95-41b5-a961-09f86495ccd0_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002652071-01990412-002.pdf)
2025-12-05 06:10:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f9a6af01-2d95-41b5-a961-09f86495ccd0_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002652071-01990412-002.pdf)
2025-12-05 06:10:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f9a6af01-2d95-41b5-a961-09f86495ccd0_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002652071-01990412-002.pdf)
2025-12-05 06:10:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f9a6af01-2d95-41b5-a961-09f86495ccd0_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002652071-01990412-002.pdf)
2025-12-05 06:10:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:10:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:10:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:10:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341e93050>
2025-12-05 06:10:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:10:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:10:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:10:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:10:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:10:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:10:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_458c7121-91e1-5e41-b4a5-065576fc4c04/458c7121-91e1-5e41-b4a5-065576fc4c04_image_9.jpg HTTP/1.1" 201 0
2025-12-05 06:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe936fc9c-6f44-4e08-8161-19d6479c24c5_ext_2.jpg') HTTP/1.1" 204 0
2025-12-05 06:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e936fc9c-6f44-4e08-8161-19d6479c24c5_ext_2.jpg saved to cache
2025-12-05 06:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 458c7121-91e1-5e41-b4a5-065576fc4c04
2025-12-05 06:10:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:10:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:10:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:10:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341f02850>
2025-12-05 06:10:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:10:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:10:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:10:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:10:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:10:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:10:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_458c7121-91e1-5e41-b4a5-065576fc4c04/458c7121-91e1-5e41-b4a5-065576fc4c04_image_14.jpg HTTP/1.1" 201 0
2025-12-05 06:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2585181-4008021-1000.jpg') HTTP/1.1" 204 0
2025-12-05 06:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2585181-4008021-1000.jpg saved to cache
2025-12-05 06:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 458c7121-91e1-5e41-b4a5-065576fc4c04
2025-12-05 06:10:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:10:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:10:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:10:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23415a0bd0>
2025-12-05 06:10:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:10:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:10:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 06:10:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:10:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:10:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:10:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_458c7121-91e1-5e41-b4a5-065576fc4c04/458c7121-91e1-5e41-b4a5-065576fc4c04_image_12.jpg HTTP/1.1" 201 0
2025-12-05 06:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe936fc9c-6f44-4e08-8161-19d6479c24c5_ext_4.jpg') HTTP/1.1" 204 0
2025-12-05 06:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e936fc9c-6f44-4e08-8161-19d6479c24c5_ext_4.jpg saved to cache
2025-12-05 06:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 458c7121-91e1-5e41-b4a5-065576fc4c04
2025-12-05 06:10:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:10:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:10:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:10:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23425b2090>
2025-12-05 06:10:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:10:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:10:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 06:10:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:10:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:10:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:10:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_458c7121-91e1-5e41-b4a5-065576fc4c04/458c7121-91e1-5e41-b4a5-065576fc4c04_image_13.jpg HTTP/1.1" 201 0
2025-12-05 06:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2585181-4008021-13.jpg') HTTP/1.1" 204 0
2025-12-05 06:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2585181-4008021-13.jpg saved to cache
2025-12-05 06:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 458c7121-91e1-5e41-b4a5-065576fc4c04
2025-12-05 06:10:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:10:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:10:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:10:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23424ce910>
2025-12-05 06:10:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:10:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:10:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:10:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:10:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:10:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:10:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_458c7121-91e1-5e41-b4a5-065576fc4c04/458c7121-91e1-5e41-b4a5-065576fc4c04_image_15.jpg HTTP/1.1" 201 0
2025-12-05 06:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2585181-4008021-1001.jpg') HTTP/1.1" 204 0
2025-12-05 06:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2585181-4008021-1001.jpg saved to cache
2025-12-05 06:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 458c7121-91e1-5e41-b4a5-065576fc4c04
2025-12-05 06:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2652071-4008559-1004.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2652071-4008559-1004.jpg not downloaded yet
2025-12-05 06:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2652071-4008559-1005.jpg%27 HTTP/1.1" 200 None
2025-12-05 06:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2652071-4008559-1005.jpg not downloaded yet
2025-12-05 06:10:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:10:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:10:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:10:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342662250>
2025-12-05 06:10:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:10:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:10:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:10:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:10:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:10:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:10:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_458c7121-91e1-5e41-b4a5-065576fc4c04/458c7121-91e1-5e41-b4a5-065576fc4c04_image_19.jpg HTTP/1.1" 201 0
2025-12-05 06:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2585181-4008021-1005.jpg') HTTP/1.1" 204 0
2025-12-05 06:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2585181-4008021-1005.jpg saved to cache
2025-12-05 06:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 458c7121-91e1-5e41-b4a5-065576fc4c04
2025-12-05 06:10:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:10:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:10:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:10:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341583790>
2025-12-05 06:10:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:10:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:10:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:10:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:10:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:10:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:10:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_458c7121-91e1-5e41-b4a5-065576fc4c04/458c7121-91e1-5e41-b4a5-065576fc4c04_image_18.jpg HTTP/1.1" 201 0
2025-12-05 06:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2585181-4008021-1004.jpg') HTTP/1.1" 204 0
2025-12-05 06:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2585181-4008021-1004.jpg saved to cache
2025-12-05 06:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 458c7121-91e1-5e41-b4a5-065576fc4c04
2025-12-05 06:10:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:10:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:10:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:10:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234155e390>
2025-12-05 06:10:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:10:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:10:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:10:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:10:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:10:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:10:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_458c7121-91e1-5e41-b4a5-065576fc4c04/458c7121-91e1-5e41-b4a5-065576fc4c04_image_17.jpg HTTP/1.1" 201 0
2025-12-05 06:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2585181-4008021-1003.jpg') HTTP/1.1" 204 0
2025-12-05 06:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2585181-4008021-1003.jpg saved to cache
2025-12-05 06:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 458c7121-91e1-5e41-b4a5-065576fc4c04
2025-12-05 06:10:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:10:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:10:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:10:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23415bd090>
2025-12-05 06:10:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:10:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:10:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:10:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:10:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:10:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:10:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02/e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02_image_3.jpg HTTP/1.1" 201 0
2025-12-05 06:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff9a6af01-2d95-41b5-a961-09f86495ccd0_ext_1.jpg') HTTP/1.1" 204 0
2025-12-05 06:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f9a6af01-2d95-41b5-a961-09f86495ccd0_ext_1.jpg saved to cache
2025-12-05 06:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02
2025-12-05 06:10:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:10:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:10:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:10:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341580710>
2025-12-05 06:10:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:10:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:10:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:10:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:10:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02/e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02_image_1.jpg HTTP/1.1" 201 0
2025-12-05 06:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff9a6af01-2d95-41b5-a961-09f86495ccd0_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 06:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f9a6af01-2d95-41b5-a961-09f86495ccd0_ext_7.jpg saved to cache
2025-12-05 06:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02
2025-12-05 06:10:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:10:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:10:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:10:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234253f290>
2025-12-05 06:10:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:10:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:10:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:10:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:10:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02/e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02_image_2.jpg HTTP/1.1" 201 0
2025-12-05 06:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff9a6af01-2d95-41b5-a961-09f86495ccd0_ext_6.jpg') HTTP/1.1" 204 0
2025-12-05 06:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f9a6af01-2d95-41b5-a961-09f86495ccd0_ext_6.jpg saved to cache
2025-12-05 06:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02
2025-12-05 06:10:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:10:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:10:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:10:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234158dc10>
2025-12-05 06:10:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:10:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:10:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:10:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:10:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02/e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02_image_0.jpg HTTP/1.1" 201 0
2025-12-05 06:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff9a6af01-2d95-41b5-a961-09f86495ccd0_ext_7.jpg') HTTP/1.1" 204 0
2025-12-05 06:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f9a6af01-2d95-41b5-a961-09f86495ccd0_ext_7.jpg saved to cache
2025-12-05 06:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02
2025-12-05 06:10:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:10:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:10:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:10:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342626210>
2025-12-05 06:10:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:10:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:10:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:10:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:10:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02/e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02_image_8.jpg HTTP/1.1" 201 0
2025-12-05 06:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff9a6af01-2d95-41b5-a961-09f86495ccd0_9.jpg') HTTP/1.1" 204 0
2025-12-05 06:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f9a6af01-2d95-41b5-a961-09f86495ccd0_9.jpg saved to cache
2025-12-05 06:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02
2025-12-05 06:10:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f9a6af01-2d95-41b5-a961-09f86495ccd0_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002652071-01990412-002.pdf)
2025-12-05 06:10:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f9a6af01-2d95-41b5-a961-09f86495ccd0_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002652071-01990412-002.pdf)
2025-12-05 06:10:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f9a6af01-2d95-41b5-a961-09f86495ccd0_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002652071-01990412-002.pdf)
2025-12-05 06:10:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f9a6af01-2d95-41b5-a961-09f86495ccd0_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002652071-01990412-002.pdf)
2025-12-05 06:10:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f9a6af01-2d95-41b5-a961-09f86495ccd0_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002652071-01990412-002.pdf)
2025-12-05 06:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f9a6af01-2d95-41b5-a961-09f86495ccd0_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002652071-01990412-002.pdf)
2025-12-05 06:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f9a6af01-2d95-41b5-a961-09f86495ccd0_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002652071-01990412-002.pdf)
2025-12-05 06:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f9a6af01-2d95-41b5-a961-09f86495ccd0_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002652071-01990412-002.pdf)
2025-12-05 06:10:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:10:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:10:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:10:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342605d10>
2025-12-05 06:10:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:10:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:10:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:10:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:10:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02/e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02_image_11.jpg HTTP/1.1" 201 0
2025-12-05 06:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff9a6af01-2d95-41b5-a961-09f86495ccd0_ext_3.jpg') HTTP/1.1" 204 0
2025-12-05 06:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f9a6af01-2d95-41b5-a961-09f86495ccd0_ext_3.jpg saved to cache
2025-12-05 06:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02
2025-12-05 06:10:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:10:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:10:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:10:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341ed9250>
2025-12-05 06:10:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:10:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:10:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:10:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:10:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02/e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02_image_10.jpg HTTP/1.1" 201 0
2025-12-05 06:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff9a6af01-2d95-41b5-a961-09f86495ccd0_ext_5.jpg') HTTP/1.1" 204 0
2025-12-05 06:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f9a6af01-2d95-41b5-a961-09f86495ccd0_ext_5.jpg saved to cache
2025-12-05 06:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02
2025-12-05 06:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2652071-4008559-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002652071-01990412-002.pdf)
2025-12-05 06:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2652071-4008559-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002652071-01990412-002.pdf)
2025-12-05 06:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2652071-4008559-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002652071-01990412-002.pdf)
2025-12-05 06:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2652071-4008559-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002652071-01990412-002.pdf)
2025-12-05 06:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2652071-4008559-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002652071-01990412-002.pdf)
2025-12-05 06:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2585181-4008021-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002585181-01992158-004.pdf)
2025-12-05 06:10:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:10:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:10:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:10:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23415c0690>
2025-12-05 06:10:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:10:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:10:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 06:10:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:10:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:10:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:10:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02/e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02_image_7.jpg HTTP/1.1" 201 0
2025-12-05 06:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff9a6af01-2d95-41b5-a961-09f86495ccd0_10.jpg') HTTP/1.1" 204 0
2025-12-05 06:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f9a6af01-2d95-41b5-a961-09f86495ccd0_10.jpg saved to cache
2025-12-05 06:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02
2025-12-05 06:10:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:10:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:10:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:10:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234253e210>
2025-12-05 06:10:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:10:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:10:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:10:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:10:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:10:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:10:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02/e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02_image_9.jpg HTTP/1.1" 201 0
2025-12-05 06:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff9a6af01-2d95-41b5-a961-09f86495ccd0_ext_2.jpg') HTTP/1.1" 204 0
2025-12-05 06:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f9a6af01-2d95-41b5-a961-09f86495ccd0_ext_2.jpg saved to cache
2025-12-05 06:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02
2025-12-05 06:10:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:10:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:10:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:10:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234237f690>
2025-12-05 06:10:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:10:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:10:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:10:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:10:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:10:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:10:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02/e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02_image_12.jpg HTTP/1.1" 201 0
2025-12-05 06:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff9a6af01-2d95-41b5-a961-09f86495ccd0_ext_4.jpg') HTTP/1.1" 204 0
2025-12-05 06:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f9a6af01-2d95-41b5-a961-09f86495ccd0_ext_4.jpg saved to cache
2025-12-05 06:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02
2025-12-05 06:10:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:10:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:10:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:10:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23423abc10>
2025-12-05 06:10:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:10:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:10:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:10:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:10:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:10:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:10:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02/e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02_image_6.jpg HTTP/1.1" 201 0
2025-12-05 06:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff9a6af01-2d95-41b5-a961-09f86495ccd0_11.jpg') HTTP/1.1" 204 0
2025-12-05 06:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f9a6af01-2d95-41b5-a961-09f86495ccd0_11.jpg saved to cache
2025-12-05 06:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02
2025-12-05 06:10:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:10:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:10:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:10:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23424f6350>
2025-12-05 06:10:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:10:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:10:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 06:10:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:10:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:10:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:10:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02/e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02_image_5.jpg HTTP/1.1" 201 0
2025-12-05 06:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff9a6af01-2d95-41b5-a961-09f86495ccd0_4.jpg') HTTP/1.1" 204 0
2025-12-05 06:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f9a6af01-2d95-41b5-a961-09f86495ccd0_4.jpg saved to cache
2025-12-05 06:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02
2025-12-05 06:10:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:10:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:10:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:10:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23424f4650>
2025-12-05 06:10:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:10:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:10:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:10:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:10:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:10:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:10:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02/e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02_image_4.jpg HTTP/1.1" 201 0
2025-12-05 06:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff9a6af01-2d95-41b5-a961-09f86495ccd0_5.jpg') HTTP/1.1" 204 0
2025-12-05 06:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f9a6af01-2d95-41b5-a961-09f86495ccd0_5.jpg saved to cache
2025-12-05 06:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02
2025-12-05 06:10:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2652071-4008559-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002652071-01990412-002.pdf)
2025-12-05 06:10:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2652071-4008559-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002652071-01990412-002.pdf)
2025-12-05 06:10:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:10:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:10:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:10:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234156d4d0>
2025-12-05 06:10:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:10:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:10:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:10:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:10:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:10:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:10:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02/e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02_image_17.jpg HTTP/1.1" 201 0
2025-12-05 06:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2652071-4008559-1003.jpg') HTTP/1.1" 204 0
2025-12-05 06:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2652071-4008559-1003.jpg saved to cache
2025-12-05 06:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02
2025-12-05 06:10:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:10:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:10:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:10:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23424eb150>
2025-12-05 06:10:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:10:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:10:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:10:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:10:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:10:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:10:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02/e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02_image_14.jpg HTTP/1.1" 201 0
2025-12-05 06:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2652071-4008559-1000.jpg') HTTP/1.1" 204 0
2025-12-05 06:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2652071-4008559-1000.jpg saved to cache
2025-12-05 06:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02
2025-12-05 06:10:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:10:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:10:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:10:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234237d810>
2025-12-05 06:10:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:10:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:10:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:10:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:10:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:10:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:10:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02/e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02_image_15.jpg HTTP/1.1" 201 0
2025-12-05 06:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2652071-4008559-1001.jpg') HTTP/1.1" 204 0
2025-12-05 06:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2652071-4008559-1001.jpg saved to cache
2025-12-05 06:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02
2025-12-05 06:10:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:10:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:10:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:10:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2341f24450>
2025-12-05 06:10:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:10:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:10:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 06:10:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:10:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:10:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:10:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02/e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02_image_16.jpg HTTP/1.1" 201 0
2025-12-05 06:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2652071-4008559-1002.jpg') HTTP/1.1" 204 0
2025-12-05 06:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2652071-4008559-1002.jpg saved to cache
2025-12-05 06:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02
2025-12-05 06:10:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:10:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:10:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:10:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234253ee10>
2025-12-05 06:10:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:10:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:10:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 06:10:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:10:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:10:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:10:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02/e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02_image_19.jpg HTTP/1.1" 201 0
2025-12-05 06:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2652071-4008559-1005.jpg') HTTP/1.1" 204 0
2025-12-05 06:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2652071-4008559-1005.jpg saved to cache
2025-12-05 06:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02
2025-12-05 06:10:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:10:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:10:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:10:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f234285e350>
2025-12-05 06:10:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:10:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:10:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 06:10:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:10:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:10:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:10:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_458c7121-91e1-5e41-b4a5-065576fc4c04/458c7121-91e1-5e41-b4a5-065576fc4c04_image_16.jpg HTTP/1.1" 201 0
2025-12-05 06:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2585181-4008021-1002.jpg') HTTP/1.1" 204 0
2025-12-05 06:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2585181-4008021-1002.jpg saved to cache
2025-12-05 06:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 458c7121-91e1-5e41-b4a5-065576fc4c04
2025-12-05 06:10:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 458c7121-91e1-5e41-b4a5-065576fc4c04, skipping ID generation
2025-12-05 06:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 458c7121-91e1-5e41-b4a5-065576fc4c04 from tracking dictionaries
2025-12-05 06:10:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 458c7121-91e1-5e41-b4a5-065576fc4c04 sending to next pipeline
2025-12-05 06:10:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 458c7121-91e1-5e41-b4a5-065576fc4c04, identifier: 2585181
2025-12-05 06:10:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 458c7121-91e1-5e41-b4a5-065576fc4c04 with identifier: 2585181
2025-12-05 06:10:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 06:10:59 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=YELLOW HTTP/1.1" 200 None
2025-12-05 06:10:59 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 06:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 06:10:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 458c7121-91e1-5e41-b4a5-065576fc4c04 with identifier: 2585181
2025-12-05 06:10:59 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 458c7121-91e1-5e41-b4a5-065576fc4c04 with identifier: 2585181 to the API
2025-12-05 06:10:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 06:11:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 06:11:01 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/insp-0001-2585181-4008021-1002.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_458c7121-91e1-5e41-b4a5-065576fc4c04/458c7121-91e1-5e41-b4a5-065576fc4c04_expert_report_file_ab409b02-98ff-4a80-bd48-11cedbd720d9.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002585181-01992158-004.pdf',
 'color': 'YELLOW',
 'currency': 'GBP',
 'engine': '1.5L',
 'expiration_date': '2025-12-10T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '458c7121-91e1-5e41-b4a5-065576fc4c04',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'SP16NYM',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/NISSAN/JUKE?id=2585181',
 'listing': 'auction',
 'location': 'Plymouth',
 'make': 'NISSAN',
 'model': 'JUKE',
 'odometer': 88488,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 28,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_458c7121-91e1-5e41-b4a5-065576fc4c04/458c7121-91e1-5e41-b4a5-065576fc4c04_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 227872,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e936fc9c-6f44-4e08-8161-19d6479c24c5_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_458c7121-91e1-5e41-b4a5-065576fc4c04/458c7121-91e1-5e41-b4a5-065576fc4c04_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 227872,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e936fc9c-6f44-4e08-8161-19d6479c24c5_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_458c7121-91e1-5e41-b4a5-065576fc4c04/458c7121-91e1-5e41-b4a5-065576fc4c04_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 219284,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e936fc9c-6f44-4e08-8161-19d6479c24c5_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_458c7121-91e1-5e41-b4a5-065576fc4c04/458c7121-91e1-5e41-b4a5-065576fc4c04_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 250298,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e936fc9c-6f44-4e08-8161-19d6479c24c5_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_458c7121-91e1-5e41-b4a5-065576fc4c04/458c7121-91e1-5e41-b4a5-065576fc4c04_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 233326,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e936fc9c-6f44-4e08-8161-19d6479c24c5_5.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_458c7121-91e1-5e41-b4a5-065576fc4c04/458c7121-91e1-5e41-b4a5-065576fc4c04_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 228253,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e936fc9c-6f44-4e08-8161-19d6479c24c5_4.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_458c7121-91e1-5e41-b4a5-065576fc4c04/458c7121-91e1-5e41-b4a5-065576fc4c04_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 227223,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e936fc9c-6f44-4e08-8161-19d6479c24c5_11.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_458c7121-91e1-5e41-b4a5-065576fc4c04/458c7121-91e1-5e41-b4a5-065576fc4c04_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 217144,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e936fc9c-6f44-4e08-8161-19d6479c24c5_10.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_458c7121-91e1-5e41-b4a5-065576fc4c04/458c7121-91e1-5e41-b4a5-065576fc4c04_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 227559,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e936fc9c-6f44-4e08-8161-19d6479c24c5_9.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_458c7121-91e1-5e41-b4a5-065576fc4c04/458c7121-91e1-5e41-b4a5-065576fc4c04_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 270212,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e936fc9c-6f44-4e08-8161-19d6479c24c5_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_458c7121-91e1-5e41-b4a5-065576fc4c04/458c7121-91e1-5e41-b4a5-065576fc4c04_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 197028,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e936fc9c-6f44-4e08-8161-19d6479c24c5_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_458c7121-91e1-5e41-b4a5-065576fc4c04/458c7121-91e1-5e41-b4a5-065576fc4c04_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 192154,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e936fc9c-6f44-4e08-8161-19d6479c24c5_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_458c7121-91e1-5e41-b4a5-065576fc4c04/458c7121-91e1-5e41-b4a5-065576fc4c04_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 271772,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e936fc9c-6f44-4e08-8161-19d6479c24c5_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_458c7121-91e1-5e41-b4a5-065576fc4c04/458c7121-91e1-5e41-b4a5-065576fc4c04_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 268773,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2585181-4008021-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_458c7121-91e1-5e41-b4a5-065576fc4c04/458c7121-91e1-5e41-b4a5-065576fc4c04_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 225403,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2585181-4008021-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_458c7121-91e1-5e41-b4a5-065576fc4c04/458c7121-91e1-5e41-b4a5-065576fc4c04_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 378656,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2585181-4008021-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_458c7121-91e1-5e41-b4a5-065576fc4c04/458c7121-91e1-5e41-b4a5-065576fc4c04_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 137829,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2585181-4008021-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_458c7121-91e1-5e41-b4a5-065576fc4c04/458c7121-91e1-5e41-b4a5-065576fc4c04_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 151754,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2585181-4008021-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_458c7121-91e1-5e41-b4a5-065576fc4c04/458c7121-91e1-5e41-b4a5-065576fc4c04_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121549,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2585181-4008021-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_458c7121-91e1-5e41-b4a5-065576fc4c04/458c7121-91e1-5e41-b4a5-065576fc4c04_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121824,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2585181-4008021-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-31',
 'seller_name': 'Vospers Group',
 'title': 'NISSAN JUKE 1.5 dCi N-Connecta 5dr',
 'transmission': 'manual',
 'trim': '1.5 dCi N-Connecta 5dr',
 'year': 2016}
2025-12-05 06:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272585181%27 HTTP/1.1" 200 None
2025-12-05 06:11:01 [manheim.gb] INFO: Saving data for 2585181: {'created_time': 1764915061.479036, 'last_price_update_time': 1764915061.479049, 'auction_closing_time': 1765357200.0}
2025-12-05 06:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2585181') HTTP/1.1" 204 0
2025-12-05 06:11:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:11:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:11:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:11:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2342604610>
2025-12-05 06:11:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:11:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:11:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 06:11:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:11:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:11:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:11:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02/e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02_image_13.jpg HTTP/1.1" 201 0
2025-12-05 06:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2652071-4008559-13.jpg') HTTP/1.1" 204 0
2025-12-05 06:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2652071-4008559-13.jpg saved to cache
2025-12-05 06:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02
2025-12-05 06:11:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 06:11:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 06:11:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 06:11:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f23424af2d0>
2025-12-05 06:11:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 06:11:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 06:11:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 06:11:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 06:11:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 06:11:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 06:11:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02/e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02_image_18.jpg HTTP/1.1" 201 0
2025-12-05 06:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2652071-4008559-1004.jpg') HTTP/1.1" 204 0
2025-12-05 06:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2652071-4008559-1004.jpg saved to cache
2025-12-05 06:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02
2025-12-05 06:11:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02, skipping ID generation
2025-12-05 06:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02 from tracking dictionaries
2025-12-05 06:11:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02 sending to next pipeline
2025-12-05 06:11:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02, identifier: 2652071
2025-12-05 06:11:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02 with identifier: 2652071
2025-12-05 06:11:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02 with identifier: 2652071
2025-12-05 06:11:02 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02 with identifier: 2652071 to the API
2025-12-05 06:11:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 06:11:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 06:11:02 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/insp-0001-2652071-4008559-1004.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02/e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02_expert_report_file_50ace9bc-343b-4e7e-84f7-2fa7eefbdacf.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002652071-01990412-002.pdf',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'HW68GZJ',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/CITROEN/C1?id=2652071',
 'listing': 'auction',
 'location': 'Bristol',
 'make': 'CITROEN',
 'model': 'C1',
 'odometer': 15624,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 26,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02/e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 211936,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f9a6af01-2d95-41b5-a961-09f86495ccd0_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02/e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 211936,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f9a6af01-2d95-41b5-a961-09f86495ccd0_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02/e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 238123,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f9a6af01-2d95-41b5-a961-09f86495ccd0_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02/e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 161926,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f9a6af01-2d95-41b5-a961-09f86495ccd0_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02/e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 221166,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f9a6af01-2d95-41b5-a961-09f86495ccd0_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02/e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 206674,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f9a6af01-2d95-41b5-a961-09f86495ccd0_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02/e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 203642,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f9a6af01-2d95-41b5-a961-09f86495ccd0_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02/e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 222502,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f9a6af01-2d95-41b5-a961-09f86495ccd0_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02/e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 219693,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f9a6af01-2d95-41b5-a961-09f86495ccd0_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02/e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 231803,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f9a6af01-2d95-41b5-a961-09f86495ccd0_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02/e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 169431,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f9a6af01-2d95-41b5-a961-09f86495ccd0_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02/e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 145167,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f9a6af01-2d95-41b5-a961-09f86495ccd0_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02/e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 189658,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f9a6af01-2d95-41b5-a961-09f86495ccd0_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02/e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 280123,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2652071-4008559-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02/e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 143841,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2652071-4008559-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02/e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 159349,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2652071-4008559-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02/e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 166802,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2652071-4008559-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02/e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 152760,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2652071-4008559-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02/e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 341069,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2652071-4008559-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02/e36a5ebf-c5e4-5d91-8a08-b5e1b1f33f02_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 181118,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2652071-4008559-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-28',
 'seller_name': 'Hendy Group',
 'title': 'CITROEN C1 1.2 PureTech Feel 5dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech Feel 5dr',
 'year': 2018}
2025-12-05 06:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272652071%27 HTTP/1.1" 200 None
2025-12-05 06:11:02 [manheim.gb] INFO: Saving data for 2652071: {'created_time': 1764915062.67937, 'last_price_update_time': 1764915062.679384, 'auction_closing_time': 1765184400.0}
2025-12-05 06:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2652071') HTTP/1.1" 204 0
2025-12-05 06:11:02 [scrapy.core.engine] INFO: Closing spider (finished)
2025-12-05 06:11:02 [manheim.gb] INFO: manheim.gb Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0}
2025-12-05 06:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273834095%27 HTTP/1.1" 200 None
2025-12-05 06:11:02 [manheim.gb] INFO: Saving data for 3834095: {'created_time': 1764915062.840413}
2025-12-05 06:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3834095') HTTP/1.1" 204 0
2025-12-05 06:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273747146%27 HTTP/1.1" 200 None
2025-12-05 06:11:02 [manheim.gb] INFO: Saving data for 3747146: {'created_time': 1764915062.872822}
2025-12-05 06:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3747146') HTTP/1.1" 204 0
2025-12-05 06:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 06:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20last_price_update_time%20lt%201764483062 HTTP/1.1" 200 None
2025-12-05 06:11:03 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (75 items) in: file:///var/lib/scrapyd/items/sourcing_v2/manheim.gb/task_37_2025-12-05T06_00_02.jl
2025-12-05 06:11:03 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 1402211,
 'downloader/request_count': 1021,
 'downloader/request_method_count/GET': 1017,
 'downloader/request_method_count/POST': 4,
 'downloader/response_bytes': 406331752,
 'downloader/response_count': 1021,
 'downloader/response_status_count/200': 1020,
 'downloader/response_status_count/404': 1,
 'elapsed_time_seconds': 633.185328,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2025, 12, 5, 6, 11, 2, 999851, tzinfo=datetime.timezone.utc),
 'item_dropped_count': 59,
 'item_dropped_reasons_count/DropItem': 59,
 'item_scraped_count': 75,
 'log_count/DEBUG': 11021,
 'log_count/ERROR': 11,
 'log_count/INFO': 9959,
 'memusage/max': 211808256,
 'memusage/startup': 127287296,
 'photo_download_count': 828,
 'playwright/context_count': 1,
 'playwright/context_count/max_concurrent': 1,
 'playwright/context_count/persistent/False': 1,
 'playwright/context_count/remote/False': 1,
 'playwright/page_count': 1,
 'playwright/page_count/max_concurrent': 1,
 'playwright/request_count': 86,
 'playwright/request_count/aborted': 46,
 'playwright/request_count/method/GET': 83,
 'playwright/request_count/method/POST': 3,
 'playwright/request_count/navigation': 4,
 'playwright/request_count/resource_type/document': 4,
 'playwright/request_count/resource_type/font': 8,
 'playwright/request_count/resource_type/image': 40,
 'playwright/request_count/resource_type/script': 24,
 'playwright/request_count/resource_type/stylesheet': 8,
 'playwright/request_count/resource_type/xhr': 2,
 'playwright/response_count': 40,
 'playwright/response_count/method/GET': 37,
 'playwright/response_count/method/POST': 3,
 'playwright/response_count/resource_type/document': 4,
 'playwright/response_count/resource_type/font': 8,
 'playwright/response_count/resource_type/script': 18,
 'playwright/response_count/resource_type/stylesheet': 8,
 'playwright/response_count/resource_type/xhr': 2,
 'request_depth_max': 7,
 'response_received_count': 193,
 'scheduler/dequeued': 1021,
 'scheduler/dequeued/memory': 1021,
 'scheduler/enqueued': 1021,
 'scheduler/enqueued/memory': 1021,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 139,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 30.063955343673484,
 'scrapy-zyte-api/mean_response_seconds': 30.2909631647719,
 'scrapy-zyte-api/processed': 139,
 'scrapy-zyte-api/request_args/actions': 135,
 'scrapy-zyte-api/request_args/browserHtml': 135,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 4,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 139,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 139,
 'scrapy-zyte-api/request_args/httpRequestBody': 4,
 'scrapy-zyte-api/request_args/httpRequestMethod': 4,
 'scrapy-zyte-api/request_args/httpResponseBody': 4,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 4,
 'scrapy-zyte-api/request_args/requestHeaders': 135,
 'scrapy-zyte-api/request_args/sessionContext': 135,
 'scrapy-zyte-api/request_args/url': 139,
 'scrapy-zyte-api/status_codes/200': 139,
 'scrapy-zyte-api/success': 139,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'spider_exceptions/HttpError': 1,
 'spider_exceptions/ValueError': 1,
 'start_time': datetime.datetime(2025, 12, 5, 6, 0, 29, 814523, tzinfo=datetime.timezone.utc)}
2025-12-05 06:11:03 [scrapy.core.engine] INFO: Spider closed (finished)