2025-12-03 06:00:20 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2025-12-03 06:00:20 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2025-12-03 06:00:20 [manheim.gb] INFO: Starting spider manheim.gb
2025-12-03 06:00:20 [scrapy.addons] INFO: Enabled addons:
[]
2025-12-03 06:00:20 [asyncio] DEBUG: Using selector: EpollSelector
2025-12-03 06:00:20 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2025-12-03 06:00:20 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2025-12-03 06:00:20 [scrapy.extensions.telnet] INFO: Telnet Password: 763960ce6bf999f7
2025-12-03 06:00:20 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2025-12-03 06:00:20 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/manheim.gb/task_37_2025-12-03T06_00_02.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2025-12-03 06:00:20 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2025-12-03 06:00:20 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2025-12-03 06:00:20 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2025-12-03 06:00:20 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2025-12-03 06:00:20 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2025-12-03 06:00:20 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2025-12-03 06:00:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:00:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:00:20 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2025-12-03 06:00:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2025-12-03 06:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:00:20 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2025-12-03 06:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2025-12-03 06:00:20 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2025-12-03 06:00:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: low_mileage_for_country.json
2025-12-03 06:00:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage.json
2025-12-03 06:00:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2025-12-03 06:00:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2025-12-03 06:00:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2025-12-03 06:00:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2025-12-03 06:00:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2025-12-03 06:00:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2025-12-03 06:00:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2025-12-03 06:00:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2025-12-03 06:00:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: cars_too_new_for_country.json
2025-12-03 06:00:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_price_for_currency.json
2025-12-03 06:00:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2025-12-03 06:00:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2025-12-03 06:00:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2025-12-03 06:00:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2025-12-03 06:00:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage_for_country.json
2025-12-03 06:00:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2025-12-03 06:00:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2025-12-03 06:00:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2025-12-03 06:00:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2025-12-03 06:00:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2025-12-03 06:00:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: registration_date_old.json
2025-12-03 06:00:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage_for_make.json
2025-12-03 06:00:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2025-12-03 06:00:20 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2025-12-03 06:00:20 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2025-12-03 06:00:20 [scrapy.core.engine] INFO: Spider opened
2025-12-03 06:00:20 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2025-12-03 06:00:20 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6025
2025-12-03 06:00:20 [scrapy-playwright] INFO: Starting download handler
2025-12-03 06:00:20 [scrapy-playwright] INFO: Starting download handler
2025-12-03 06:00:25 [scrapy-playwright] INFO: Launching browser firefox
2025-12-03 06:00:26 [scrapy-playwright] INFO: Browser firefox launched
2025-12-03 06:00:26 [scrapy-playwright] DEBUG: Browser context started: 'default' (persistent=False, remote=False)
2025-12-03 06:00:28 [scrapy-playwright] DEBUG: [Context=default] New page created, page count is 1 (1 for all contexts)
2025-12-03 06:00:28 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/> (resource type: document)
2025-12-03 06:00:29 [scrapy-playwright] DEBUG: [Context=default] Response: <407 https://www.manheim.co.uk/>
2025-12-03 06:00:29 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/> (resource type: document)
2025-12-03 06:00:30 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/>
2025-12-03 06:00:30 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/bundle?v=HcGNblHj64wK-Istb_0SemQAL-rwtK13kDPW8q3LCIo1> (resource type: stylesheet, referrer: https://www.manheim.co.uk/)
2025-12-03 06:00:30 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/bundles/delete/scripts/homepage?v=CIpuZXIp0V7i0j1sjTB9sUemSg9-D9w8k891UP0sReI1> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-03 06:00:30 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/top_navigationlogo.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-03 06:00:30 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/top_navigationlogo.ashx?la=en>
2025-12-03 06:00:30 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/homepage_new.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-03 06:00:30 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/homepage_new.ashx?la=en>
2025-12-03 06:00:30 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/auction-centre-pages/auction-centre-c114-treated--hero.ashx?la=en&mw=960> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-03 06:00:30 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/auction-centre-pages/auction-centre-c114-treated--hero.ashx?la=en&mw=960>
2025-12-03 06:00:30 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/new-website-images-2021/vehicle-solutions/vs-3.ashx?la=en&mw=960> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-03 06:00:30 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/new-website-images-2021/vehicle-solutions/vs-3.ashx?la=en&mw=960>
2025-12-03 06:00:30 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/inspections-and-collections/inspections-and-collections-b87-treated---hero.ashx?la=en&mw=960> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-03 06:00:30 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/inspections-and-collections/inspections-and-collections-b87-treated---hero.ashx?la=en&mw=960>
2025-12-03 06:00:30 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimvehiclesearchpage2.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-03 06:00:30 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimvehiclesearchpage2.ashx?la=en>
2025-12-03 06:00:30 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/Scripts/Manheim/tellnumberchange.js> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-03 06:00:30 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/Scripts/Manheim/RemoveSignUpBanner.js> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-03 06:00:30 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/bundle?v=HcGNblHj64wK-Istb_0SemQAL-rwtK13kDPW8q3LCIo1>
2025-12-03 06:00:30 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/jquery-ui-1.13.2.min.css> (resource type: stylesheet, referrer: https://www.manheim.co.uk/assets/css/bundle?v=HcGNblHj64wK-Istb_0SemQAL-rwtK13kDPW8q3LCIo1)
2025-12-03 06:00:30 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/core-blessed1.min.css> (resource type: stylesheet, referrer: https://www.manheim.co.uk/assets/css/bundle?v=HcGNblHj64wK-Istb_0SemQAL-rwtK13kDPW8q3LCIo1)
2025-12-03 06:00:30 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/Scripts/Manheim/tellnumberchange.js>
2025-12-03 06:00:30 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/Scripts/Manheim/RemoveSignUpBanner.js>
2025-12-03 06:00:30 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/jquery-ui-1.13.2.min.css>
2025-12-03 06:00:30 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/core-blessed1.min.css>
2025-12-03 06:00:30 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/bundles/delete/scripts/homepage?v=CIpuZXIp0V7i0j1sjTB9sUemSg9-D9w8k891UP0sReI1>
2025-12-03 06:00:31 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Light.woff> (resource type: font, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-03 06:00:31 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.googletagmanager.com/gtm.js?id=GTM-KZS96H> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-03 06:00:31 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.googletagmanager.com/gtm.js?id=GTM-KZS96H>
2025-12-03 06:00:31 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/top_navigationlogo.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-03 06:00:31 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/top_navigationlogo.ashx?la=en>
2025-12-03 06:00:31 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/homepage_new.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-03 06:00:31 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/homepage_new.ashx?la=en>
2025-12-03 06:00:31 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/auction-centre-pages/auction-centre-c114-treated--hero.ashx?la=en&mw=960> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-03 06:00:31 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/auction-centre-pages/auction-centre-c114-treated--hero.ashx?la=en&mw=960>
2025-12-03 06:00:31 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/new-website-images-2021/vehicle-solutions/vs-3.ashx?la=en&mw=960> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-03 06:00:31 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/new-website-images-2021/vehicle-solutions/vs-3.ashx?la=en&mw=960>
2025-12-03 06:00:31 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/inspections-and-collections/inspections-and-collections-b87-treated---hero.ashx?la=en&mw=960> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-03 06:00:31 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/inspections-and-collections/inspections-and-collections-b87-treated---hero.ashx?la=en&mw=960>
2025-12-03 06:00:31 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimvehiclesearchpage2.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-03 06:00:31 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimvehiclesearchpage2.ashx?la=en>
2025-12-03 06:00:31 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/images/filters/dot_pattern.png> (resource type: image, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-03 06:00:31 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/assets/images/filters/dot_pattern.png>
2025-12-03 06:00:31 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/images/branding/dropdown.png> (resource type: image, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-03 06:00:31 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/assets/images/branding/dropdown.png>
2025-12-03 06:00:31 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Regular.woff> (resource type: font, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-03 06:00:31 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Bold.woff> (resource type: font, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-03 06:00:31 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/fonts/Manheim-Icons/Manheim-Icons.woff> (resource type: font, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-03 06:00:31 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://www.manheim.co.uk/Account/IsCookieExist> (resource type: xhr, referrer: https://www.manheim.co.uk/)
2025-12-03 06:00:31 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/buying-options/buying-options-c153-treated--hero.ashx?la=en&mw=1920> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-03 06:00:31 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/buying-options/buying-options-c153-treated--hero.ashx?la=en&mw=1920>
2025-12-03 06:00:31 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/manheimcolchester10.ashx?la=en&mw=1920> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-03 06:00:31 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/manheimcolchester10.ashx?la=en&mw=1920>
2025-12-03 06:00:31 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/auction-centre-pages/auction-centre-8665-treated--hero.ashx?la=en&mw=1920> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-03 06:00:31 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/auction-centre-pages/auction-centre-8665-treated--hero.ashx?la=en&mw=1920>
2025-12-03 06:00:31 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Light.woff>
2025-12-03 06:00:31 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Regular.woff>
2025-12-03 06:00:31 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Bold.woff>
2025-12-03 06:00:31 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/fonts/Manheim-Icons/Manheim-Icons.woff>
2025-12-03 06:00:31 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/Account/IsCookieExist>
2025-12-03 06:00:31 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://js-agent.newrelic.com/nr-spa-1.303.0.min.js> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-03 06:00:31 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://js-agent.newrelic.com/nr-spa-1.303.0.min.js>
2025-12-03 06:00:31 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://pi.pardot.com/pd.js> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-03 06:00:31 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://js-agent.newrelic.com/nr-spa-1.303.0.min.js> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-03 06:00:31 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://js-agent.newrelic.com/nr-spa-1.303.0.min.js>
2025-12-03 06:00:33 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://pi.pardot.com/pd.js>
2025-12-03 06:00:33 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://pi.pardot.com/analytics?ver=3&visitor_id=&visitor_id_sign=&pi_opt_in=&campaign_id=24684&account_id=38592&title=Manheim%20%7C%20Auctions%2C%20Vehicle%20Solutions%20%26%20Remarketing&url=https%3A%2F%2Fwww.manheim.co.uk%2F&referrer=> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-03 06:00:33 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://pi.pardot.com/analytics?ver=3&visitor_id=&visitor_id_sign=&pi_opt_in=&campaign_id=24684&account_id=38592&title=Manheim%20%7C%20Auctions%2C%20Vehicle%20Solutions%20%26%20Remarketing&url=https%3A%2F%2Fwww.manheim.co.uk%2F&referrer=>
2025-12-03 06:00:33 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://brands.coxauto.co.uk/analytics?conly=true&visitor_id=918650046&visitor_id_sign=70cbfbec7b0d60b68f2f57d86c6e387a514ae6f3d73c0e388ccf539ae9424ecd3dead26ec79b03b8029578aea175ea1fd7acd294&pi_opt_in=&campaign_id=24684&account_id=38592&title=Manheim%20%7C%20Auctions%2C%20Vehicle%20Solutions%20%26%20Remarketing&url=https%3A%2F%2Fwww.manheim.co.uk%2F&referrer=> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-03 06:00:35 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://brands.coxauto.co.uk/analytics?conly=true&visitor_id=918650046&visitor_id_sign=70cbfbec7b0d60b68f2f57d86c6e387a514ae6f3d73c0e388ccf539ae9424ecd3dead26ec79b03b8029578aea175ea1fd7acd294&pi_opt_in=&campaign_id=24684&account_id=38592&title=Manheim%20%7C%20Auctions%2C%20Vehicle%20Solutions%20%26%20Remarketing&url=https%3A%2F%2Fwww.manheim.co.uk%2F&referrer=>
2025-12-03 06:00:42 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://www.manheim.co.uk/account/login> (resource type: document, referrer: https://www.manheim.co.uk/)
2025-12-03 06:00:42 [scrapy-playwright] DEBUG: [Context=default] Response: <302 https://www.manheim.co.uk/account/login> (location: /mymanheim/dashboard)
2025-12-03 06:00:42 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/mymanheim/dashboard> (resource type: document, referrer: https://www.manheim.co.uk/)
2025-12-03 06:00:44 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/mymanheim/dashboard>
2025-12-03 06:00:44 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/bundle?v=HcGNblHj64wK-Istb_0SemQAL-rwtK13kDPW8q3LCIo1> (resource type: stylesheet, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-03 06:00:44 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/bundles/delete/scripts/postlogin?v=Bwe963dGqUB3Sdny8E3tKSL2gV9GDgLwX1g6Gq6KF-A1> (resource type: script, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-03 06:00:44 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/SignalR/Hubs> (resource type: script, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-03 06:00:44 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimwhitecoxautomotive3.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-03 06:00:44 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimwhitecoxautomotive3.ashx?la=en>
2025-12-03 06:00:44 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/Scripts/jquery-ui-1.12.1.js> (resource type: script, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-03 06:00:44 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/Content/myManheim.css> (resource type: stylesheet, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-03 06:00:44 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/bundles/simulcast?v=P7s0oLmuXc3p3WQNs8URnZ4NaK3K6qkWLOwf0uOs5gw1> (resource type: script, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-03 06:00:44 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/Content/dashboards.css> (resource type: stylesheet, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-03 06:00:44 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/new-manheim-booking.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-03 06:00:44 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/new-manheim-booking.ashx?la=en>
2025-12-03 06:00:44 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/blog/2025/gavel_2025.ashx?h=176&la=en&w=210&crop=1> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-03 06:00:44 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/img_6251.ashx?h=176&la=en&w=210&crop=1> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-03 06:00:44 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/blog/2025/gavel_2025.ashx?h=176&la=en&w=210&crop=1>
2025-12-03 06:00:44 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/movex/payg1.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-03 06:00:44 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/img_6251.ashx?h=176&la=en&w=210&crop=1>
2025-12-03 06:00:44 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/v3--design11918banner535x191px-(1).ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-03 06:00:44 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/movex/payg1.ashx?la=en>
2025-12-03 06:00:44 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/v3--design11918banner535x191px-(1).ashx?la=en>
2025-12-03 06:00:44 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/campaigns/nama/nama-lcv-location-banner.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-03 06:00:44 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/campaigns/nama/nama-lcv-location-banner.ashx?la=en>
2025-12-03 06:00:44 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/movex/why_pay_more.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-03 06:00:44 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/banners-and-adverts/products-services/simulcast_banner.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-03 06:00:44 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/movex/why_pay_more.ashx?la=en>
2025-12-03 06:00:44 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimlogofooter2.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-03 06:00:44 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/banners-and-adverts/products-services/simulcast_banner.ashx?la=en>
2025-12-03 06:00:44 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimvehiclesearchpage2.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-03 06:00:44 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimlogofooter2.ashx?la=en>
2025-12-03 06:00:44 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/Scripts/Manheim/tellnumberchange.js> (resource type: script, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-03 06:00:44 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/Scripts/Manheim/RemoveSignUpBanner.js> (resource type: script, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-03 06:00:44 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimvehiclesearchpage2.ashx?la=en>
2025-12-03 06:00:44 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/bundle?v=HcGNblHj64wK-Istb_0SemQAL-rwtK13kDPW8q3LCIo1>
2025-12-03 06:00:44 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/SignalR/Hubs>
2025-12-03 06:00:44 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/jquery-ui-1.13.2.min.css> (resource type: stylesheet, referrer: https://www.manheim.co.uk/assets/css/bundle?v=HcGNblHj64wK-Istb_0SemQAL-rwtK13kDPW8q3LCIo1)
2025-12-03 06:00:44 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/core-blessed1.min.css> (resource type: stylesheet, referrer: https://www.manheim.co.uk/assets/css/bundle?v=HcGNblHj64wK-Istb_0SemQAL-rwtK13kDPW8q3LCIo1)
2025-12-03 06:00:44 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/bundles/delete/scripts/postlogin?v=Bwe963dGqUB3Sdny8E3tKSL2gV9GDgLwX1g6Gq6KF-A1>
2025-12-03 06:00:47 [scrapy-playwright] DEBUG: [Context=default] Response: <302 https://www.manheim.co.uk/Scripts/jquery-ui-1.12.1.js> (location: https://www.manheim.co.uk/404)
2025-12-03 06:00:47 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/Content/myManheim.css>
2025-12-03 06:00:47 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/Content/dashboards.css>
2025-12-03 06:00:47 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/404> (resource type: script, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-03 06:00:47 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/bundles/simulcast?v=P7s0oLmuXc3p3WQNs8URnZ4NaK3K6qkWLOwf0uOs5gw1>
2025-12-03 06:00:47 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/Scripts/Manheim/tellnumberchange.js>
2025-12-03 06:00:47 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/Scripts/Manheim/RemoveSignUpBanner.js>
2025-12-03 06:00:47 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/jquery-ui-1.13.2.min.css>
2025-12-03 06:00:47 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/core-blessed1.min.css>
2025-12-03 06:00:47 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Light.woff> (resource type: font, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-03 06:00:47 [scrapy-playwright] DEBUG: [Context=default] Response: <404 https://www.manheim.co.uk/404>
2025-12-03 06:00:48 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimwhitecoxautomotive3.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-03 06:00:48 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimwhitecoxautomotive3.ashx?la=en>
2025-12-03 06:00:48 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Regular.woff> (resource type: font, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-03 06:00:48 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/fonts/Manheim-Icons/Manheim-Icons.woff> (resource type: font, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-03 06:00:48 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/new-manheim-booking.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-03 06:00:48 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/new-manheim-booking.ashx?la=en>
2025-12-03 06:00:48 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/blog/2025/gavel_2025.ashx?h=176&la=en&w=210&crop=1> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-03 06:00:48 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/blog/2025/gavel_2025.ashx?h=176&la=en&w=210&crop=1>
2025-12-03 06:00:48 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/img_6251.ashx?h=176&la=en&w=210&crop=1> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-03 06:00:48 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/img_6251.ashx?h=176&la=en&w=210&crop=1>
2025-12-03 06:00:48 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/movex/payg1.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-03 06:00:48 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/movex/payg1.ashx?la=en>
2025-12-03 06:00:48 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/v3--design11918banner535x191px-(1).ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-03 06:00:48 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/v3--design11918banner535x191px-(1).ashx?la=en>
2025-12-03 06:00:48 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/campaigns/nama/nama-lcv-location-banner.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-03 06:00:48 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/campaigns/nama/nama-lcv-location-banner.ashx?la=en>
2025-12-03 06:00:48 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/movex/why_pay_more.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-03 06:00:48 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/movex/why_pay_more.ashx?la=en>
2025-12-03 06:00:48 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/banners-and-adverts/products-services/simulcast_banner.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-03 06:00:48 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/banners-and-adverts/products-services/simulcast_banner.ashx?la=en>
2025-12-03 06:00:48 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimlogofooter2.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-03 06:00:48 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimlogofooter2.ashx?la=en>
2025-12-03 06:00:48 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimvehiclesearchpage2.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-03 06:00:48 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimvehiclesearchpage2.ashx?la=en>
2025-12-03 06:00:48 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/images/branding/dropdown.png> (resource type: image, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-03 06:00:48 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/assets/images/branding/dropdown.png>
2025-12-03 06:00:48 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Bold.woff> (resource type: font, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-03 06:00:48 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/images/thickbox/loadingAnimation.gif> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-03 06:00:48 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/assets/images/thickbox/loadingAnimation.gif>
2025-12-03 06:00:48 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://www.manheim.co.uk/Account/IsCookieExist> (resource type: xhr, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-03 06:00:48 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.googletagmanager.com/gtm.js?id=GTM-KZS96H> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-03 06:00:48 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.googletagmanager.com/gtm.js?id=GTM-KZS96H>
2025-12-03 06:00:48 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Light.woff>
2025-12-03 06:00:48 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Regular.woff>
2025-12-03 06:00:48 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/fonts/Manheim-Icons/Manheim-Icons.woff>
2025-12-03 06:00:48 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Bold.woff>
2025-12-03 06:00:48 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/Account/IsCookieExist>
2025-12-03 06:00:48 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://js-agent.newrelic.com/nr-spa-1.303.0.min.js> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-03 06:00:48 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://js-agent.newrelic.com/nr-spa-1.303.0.min.js>
2025-12-03 06:00:48 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://pi.pardot.com/pd.js> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-03 06:00:49 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://js-agent.newrelic.com/nr-spa-1.303.0.min.js> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-03 06:00:49 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://js-agent.newrelic.com/nr-spa-1.303.0.min.js>
2025-12-03 06:00:49 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://pi.pardot.com/pd.js>
2025-12-03 06:00:49 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://pi.pardot.com/analytics?ver=3&visitor_id=918650046&visitor_id_sign=70cbfbec7b0d60b68f2f57d86c6e387a514ae6f3d73c0e388ccf539ae9424ecd3dead26ec79b03b8029578aea175ea1fd7acd294&pi_opt_in=&campaign_id=24684&account_id=38592&title=Dashboard%20%7C%20Manheim&url=https%3A%2F%2Fwww.manheim.co.uk%2Fmymanheim%2Fdashboard&referrer=https%3A%2F%2Fwww.manheim.co.uk%2F> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-03 06:00:49 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://pi.pardot.com/analytics?ver=3&visitor_id=918650046&visitor_id_sign=70cbfbec7b0d60b68f2f57d86c6e387a514ae6f3d73c0e388ccf539ae9424ecd3dead26ec79b03b8029578aea175ea1fd7acd294&pi_opt_in=&campaign_id=24684&account_id=38592&title=Dashboard%20%7C%20Manheim&url=https%3A%2F%2Fwww.manheim.co.uk%2Fmymanheim%2Fdashboard&referrer=https%3A%2F%2Fwww.manheim.co.uk%2F>
2025-12-03 06:00:49 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://brands.coxauto.co.uk/analytics?conly=true&visitor_id=918650046&visitor_id_sign=70cbfbec7b0d60b68f2f57d86c6e387a514ae6f3d73c0e388ccf539ae9424ecd3dead26ec79b03b8029578aea175ea1fd7acd294&pi_opt_in=&campaign_id=24684&account_id=38592&title=Dashboard%20%7C%20Manheim&url=https%3A%2F%2Fwww.manheim.co.uk%2Fmymanheim%2Fdashboard&referrer=https%3A%2F%2Fwww.manheim.co.uk%2F> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-03 06:00:51 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://brands.coxauto.co.uk/analytics?conly=true&visitor_id=918650046&visitor_id_sign=70cbfbec7b0d60b68f2f57d86c6e387a514ae6f3d73c0e388ccf539ae9424ecd3dead26ec79b03b8029578aea175ea1fd7acd294&pi_opt_in=&campaign_id=24684&account_id=38592&title=Dashboard%20%7C%20Manheim&url=https%3A%2F%2Fwww.manheim.co.uk%2Fmymanheim%2Fdashboard&referrer=https%3A%2F%2Fwww.manheim.co.uk%2F>
2025-12-03 06:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk> (referer: None) ['playwright']
2025-12-03 06:00:54 [manheim.gb] INFO: Cookies from Playwright: [{'name': 'ASP.NET_SessionId', 'value': 'un2iah34uxy2yo52bqtkexvi', 'domain': 'www.manheim.co.uk', 'path': '/', 'expires': -1, 'httpOnly': True, 'secure': True, 'sameSite': 'Lax'}, {'name': '__RequestVerificationToken', 'value': 'DUS3IPc1ClWg8iCTIrSGqmoLPJHyQN2yRZuz5B8UCZdj30kFrEWYjVcZYJ_YBIiETGvaU0anX_8IjiJJhbAl-k4or7Q1', 'domain': 'www.manheim.co.uk', 'path': '/', 'expires': -1, 'httpOnly': True, 'secure': True, 'sameSite': 'None'}, {'name': 'cb-enabled', 'value': 'enabled', 'domain': 'www.manheim.co.uk', 'path': '/', 'expires': 1796277631, 'httpOnly': False, 'secure': False, 'sameSite': 'None'}, {'name': 'remarketing-web', 'value': '364C629233C38FB47FFFFB9D057DC1A4C2BE049CB5BD59C14C6F8D5B2236CA19EFA8E02576D2B5BB935D00885958F12251A9803BF07FB21CADDD6D3A93B77E0F7ECCCF9312B802BA66BE5CBF293F69065E59C3B8E7E799D1AF08E09DCACF3190622F84469717DCF0B4B325F377FB05B169F9410E', 'domain': 'www.manheim.co.uk', 'path': '/', 'expires': -1, 'httpOnly': True, 'secure': True, 'sameSite': 'None'}, {'name': 'visitor_id37592', 'value': '918650046', 'domain': 'www.manheim.co.uk', 'path': '/', 'expires': 1796277649, 'httpOnly': False, 'secure': False, 'sameSite': 'None'}, {'name': 'visitor_id37592-hash', 'value': '70cbfbec7b0d60b68f2f57d86c6e387a514ae6f3d73c0e388ccf539ae9424ecd3dead26ec79b03b8029578aea175ea1fd7acd294', 'domain': 'www.manheim.co.uk', 'path': '/', 'expires': 1796277649, 'httpOnly': False, 'secure': False, 'sameSite': 'None'}, {'name': 'visitor_id37592', 'value': '918650046', 'domain': 'brands.coxauto.co.uk', 'path': '/', 'expires': 1796277651, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}, {'name': 'visitor_id37592-hash', 'value': '70cbfbec7b0d60b68f2f57d86c6e387a514ae6f3d73c0e388ccf539ae9424ecd3dead26ec79b03b8029578aea175ea1fd7acd294', 'domain': 'brands.coxauto.co.uk', 'path': '/', 'expires': 1796277651, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}, {'name': 'visitor_id37592', 'value': '918650046', 'domain': '.pardot.com', 'path': '/', 'expires': 1796277649, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}, {'name': 'visitor_id37592-hash', 'value': '70cbfbec7b0d60b68f2f57d86c6e387a514ae6f3d73c0e388ccf539ae9424ecd3dead26ec79b03b8029578aea175ea1fd7acd294', 'domain': '.pardot.com', 'path': '/', 'expires': 1796277649, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}, {'name': 'lpv37592', 'value': 'aHR0cHM6Ly93d3cubWFuaGVpbS5jby51ay9teW1hbmhlaW0vZGFzaGJvYXJk', 'domain': 'pi.pardot.com', 'path': '/', 'expires': 1764743449, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}]
2025-12-03 06:00:54 [manheim.gb] INFO: Scrapy-formatted cookies: [{'name': 'ASP.NET_SessionId', 'value': 'un2iah34uxy2yo52bqtkexvi', 'domain': 'www.manheim.co.uk', 'path': '/'}, {'name': '__RequestVerificationToken', 'value': 'DUS3IPc1ClWg8iCTIrSGqmoLPJHyQN2yRZuz5B8UCZdj30kFrEWYjVcZYJ_YBIiETGvaU0anX_8IjiJJhbAl-k4or7Q1', 'domain': 'www.manheim.co.uk', 'path': '/'}, {'name': 'cb-enabled', 'value': 'enabled', 'domain': 'www.manheim.co.uk', 'path': '/'}, {'name': 'remarketing-web', 'value': '364C629233C38FB47FFFFB9D057DC1A4C2BE049CB5BD59C14C6F8D5B2236CA19EFA8E02576D2B5BB935D00885958F12251A9803BF07FB21CADDD6D3A93B77E0F7ECCCF9312B802BA66BE5CBF293F69065E59C3B8E7E799D1AF08E09DCACF3190622F84469717DCF0B4B325F377FB05B169F9410E', 'domain': 'www.manheim.co.uk', 'path': '/'}, {'name': 'visitor_id37592', 'value': '918650046', 'domain': 'www.manheim.co.uk', 'path': '/'}, {'name': 'visitor_id37592-hash', 'value': '70cbfbec7b0d60b68f2f57d86c6e387a514ae6f3d73c0e388ccf539ae9424ecd3dead26ec79b03b8029578aea175ea1fd7acd294', 'domain': 'www.manheim.co.uk', 'path': '/'}, {'name': 'visitor_id37592', 'value': '918650046', 'domain': 'brands.coxauto.co.uk', 'path': '/'}, {'name': 'visitor_id37592-hash', 'value': '70cbfbec7b0d60b68f2f57d86c6e387a514ae6f3d73c0e388ccf539ae9424ecd3dead26ec79b03b8029578aea175ea1fd7acd294', 'domain': 'brands.coxauto.co.uk', 'path': '/'}, {'name': 'visitor_id37592', 'value': '918650046', 'domain': '.pardot.com', 'path': '/'}, {'name': 'visitor_id37592-hash', 'value': '70cbfbec7b0d60b68f2f57d86c6e387a514ae6f3d73c0e388ccf539ae9424ecd3dead26ec79b03b8029578aea175ea1fd7acd294', 'domain': '.pardot.com', 'path': '/'}, {'name': 'lpv37592', 'value': 'aHR0cHM6Ly93d3cubWFuaGVpbS5jby51ay9teW1hbmhlaW0vZGFzaGJvYXJk', 'domain': 'pi.pardot.com', 'path': '/'}]
2025-12-03 06:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /SpiderData(PartitionKey='Manheim',RowKey='cookies') HTTP/1.1" 204 0
2025-12-03 06:00:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/refine> (referer: https://www.manheim.co.uk/search) ['zyte-api']
2025-12-03 06:00:56 [manheim.gb] INFO: Found listing with ID: 1019262
2025-12-03 06:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271019262%27 HTTP/1.1" 200 None
2025-12-03 06:00:56 [manheim.gb] INFO: Scrape type for 1019262: 2
2025-12-03 06:00:56 [manheim.gb] INFO: Found listing with ID: 1074269
2025-12-03 06:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271074269%27 HTTP/1.1" 200 None
2025-12-03 06:00:56 [manheim.gb] INFO: Scrape type for 1074269: 0
2025-12-03 06:00:56 [manheim.gb] INFO: Found listing with ID: 1078284
2025-12-03 06:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271078284%27 HTTP/1.1" 200 None
2025-12-03 06:00:56 [manheim.gb] INFO: Scrape type for 1078284: 0
2025-12-03 06:00:56 [manheim.gb] INFO: Found listing with ID: 1089633
2025-12-03 06:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271089633%27 HTTP/1.1" 200 None
2025-12-03 06:00:56 [manheim.gb] INFO: Scrape type for 1089633: 0
2025-12-03 06:00:56 [manheim.gb] INFO: Found listing with ID: 1101758
2025-12-03 06:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271101758%27 HTTP/1.1" 200 None
2025-12-03 06:00:56 [manheim.gb] INFO: Scrape type for 1101758: 1
2025-12-03 06:00:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:00:56 [manheim.gb] INFO: Found listing with ID: 1104811
2025-12-03 06:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271104811%27 HTTP/1.1" 200 None
2025-12-03 06:00:56 [manheim.gb] INFO: Scrape type for 1104811: 0
2025-12-03 06:00:56 [manheim.gb] INFO: Found listing with ID: 1153610
2025-12-03 06:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271153610%27 HTTP/1.1" 200 None
2025-12-03 06:00:56 [manheim.gb] INFO: Scrape type for 1153610: 0
2025-12-03 06:00:56 [manheim.gb] INFO: Found listing with ID: 1162585
2025-12-03 06:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271162585%27 HTTP/1.1" 200 None
2025-12-03 06:00:56 [manheim.gb] INFO: Scrape type for 1162585: 0
2025-12-03 06:00:56 [manheim.gb] INFO: Found listing with ID: 1173100
2025-12-03 06:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271173100%27 HTTP/1.1" 200 None
2025-12-03 06:00:56 [manheim.gb] INFO: Scrape type for 1173100: 0
2025-12-03 06:00:56 [manheim.gb] INFO: Found listing with ID: 1191100
2025-12-03 06:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271191100%27 HTTP/1.1" 200 None
2025-12-03 06:00:56 [manheim.gb] INFO: Scrape type for 1191100: 0
2025-12-03 06:00:56 [manheim.gb] INFO: Found listing with ID: 1195824
2025-12-03 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271195824%27 HTTP/1.1" 200 None
2025-12-03 06:00:57 [manheim.gb] INFO: Scrape type for 1195824: 0
2025-12-03 06:00:57 [manheim.gb] INFO: Found listing with ID: 124569
2025-12-03 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27124569%27 HTTP/1.1" 200 None
2025-12-03 06:00:57 [manheim.gb] INFO: Scrape type for 124569: 2
2025-12-03 06:00:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:00:57 [manheim.gb] INFO: Found listing with ID: 1281726
2025-12-03 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271281726%27 HTTP/1.1" 200 None
2025-12-03 06:00:57 [manheim.gb] INFO: Scrape type for 1281726: 2
2025-12-03 06:00:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:00:57 [manheim.gb] INFO: Found listing with ID: 1306828
2025-12-03 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271306828%27 HTTP/1.1" 200 None
2025-12-03 06:00:57 [manheim.gb] INFO: Scrape type for 1306828: 2
2025-12-03 06:00:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:00:57 [manheim.gb] INFO: Found listing with ID: 1314291
2025-12-03 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271314291%27 HTTP/1.1" 200 None
2025-12-03 06:00:57 [manheim.gb] INFO: Scrape type for 1314291: 2
2025-12-03 06:00:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:00:57 [manheim.gb] INFO: Found listing with ID: 1376686
2025-12-03 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271376686%27 HTTP/1.1" 200 None
2025-12-03 06:00:57 [manheim.gb] INFO: Scrape type for 1376686: 0
2025-12-03 06:00:57 [manheim.gb] INFO: Found listing with ID: 1403363
2025-12-03 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271403363%27 HTTP/1.1" 200 None
2025-12-03 06:00:57 [manheim.gb] INFO: Scrape type for 1403363: 2
2025-12-03 06:00:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:00:57 [manheim.gb] INFO: Found listing with ID: 1405448
2025-12-03 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271405448%27 HTTP/1.1" 200 None
2025-12-03 06:00:57 [manheim.gb] INFO: Scrape type for 1405448: 2
2025-12-03 06:00:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:00:57 [manheim.gb] INFO: Found listing with ID: 1418917
2025-12-03 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271418917%27 HTTP/1.1" 200 None
2025-12-03 06:00:57 [manheim.gb] INFO: Scrape type for 1418917: 2
2025-12-03 06:00:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:00:57 [manheim.gb] INFO: Found listing with ID: 1473959
2025-12-03 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271473959%27 HTTP/1.1" 200 None
2025-12-03 06:00:57 [manheim.gb] INFO: Scrape type for 1473959: 2
2025-12-03 06:00:57 [manheim.gb] INFO: Found listing with ID: 1479833
2025-12-03 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271479833%27 HTTP/1.1" 200 None
2025-12-03 06:00:57 [manheim.gb] INFO: Scrape type for 1479833: 2
2025-12-03 06:00:57 [manheim.gb] INFO: Found listing with ID: 1484153
2025-12-03 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271484153%27 HTTP/1.1" 200 None
2025-12-03 06:00:57 [manheim.gb] INFO: Scrape type for 1484153: 0
2025-12-03 06:00:57 [manheim.gb] INFO: Found listing with ID: 1490428
2025-12-03 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271490428%27 HTTP/1.1" 200 None
2025-12-03 06:00:57 [manheim.gb] INFO: Scrape type for 1490428: 1
2025-12-03 06:00:57 [manheim.gb] INFO: Found listing with ID: 149524
2025-12-03 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27149524%27 HTTP/1.1" 200 None
2025-12-03 06:00:57 [manheim.gb] INFO: Scrape type for 149524: 2
2025-12-03 06:00:57 [manheim.gb] INFO: Found listing with ID: 1501704
2025-12-03 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271501704%27 HTTP/1.1" 200 None
2025-12-03 06:00:57 [manheim.gb] INFO: Scrape type for 1501704: 2
2025-12-03 06:00:57 [manheim.gb] INFO: Found listing with ID: 1541191
2025-12-03 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271541191%27 HTTP/1.1" 200 None
2025-12-03 06:00:57 [manheim.gb] INFO: Scrape type for 1541191: 2
2025-12-03 06:00:57 [manheim.gb] INFO: Found listing with ID: 1546758
2025-12-03 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271546758%27 HTTP/1.1" 200 None
2025-12-03 06:00:57 [manheim.gb] INFO: Scrape type for 1546758: 0
2025-12-03 06:00:57 [manheim.gb] INFO: Found listing with ID: 1554861
2025-12-03 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271554861%27 HTTP/1.1" 200 None
2025-12-03 06:00:57 [manheim.gb] INFO: Scrape type for 1554861: 2
2025-12-03 06:00:57 [manheim.gb] INFO: Found listing with ID: 1563459
2025-12-03 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271563459%27 HTTP/1.1" 200 None
2025-12-03 06:00:57 [manheim.gb] INFO: Scrape type for 1563459: 2
2025-12-03 06:00:57 [manheim.gb] INFO: Found listing with ID: 1564349
2025-12-03 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271564349%27 HTTP/1.1" 200 None
2025-12-03 06:00:57 [manheim.gb] INFO: Scrape type for 1564349: 2
2025-12-03 06:00:57 [manheim.gb] INFO: Found listing with ID: 157293
2025-12-03 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27157293%27 HTTP/1.1" 200 None
2025-12-03 06:00:57 [manheim.gb] INFO: Scrape type for 157293: 1
2025-12-03 06:00:57 [manheim.gb] INFO: Found listing with ID: 1580164
2025-12-03 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271580164%27 HTTP/1.1" 200 None
2025-12-03 06:00:57 [manheim.gb] INFO: Scrape type for 1580164: 2
2025-12-03 06:00:57 [manheim.gb] INFO: Found listing with ID: 1639320
2025-12-03 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271639320%27 HTTP/1.1" 200 None
2025-12-03 06:00:57 [manheim.gb] INFO: Scrape type for 1639320: 0
2025-12-03 06:00:57 [manheim.gb] INFO: Found listing with ID: 1671760
2025-12-03 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271671760%27 HTTP/1.1" 200 None
2025-12-03 06:00:57 [manheim.gb] INFO: Scrape type for 1671760: 2
2025-12-03 06:00:57 [manheim.gb] INFO: Found listing with ID: 1701386
2025-12-03 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271701386%27 HTTP/1.1" 200 None
2025-12-03 06:00:57 [manheim.gb] INFO: Scrape type for 1701386: 0
2025-12-03 06:00:57 [manheim.gb] INFO: Found listing with ID: 1736358
2025-12-03 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271736358%27 HTTP/1.1" 200 None
2025-12-03 06:00:57 [manheim.gb] INFO: Scrape type for 1736358: 0
2025-12-03 06:00:57 [manheim.gb] INFO: Found listing with ID: 1762778
2025-12-03 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271762778%27 HTTP/1.1" 200 None
2025-12-03 06:00:57 [manheim.gb] INFO: Scrape type for 1762778: 0
2025-12-03 06:00:57 [manheim.gb] INFO: Found listing with ID: 1783769
2025-12-03 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271783769%27 HTTP/1.1" 200 None
2025-12-03 06:00:57 [manheim.gb] INFO: Scrape type for 1783769: 0
2025-12-03 06:00:57 [manheim.gb] INFO: Found listing with ID: 1787313
2025-12-03 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271787313%27 HTTP/1.1" 200 None
2025-12-03 06:00:57 [manheim.gb] INFO: Scrape type for 1787313: 2
2025-12-03 06:00:57 [manheim.gb] INFO: Found listing with ID: 1798612
2025-12-03 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271798612%27 HTTP/1.1" 200 None
2025-12-03 06:00:57 [manheim.gb] INFO: Scrape type for 1798612: 0
2025-12-03 06:00:57 [manheim.gb] INFO: Found listing with ID: 1815539
2025-12-03 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271815539%27 HTTP/1.1" 200 None
2025-12-03 06:00:57 [manheim.gb] INFO: Scrape type for 1815539: 1
2025-12-03 06:00:57 [manheim.gb] INFO: Found listing with ID: 1825401
2025-12-03 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271825401%27 HTTP/1.1" 200 None
2025-12-03 06:00:57 [manheim.gb] INFO: Scrape type for 1825401: 2
2025-12-03 06:00:57 [manheim.gb] INFO: Found listing with ID: 1835329
2025-12-03 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271835329%27 HTTP/1.1" 200 None
2025-12-03 06:00:57 [manheim.gb] INFO: Scrape type for 1835329: 2
2025-12-03 06:00:57 [manheim.gb] INFO: Found listing with ID: 1856076
2025-12-03 06:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271856076%27 HTTP/1.1" 200 None
2025-12-03 06:00:58 [manheim.gb] INFO: Scrape type for 1856076: 2
2025-12-03 06:00:58 [manheim.gb] INFO: Found listing with ID: 1859294
2025-12-03 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271859294%27 HTTP/1.1" 200 None
2025-12-03 06:00:58 [manheim.gb] INFO: Scrape type for 1859294: 2
2025-12-03 06:00:58 [manheim.gb] INFO: Found listing with ID: 1877473
2025-12-03 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271877473%27 HTTP/1.1" 200 None
2025-12-03 06:00:58 [manheim.gb] INFO: Scrape type for 1877473: 1
2025-12-03 06:00:58 [manheim.gb] INFO: Found listing with ID: 1905242
2025-12-03 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271905242%27 HTTP/1.1" 200 None
2025-12-03 06:00:58 [manheim.gb] INFO: Scrape type for 1905242: 2
2025-12-03 06:00:58 [manheim.gb] INFO: Found listing with ID: 1912686
2025-12-03 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271912686%27 HTTP/1.1" 200 None
2025-12-03 06:00:58 [manheim.gb] INFO: Scrape type for 1912686: 1
2025-12-03 06:00:58 [manheim.gb] INFO: Found listing with ID: 1940647
2025-12-03 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271940647%27 HTTP/1.1" 200 None
2025-12-03 06:00:58 [manheim.gb] INFO: Scrape type for 1940647: 1
2025-12-03 06:00:58 [manheim.gb] INFO: Found listing with ID: 1950952
2025-12-03 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271950952%27 HTTP/1.1" 200 None
2025-12-03 06:00:58 [manheim.gb] INFO: Scrape type for 1950952: 2
2025-12-03 06:00:58 [manheim.gb] INFO: Found listing with ID: 1962040
2025-12-03 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271962040%27 HTTP/1.1" 200 None
2025-12-03 06:00:58 [manheim.gb] INFO: Scrape type for 1962040: 2
2025-12-03 06:00:58 [manheim.gb] INFO: Found listing with ID: 196679
2025-12-03 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27196679%27 HTTP/1.1" 200 None
2025-12-03 06:00:58 [manheim.gb] INFO: Scrape type for 196679: 1
2025-12-03 06:00:58 [manheim.gb] INFO: Found listing with ID: 1976170
2025-12-03 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271976170%27 HTTP/1.1" 200 None
2025-12-03 06:00:58 [manheim.gb] INFO: Scrape type for 1976170: 1
2025-12-03 06:00:58 [manheim.gb] INFO: Found listing with ID: 1989795
2025-12-03 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271989795%27 HTTP/1.1" 200 None
2025-12-03 06:00:58 [manheim.gb] INFO: Scrape type for 1989795: 2
2025-12-03 06:00:58 [manheim.gb] INFO: Found listing with ID: 1995165
2025-12-03 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271995165%27 HTTP/1.1" 200 None
2025-12-03 06:00:58 [manheim.gb] INFO: Scrape type for 1995165: 2
2025-12-03 06:00:58 [manheim.gb] INFO: Found listing with ID: 2014140
2025-12-03 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272014140%27 HTTP/1.1" 200 None
2025-12-03 06:00:58 [manheim.gb] INFO: Scrape type for 2014140: 0
2025-12-03 06:00:58 [manheim.gb] INFO: Found listing with ID: 2022887
2025-12-03 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272022887%27 HTTP/1.1" 200 None
2025-12-03 06:00:58 [manheim.gb] INFO: Scrape type for 2022887: 0
2025-12-03 06:00:58 [manheim.gb] INFO: Found listing with ID: 2044428
2025-12-03 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272044428%27 HTTP/1.1" 200 None
2025-12-03 06:00:58 [manheim.gb] INFO: Scrape type for 2044428: 0
2025-12-03 06:00:58 [manheim.gb] INFO: Found listing with ID: 2057516
2025-12-03 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272057516%27 HTTP/1.1" 200 None
2025-12-03 06:00:58 [manheim.gb] INFO: Scrape type for 2057516: 0
2025-12-03 06:00:58 [manheim.gb] INFO: Found listing with ID: 2058572
2025-12-03 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272058572%27 HTTP/1.1" 200 None
2025-12-03 06:00:58 [manheim.gb] INFO: Scrape type for 2058572: 0
2025-12-03 06:00:58 [manheim.gb] INFO: Found listing with ID: 2093385
2025-12-03 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272093385%27 HTTP/1.1" 200 None
2025-12-03 06:00:58 [manheim.gb] INFO: Scrape type for 2093385: 2
2025-12-03 06:00:58 [manheim.gb] INFO: Found listing with ID: 2143331
2025-12-03 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272143331%27 HTTP/1.1" 200 None
2025-12-03 06:00:58 [manheim.gb] INFO: Scrape type for 2143331: 0
2025-12-03 06:00:58 [manheim.gb] INFO: Found listing with ID: 2143943
2025-12-03 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272143943%27 HTTP/1.1" 200 None
2025-12-03 06:00:58 [manheim.gb] INFO: Scrape type for 2143943: 0
2025-12-03 06:00:58 [manheim.gb] INFO: Found listing with ID: 216223
2025-12-03 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27216223%27 HTTP/1.1" 200 None
2025-12-03 06:00:58 [manheim.gb] INFO: Scrape type for 216223: 1
2025-12-03 06:00:58 [manheim.gb] INFO: Found listing with ID: 2175705
2025-12-03 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272175705%27 HTTP/1.1" 200 None
2025-12-03 06:00:58 [manheim.gb] INFO: Scrape type for 2175705: 2
2025-12-03 06:00:58 [manheim.gb] INFO: Found listing with ID: 2186514
2025-12-03 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272186514%27 HTTP/1.1" 200 None
2025-12-03 06:00:58 [manheim.gb] INFO: Scrape type for 2186514: 2
2025-12-03 06:00:58 [manheim.gb] INFO: Found listing with ID: 2192411
2025-12-03 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272192411%27 HTTP/1.1" 200 None
2025-12-03 06:00:58 [manheim.gb] INFO: Scrape type for 2192411: 2
2025-12-03 06:00:58 [manheim.gb] INFO: Found listing with ID: 2195912
2025-12-03 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272195912%27 HTTP/1.1" 200 None
2025-12-03 06:00:58 [manheim.gb] INFO: Scrape type for 2195912: 2
2025-12-03 06:00:58 [manheim.gb] INFO: Found listing with ID: 2213672
2025-12-03 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272213672%27 HTTP/1.1" 200 None
2025-12-03 06:00:58 [manheim.gb] INFO: Scrape type for 2213672: 1
2025-12-03 06:00:58 [manheim.gb] INFO: Found listing with ID: 2237239
2025-12-03 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272237239%27 HTTP/1.1" 200 None
2025-12-03 06:00:58 [manheim.gb] INFO: Scrape type for 2237239: 0
2025-12-03 06:01:20 [scrapy.extensions.logstats] INFO: Crawled 2 pages (at 2 pages/min), scraped 0 items (at 0 items/min)
2025-12-03 06:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/HYUNDAI/I30?id=1281726&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231281726&indx=19> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:01:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:01:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 741ea8e0-089b-5709-bba9-fb16a7bce66c with identifier: 1281726
2025-12-03 06:01:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 741ea8e0-089b-5709-bba9-fb16a7bce66c with scrape type 2
2025-12-03 06:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 741ea8e0-089b-5709-bba9-fb16a7bce66c with scrape type 2
2025-12-03 06:01:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 741ea8e0-089b-5709-bba9-fb16a7bce66c, identifier: 1281726
2025-12-03 06:01:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 741ea8e0-089b-5709-bba9-fb16a7bce66c with identifier: 1281726
2025-12-03 06:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-03 06:01:21 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=White HTTP/1.1" 200 None
2025-12-03 06:01:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-03 06:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-03 06:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-03 06:01:22 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Diesel HTTP/1.1" 200 None
2025-12-03 06:01:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-03 06:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-03 06:01:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 741ea8e0-089b-5709-bba9-fb16a7bce66c with identifier: 1281726
2025-12-03 06:01:22 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 10 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    10
2025-12-03 06:01:22 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: 741ea8e0-089b-5709-bba9-fb16a7bce66c spider: manheim.gb
2025-12-03 06:01:22 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 741ea8e0-089b-5709-bba9-fb16a7bce66c due to rule: registration_date_old.json, error: 10 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    10
{'auction_title': '',
 'c_o_2_emission_value': 94,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001281726-01981349-003.pdf',
 'color': 'White',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '741ea8e0-089b-5709-bba9-fb16a7bce66c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'FV65FRJ',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/HYUNDAI/I30?id=1281726',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'HYUNDAI',
 'model': 'I30',
 'odometer': 85229,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-16',
 'seller_name': None,
 'title': 'HYUNDAI I30 1.6 CRDi Blue Drive SE 5dr',
 'transmission': 'manual',
 'trim': '1.6 CRDi Blue Drive SE 5dr',
 'year': 2015}
2025-12-03 06:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271281726%27 HTTP/1.1" 200 None
2025-12-03 06:01:22 [manheim.gb] INFO: Saving data for 1281726: {'auction_closing_time': 1764838800.0, 'created_time': 1764583893.725442, 'last_price_update_time': 1764741682.44939}
2025-12-03 06:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1281726') HTTP/1.1" 204 0
2025-12-03 06:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/FORD/FOCUS?id=1306828&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231306828&indx=21> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:01:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:01:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0996c4f7-2e70-59e7-9588-18c97575446d with identifier: 1306828
2025-12-03 06:01:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0996c4f7-2e70-59e7-9588-18c97575446d with scrape type 2
2025-12-03 06:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0996c4f7-2e70-59e7-9588-18c97575446d with scrape type 2
2025-12-03 06:01:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 0996c4f7-2e70-59e7-9588-18c97575446d, identifier: 1306828
2025-12-03 06:01:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 0996c4f7-2e70-59e7-9588-18c97575446d with identifier: 1306828
2025-12-03 06:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-03 06:01:24 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=BLUE HTTP/1.1" 200 None
2025-12-03 06:01:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-03 06:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-03 06:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-03 06:01:25 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Petrol HTTP/1.1" 200 None
2025-12-03 06:01:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-03 06:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-03 06:01:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 0996c4f7-2e70-59e7-9588-18c97575446d with identifier: 1306828
2025-12-03 06:01:25 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 182117 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    182117
2025-12-03 06:01:25 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 0996c4f7-2e70-59e7-9588-18c97575446d spider: manheim.gb
2025-12-03 06:01:25 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 0996c4f7-2e70-59e7-9588-18c97575446d due to rule: high_mileage_for_country.json, error: 182117 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    182117
{'auction_title': '',
 'c_o_2_emission_value': 179,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001306828-01981454-004.pdf',
 'color': 'BLUE',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '0996c4f7-2e70-59e7-9588-18c97575446d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'SA60OBL',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FORD/FOCUS?id=1306828',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'FORD',
 'model': 'FOCUS',
 'odometer': 113163,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-10-07',
 'seller_name': 'Busseys',
 'title': 'FORD FOCUS 1.6 Titanium 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.6 Titanium 5dr Auto',
 'year': 2010}
2025-12-03 06:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271306828%27 HTTP/1.1" 200 None
2025-12-03 06:01:25 [manheim.gb] INFO: Saving data for 1306828: {'auction_closing_time': 1764838800.0, 'created_time': 1764583676.84982, 'last_price_update_time': 1764741685.379014}
2025-12-03 06:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1306828') HTTP/1.1" 204 0
2025-12-03 06:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/AUDI/A1?id=1101758&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231101758&indx=7> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:01:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:01:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 722002fe-0a5f-57a0-868d-fdc59423d036 with identifier: 1101758
2025-12-03 06:01:25 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 722002fe-0a5f-57a0-868d-fdc59423d036
2025-12-03 06:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/CITROEN/GRANDC4PICASSO?id=1405448&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231405448&indx=27> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:01:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:01:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3a60c56-bd80-563c-9cc0-7ea8eee69993 with identifier: 1405448
2025-12-03 06:01:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3a60c56-bd80-563c-9cc0-7ea8eee69993 with scrape type 2
2025-12-03 06:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3a60c56-bd80-563c-9cc0-7ea8eee69993 with scrape type 2
2025-12-03 06:01:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: e3a60c56-bd80-563c-9cc0-7ea8eee69993, identifier: 1405448
2025-12-03 06:01:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: e3a60c56-bd80-563c-9cc0-7ea8eee69993 with identifier: 1405448
2025-12-03 06:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-03 06:01:27 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=GREY HTTP/1.1" 200 None
2025-12-03 06:01:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-03 06:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-03 06:01:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: e3a60c56-bd80-563c-9cc0-7ea8eee69993 with identifier: 1405448
2025-12-03 06:01:27 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: e3a60c56-bd80-563c-9cc0-7ea8eee69993 with identifier: 1405448 to the API
2025-12-03 06:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 06:01:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 06:01:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/CITROEN/GRANDC4PICASSO?id=1405448&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231405448&indx=27>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001405448-01977041-003.pdf',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'e3a60c56-bd80-563c-9cc0-7ea8eee69993',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'LF17ANR',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/CITROEN/GRAND%20C4%20PICASSO?id=1405448',
 'listing': 'directbuy',
 'location': 'Leeds',
 'make': 'CITROEN',
 'model': 'GRAND C4 PICASSO',
 'odometer': 82038,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-01',
 'seller_name': 'Motor Dough',
 'title': 'CITROEN GRAND C4 PICASSO 1.6 BlueHDi Feel 5dr',
 'transmission': 'manual',
 'trim': '1.6 BlueHDi Feel 5dr',
 'year': 2017}
2025-12-03 06:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271405448%27 HTTP/1.1" 200 None
2025-12-03 06:01:28 [manheim.gb] INFO: Saving data for 1405448: {'auction_closing_time': 1764838800.0, 'created_time': 1764584219.931124, 'last_price_update_time': 1764741688.075077}
2025-12-03 06:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1405448') HTTP/1.1" 204 0
2025-12-03 06:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VAUXHALL/INSIGNIA?id=1314291&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231314291&indx=22> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:01:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:01:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9376b1c4-967f-5b84-83f8-6c73fe1d80a5 with identifier: 1314291
2025-12-03 06:01:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9376b1c4-967f-5b84-83f8-6c73fe1d80a5 with scrape type 2
2025-12-03 06:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9376b1c4-967f-5b84-83f8-6c73fe1d80a5 with scrape type 2
2025-12-03 06:01:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 9376b1c4-967f-5b84-83f8-6c73fe1d80a5, identifier: 1314291
2025-12-03 06:01:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 9376b1c4-967f-5b84-83f8-6c73fe1d80a5 with identifier: 1314291
2025-12-03 06:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-03 06:01:28 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=SILVER HTTP/1.1" 200 None
2025-12-03 06:01:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-03 06:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-03 06:01:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 9376b1c4-967f-5b84-83f8-6c73fe1d80a5 with identifier: 1314291
2025-12-03 06:01:28 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'silver', 'original_photo_count': 0, 'seller_name': 'corner park garages', 'price_includes_vat': False, 'title': 'vauxhall insignia 2.0 cdti [140] ecoflex design nav 5dr [start stop]', 'price': 0, 'currency': 'gbp', 'make': 'vauxhall', 'model': 'insignia', 'transmission': 'manual', 'engine': '2.0l', 'fuel_type': 'diesel', 'odometer': 138705, 'odometer_reading_unit': 'mi', 'registration_date': '2014-03-05', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/vauxhall/insignia?id=1314291', 'location': 'bristol', 'origin_country_code': 'gb', 'trim': '2.0 cdti [140] ecoflex design nav 5dr [start stop]', 'license_plate': 'dy14bzu', 'year': 2014, 'listing': 'auction', 'c_o_2_emission_value': 98, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0001314291-01976910-003.pdf', 'expiration_date': '2025-12-04t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': '9376b1c4-967f-5b84-83f8-6c73fe1d80a5', 'current_year_diff': 11, 'age_in_months': 140, 'make_model': 'vauxhall insignia', 'sanitized_make': 'vauxhall', 'odometer_in_km': 223223}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 140,
     'auction_title': '',
     'c_o_2_emission_value': 98,
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0001314291-01976910-003.pdf',
     'color': 'silver',
     'currency': 'gbp',
     'current_year_diff': 11,
     'engine': '2.0l',
     'expiration_date': '2025-12-04t09:00:00z',
     'fuel_type': 'diesel',
     'id': '9376b1c4-967f-5b84-83f8-6c73fe1d80a5',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'dy14bzu',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/vauxhall/insignia?id=1314291',
     'listing': 'auction',
     'location': 'bristol',
     'make': 'vauxhall',
     'make_model': 'vauxhall insignia',
     'model': 'insignia',
     'odometer': 138705,
     'odometer_in_km': 223223,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2014-03-05',
     'sanitized_make': 'vauxhall',
     'seller_name': 'corner park garages',
     'title': 'vauxhall insignia 2.0 cdti [140] ecoflex design nav 5dr '
              '[start stop]',
     'transmission': 'manual',
     'trim': '2.0 cdti [140] ecoflex design nav 5dr [start stop]',
     'year': 2014}
2025-12-03 06:01:28 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 9376b1c4-967f-5b84-83f8-6c73fe1d80a5 spider: manheim.gb
2025-12-03 06:01:28 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 9376b1c4-967f-5b84-83f8-6c73fe1d80a5 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'silver', 'original_photo_count': 0, 'seller_name': 'corner park garages', 'price_includes_vat': False, 'title': 'vauxhall insignia 2.0 cdti [140] ecoflex design nav 5dr [start stop]', 'price': 0, 'currency': 'gbp', 'make': 'vauxhall', 'model': 'insignia', 'transmission': 'manual', 'engine': '2.0l', 'fuel_type': 'diesel', 'odometer': 138705, 'odometer_reading_unit': 'mi', 'registration_date': '2014-03-05', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/vauxhall/insignia?id=1314291', 'location': 'bristol', 'origin_country_code': 'gb', 'trim': '2.0 cdti [140] ecoflex design nav 5dr [start stop]', 'license_plate': 'dy14bzu', 'year': 2014, 'listing': 'auction', 'c_o_2_emission_value': 98, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0001314291-01976910-003.pdf', 'expiration_date': '2025-12-04t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': '9376b1c4-967f-5b84-83f8-6c73fe1d80a5', 'current_year_diff': 11, 'age_in_months': 140, 'make_model': 'vauxhall insignia', 'sanitized_make': 'vauxhall', 'odometer_in_km': 223223}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 140,
     'auction_title': '',
     'c_o_2_emission_value': 98,
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0001314291-01976910-003.pdf',
     'color': 'silver',
     'currency': 'gbp',
     'current_year_diff': 11,
     'engine': '2.0l',
     'expiration_date': '2025-12-04t09:00:00z',
     'fuel_type': 'diesel',
     'id': '9376b1c4-967f-5b84-83f8-6c73fe1d80a5',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'dy14bzu',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/vauxhall/insignia?id=1314291',
     'listing': 'auction',
     'location': 'bristol',
     'make': 'vauxhall',
     'make_model': 'vauxhall insignia',
     'model': 'insignia',
     'odometer': 138705,
     'odometer_in_km': 223223,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2014-03-05',
     'sanitized_make': 'vauxhall',
     'seller_name': 'corner park garages',
     'title': 'vauxhall insignia 2.0 cdti [140] ecoflex design nav 5dr '
              '[start stop]',
     'transmission': 'manual',
     'trim': '2.0 cdti [140] ecoflex design nav 5dr [start stop]',
     'year': 2014}
{'auction_title': '',
 'c_o_2_emission_value': 98,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001314291-01976910-003.pdf',
 'color': 'SILVER',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '9376b1c4-967f-5b84-83f8-6c73fe1d80a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'DY14BZU',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VAUXHALL/INSIGNIA?id=1314291',
 'listing': 'auction',
 'location': 'Bristol',
 'make': 'VAUXHALL',
 'model': 'INSIGNIA',
 'odometer': 138705,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-05',
 'seller_name': 'Corner Park Garages',
 'title': 'VAUXHALL INSIGNIA 2.0 CDTi [140] ecoFLEX Design Nav 5dr [Start '
          'Stop]',
 'transmission': 'manual',
 'trim': '2.0 CDTi [140] ecoFLEX Design Nav 5dr [Start Stop]',
 'year': 2014}
2025-12-03 06:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271314291%27 HTTP/1.1" 200 None
2025-12-03 06:01:28 [manheim.gb] INFO: Saving data for 1314291: {'auction_closing_time': 1764838800.0, 'created_time': 1764583343.206979, 'last_price_update_time': 1764741688.801548}
2025-12-03 06:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1314291') HTTP/1.1" 204 0
2025-12-03 06:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0001101758-01984290-002.pdf> (referer: None)
2025-12-03 06:01:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:01:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6222850>
2025-12-03 06:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:01:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_722002fe-0a5f-57a0-868d-fdc59423d036/722002fe-0a5f-57a0-868d-fdc59423d036_expert_report_file_112ea212-0c1a-4302-8a95-9d1932192bad.pdf HTTP/1.1" 201 0
2025-12-03 06:01:29 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 722002fe-0a5f-57a0-868d-fdc59423d036
2025-12-03 06:01:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 722002fe-0a5f-57a0-868d-fdc59423d036, skipping ID generation
2025-12-03 06:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 722002fe-0a5f-57a0-868d-fdc59423d036
2025-12-03 06:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F939bc8ad-4dfd-418f-a0a5-f8af06d5272c_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/939bc8ad-4dfd-418f-a0a5-f8af06d5272c_ext_7.jpg not downloaded yet
2025-12-03 06:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F939bc8ad-4dfd-418f-a0a5-f8af06d5272c_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/939bc8ad-4dfd-418f-a0a5-f8af06d5272c_ext_7.jpg not downloaded yet
2025-12-03 06:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/NISSAN/JUKE?id=1403363&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231403363&indx=26> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/FIAT/PUNTOEVO?id=124569&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%23124569&indx=17> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F939bc8ad-4dfd-418f-a0a5-f8af06d5272c_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/939bc8ad-4dfd-418f-a0a5-f8af06d5272c_ext_6.jpg not downloaded yet
2025-12-03 06:01:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:01:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F939bc8ad-4dfd-418f-a0a5-f8af06d5272c_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/939bc8ad-4dfd-418f-a0a5-f8af06d5272c_ext_1.jpg not downloaded yet
2025-12-03 06:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F939bc8ad-4dfd-418f-a0a5-f8af06d5272c_5.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/939bc8ad-4dfd-418f-a0a5-f8af06d5272c_5.jpg not downloaded yet
2025-12-03 06:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F939bc8ad-4dfd-418f-a0a5-f8af06d5272c_4.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/939bc8ad-4dfd-418f-a0a5-f8af06d5272c_4.jpg not downloaded yet
2025-12-03 06:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F939bc8ad-4dfd-418f-a0a5-f8af06d5272c_11.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/939bc8ad-4dfd-418f-a0a5-f8af06d5272c_11.jpg not downloaded yet
2025-12-03 06:01:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b52da2da-653c-5b4d-a08e-32993ce7bdc2 with identifier: 1403363
2025-12-03 06:01:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b52da2da-653c-5b4d-a08e-32993ce7bdc2 with scrape type 2
2025-12-03 06:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b52da2da-653c-5b4d-a08e-32993ce7bdc2 with scrape type 2
2025-12-03 06:01:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: b52da2da-653c-5b4d-a08e-32993ce7bdc2, identifier: 1403363
2025-12-03 06:01:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0659ca46-f0c9-50ed-9faf-2cf9e173592e with identifier: 124569
2025-12-03 06:01:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0659ca46-f0c9-50ed-9faf-2cf9e173592e with scrape type 2
2025-12-03 06:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0659ca46-f0c9-50ed-9faf-2cf9e173592e with scrape type 2
2025-12-03 06:01:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 0659ca46-f0c9-50ed-9faf-2cf9e173592e, identifier: 124569
2025-12-03 06:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F939bc8ad-4dfd-418f-a0a5-f8af06d5272c_10.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/939bc8ad-4dfd-418f-a0a5-f8af06d5272c_10.jpg not downloaded yet
2025-12-03 06:01:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: b52da2da-653c-5b4d-a08e-32993ce7bdc2 with identifier: 1403363
2025-12-03 06:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-03 06:01:30 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Black HTTP/1.1" 200 None
2025-12-03 06:01:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-03 06:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-03 06:01:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: b52da2da-653c-5b4d-a08e-32993ce7bdc2 with identifier: 1403363
2025-12-03 06:01:30 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: b52da2da-653c-5b4d-a08e-32993ce7bdc2 with identifier: 1403363 to the API
2025-12-03 06:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 06:01:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 06:01:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/NISSAN/JUKE?id=1403363&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231403363&indx=26>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001403363-01982347-004.pdf',
 'color': 'Black',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': '2025-12-03T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'b52da2da-653c-5b4d-a08e-32993ce7bdc2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'VK17WSF',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/NISSAN/JUKE?id=1403363',
 'listing': 'auction',
 'location': 'Birmingham',
 'make': 'NISSAN',
 'model': 'JUKE',
 'odometer': 68242,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-31',
 'seller_name': 'Sandicliffe',
 'title': 'NISSAN JUKE 1.2 DiG-T Tekna Pulse 5dr',
 'transmission': 'manual',
 'trim': '1.2 DiG-T Tekna Pulse 5dr',
 'year': 2017}
2025-12-03 06:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271403363%27 HTTP/1.1" 200 None
2025-12-03 06:01:30 [manheim.gb] INFO: Saving data for 1403363: {'auction_closing_time': 1764752400.0, 'created_time': 1764583359.109947, 'last_price_update_time': 1764741690.762805}
2025-12-03 06:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1403363') HTTP/1.1" 204 0
2025-12-03 06:01:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 0659ca46-f0c9-50ed-9faf-2cf9e173592e with identifier: 124569
2025-12-03 06:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-03 06:01:30 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=RED HTTP/1.1" 200 None
2025-12-03 06:01:31 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-03 06:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-03 06:01:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 0659ca46-f0c9-50ed-9faf-2cf9e173592e with identifier: 124569
2025-12-03 06:01:31 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 163893 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    163893
2025-12-03 06:01:31 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 0659ca46-f0c9-50ed-9faf-2cf9e173592e spider: manheim.gb
2025-12-03 06:01:31 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 0659ca46-f0c9-50ed-9faf-2cf9e173592e due to rule: high_mileage_for_country.json, error: 163893 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    163893
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0000124569-01981427-003.pdf',
 'color': 'RED',
 'currency': 'GBP',
 'engine': '1.4L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '0659ca46-f0c9-50ed-9faf-2cf9e173592e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'DY12HYB',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FIAT/PUNTO%20EVO?id=124569',
 'listing': 'auction',
 'location': 'Bristol',
 'make': 'FIAT',
 'model': 'PUNTO EVO',
 'odometer': 101839,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-06',
 'seller_name': 'Hendy Group',
 'title': 'FIAT PUNTO EVO 1.4 GP 5dr',
 'transmission': 'manual',
 'trim': '1.4 GP 5dr',
 'year': 2012}
2025-12-03 06:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27124569%27 HTTP/1.1" 200 None
2025-12-03 06:01:31 [manheim.gb] INFO: Saving data for 124569: {'auction_closing_time': 1764838800.0, 'created_time': 1764583319.286998, 'last_price_update_time': 1764741691.41677}
2025-12-03 06:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='124569') HTTP/1.1" 204 0
2025-12-03 06:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F939bc8ad-4dfd-418f-a0a5-f8af06d5272c_9.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/939bc8ad-4dfd-418f-a0a5-f8af06d5272c_9.jpg not downloaded yet
2025-12-03 06:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F939bc8ad-4dfd-418f-a0a5-f8af06d5272c_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/939bc8ad-4dfd-418f-a0a5-f8af06d5272c_ext_2.jpg not downloaded yet
2025-12-03 06:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F939bc8ad-4dfd-418f-a0a5-f8af06d5272c_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/939bc8ad-4dfd-418f-a0a5-f8af06d5272c_ext_5.jpg not downloaded yet
2025-12-03 06:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F939bc8ad-4dfd-418f-a0a5-f8af06d5272c_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/939bc8ad-4dfd-418f-a0a5-f8af06d5272c_ext_3.jpg not downloaded yet
2025-12-03 06:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F939bc8ad-4dfd-418f-a0a5-f8af06d5272c_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/939bc8ad-4dfd-418f-a0a5-f8af06d5272c_ext_4.jpg not downloaded yet
2025-12-03 06:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1101758-4004858-13.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1101758-4004858-13.jpg not downloaded yet
2025-12-03 06:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1101758-4004858-1000.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1101758-4004858-1000.jpg not downloaded yet
2025-12-03 06:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1101758-4004858-1001.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1101758-4004858-1001.jpg not downloaded yet
2025-12-03 06:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1101758-4004858-1002.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1101758-4004858-1002.jpg not downloaded yet
2025-12-03 06:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1101758-4004858-1003.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1101758-4004858-1003.jpg not downloaded yet
2025-12-03 06:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1101758-4004858-1004.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1101758-4004858-1004.jpg not downloaded yet
2025-12-03 06:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1101758-4004858-1005.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1101758-4004858-1005.jpg not downloaded yet
2025-12-03 06:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1101758-4004858-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001101758-01984290-002.pdf)
2025-12-03 06:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1101758-4004858-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001101758-01984290-002.pdf)
2025-12-03 06:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1101758-4004858-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001101758-01984290-002.pdf)
2025-12-03 06:01:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:01:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6233190>
2025-12-03 06:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:01:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_722002fe-0a5f-57a0-868d-fdc59423d036/722002fe-0a5f-57a0-868d-fdc59423d036_image_19.jpg HTTP/1.1" 201 0
2025-12-03 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1101758-4004858-1005.jpg') HTTP/1.1" 204 0
2025-12-03 06:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1101758-4004858-1005.jpg saved to cache
2025-12-03 06:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 722002fe-0a5f-57a0-868d-fdc59423d036
2025-12-03 06:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1101758-4004858-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001101758-01984290-002.pdf)
2025-12-03 06:01:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:01:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f5b54a10>
2025-12-03 06:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:01:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 06:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_722002fe-0a5f-57a0-868d-fdc59423d036/722002fe-0a5f-57a0-868d-fdc59423d036_image_18.jpg HTTP/1.1" 201 0
2025-12-03 06:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1101758-4004858-1004.jpg') HTTP/1.1" 204 0
2025-12-03 06:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1101758-4004858-1004.jpg saved to cache
2025-12-03 06:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 722002fe-0a5f-57a0-868d-fdc59423d036
2025-12-03 06:01:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:01:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f52a4e90>
2025-12-03 06:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:01:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_722002fe-0a5f-57a0-868d-fdc59423d036/722002fe-0a5f-57a0-868d-fdc59423d036_image_17.jpg HTTP/1.1" 201 0
2025-12-03 06:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1101758-4004858-1003.jpg') HTTP/1.1" 204 0
2025-12-03 06:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1101758-4004858-1003.jpg saved to cache
2025-12-03 06:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 722002fe-0a5f-57a0-868d-fdc59423d036
2025-12-03 06:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1101758-4004858-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001101758-01984290-002.pdf)
2025-12-03 06:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1101758-4004858-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001101758-01984290-002.pdf)
2025-12-03 06:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/LAND%20ROVER/DISCOVERY?id=1019262&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231019262&indx=1> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:01:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:01:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:01:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f61d8710>
2025-12-03 06:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:01:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 06:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_722002fe-0a5f-57a0-868d-fdc59423d036/722002fe-0a5f-57a0-868d-fdc59423d036_image_15.jpg HTTP/1.1" 201 0
2025-12-03 06:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1101758-4004858-1001.jpg') HTTP/1.1" 204 0
2025-12-03 06:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1101758-4004858-1001.jpg saved to cache
2025-12-03 06:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 722002fe-0a5f-57a0-868d-fdc59423d036
2025-12-03 06:01:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:01:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f5bc4310>
2025-12-03 06:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:01:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 06:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_722002fe-0a5f-57a0-868d-fdc59423d036/722002fe-0a5f-57a0-868d-fdc59423d036_image_16.jpg HTTP/1.1" 201 0
2025-12-03 06:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1101758-4004858-1002.jpg') HTTP/1.1" 204 0
2025-12-03 06:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1101758-4004858-1002.jpg saved to cache
2025-12-03 06:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 722002fe-0a5f-57a0-868d-fdc59423d036
2025-12-03 06:01:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:01:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f529db50>
2025-12-03 06:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:01:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 06:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_722002fe-0a5f-57a0-868d-fdc59423d036/722002fe-0a5f-57a0-868d-fdc59423d036_image_14.jpg HTTP/1.1" 201 0
2025-12-03 06:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1101758-4004858-1000.jpg') HTTP/1.1" 204 0
2025-12-03 06:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1101758-4004858-1000.jpg saved to cache
2025-12-03 06:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 722002fe-0a5f-57a0-868d-fdc59423d036
2025-12-03 06:01:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17dea801-4624-57df-bf1c-82420db11734 with identifier: 1019262
2025-12-03 06:01:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17dea801-4624-57df-bf1c-82420db11734 with scrape type 2
2025-12-03 06:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17dea801-4624-57df-bf1c-82420db11734 with scrape type 2
2025-12-03 06:01:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 17dea801-4624-57df-bf1c-82420db11734, identifier: 1019262
2025-12-03 06:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/939bc8ad-4dfd-418f-a0a5-f8af06d5272c_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001101758-01984290-002.pdf)
2025-12-03 06:01:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 17dea801-4624-57df-bf1c-82420db11734 with identifier: 1019262
2025-12-03 06:01:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 17dea801-4624-57df-bf1c-82420db11734 with identifier: 1019262
2025-12-03 06:01:35 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': False, 'title': 'land rover discovery 3.0 tdv6 xs 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'land rover', 'model': 'discovery', 'transmission': 'automatic', 'engine': '3.0l', 'fuel_type': 'diesel', 'odometer': 135981, 'odometer_reading_unit': 'mi', 'registration_date': '2009-11-18', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/land%20rover/discovery?id=1019262', 'location': 'colchester', 'origin_country_code': 'gb', 'trim': '3.0 tdv6 xs 5dr auto', 'license_plate': 'gk59ybt', 'year': 2009, 'listing': 'auction', 'c_o_2_emission_value': 244, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0001019262-01983742-004.pdf', 'expiration_date': '2025-12-04t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': '17dea801-4624-57df-bf1c-82420db11734', 'current_year_diff': 16, 'age_in_months': 192, 'make_model': 'land rover discovery', 'sanitized_make': 'landrover', 'odometer_in_km': 218839}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 192,
     'auction_title': '',
     'c_o_2_emission_value': 244,
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0001019262-01983742-004.pdf',
     'color': 'red',
     'currency': 'gbp',
     'current_year_diff': 16,
     'engine': '3.0l',
     'expiration_date': '2025-12-04t09:00:00z',
     'fuel_type': 'diesel',
     'id': '17dea801-4624-57df-bf1c-82420db11734',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'gk59ybt',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/land%20rover/discovery?id=1019262',
     'listing': 'auction',
     'location': 'colchester',
     'make': 'land rover',
     'make_model': 'land rover discovery',
     'model': 'discovery',
     'odometer': 135981,
     'odometer_in_km': 218839,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2009-11-18',
     'sanitized_make': 'landrover',
     'seller_name': None,
     'title': 'land rover discovery 3.0 tdv6 xs 5dr auto',
     'transmission': 'automatic',
     'trim': '3.0 tdv6 xs 5dr auto',
     'year': 2009}
2025-12-03 06:01:35 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 17dea801-4624-57df-bf1c-82420db11734 spider: manheim.gb
2025-12-03 06:01:35 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 17dea801-4624-57df-bf1c-82420db11734 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': False, 'title': 'land rover discovery 3.0 tdv6 xs 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'land rover', 'model': 'discovery', 'transmission': 'automatic', 'engine': '3.0l', 'fuel_type': 'diesel', 'odometer': 135981, 'odometer_reading_unit': 'mi', 'registration_date': '2009-11-18', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/land%20rover/discovery?id=1019262', 'location': 'colchester', 'origin_country_code': 'gb', 'trim': '3.0 tdv6 xs 5dr auto', 'license_plate': 'gk59ybt', 'year': 2009, 'listing': 'auction', 'c_o_2_emission_value': 244, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0001019262-01983742-004.pdf', 'expiration_date': '2025-12-04t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': '17dea801-4624-57df-bf1c-82420db11734', 'current_year_diff': 16, 'age_in_months': 192, 'make_model': 'land rover discovery', 'sanitized_make': 'landrover', 'odometer_in_km': 218839}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 192,
     'auction_title': '',
     'c_o_2_emission_value': 244,
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0001019262-01983742-004.pdf',
     'color': 'red',
     'currency': 'gbp',
     'current_year_diff': 16,
     'engine': '3.0l',
     'expiration_date': '2025-12-04t09:00:00z',
     'fuel_type': 'diesel',
     'id': '17dea801-4624-57df-bf1c-82420db11734',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'gk59ybt',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/land%20rover/discovery?id=1019262',
     'listing': 'auction',
     'location': 'colchester',
     'make': 'land rover',
     'make_model': 'land rover discovery',
     'model': 'discovery',
     'odometer': 135981,
     'odometer_in_km': 218839,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2009-11-18',
     'sanitized_make': 'landrover',
     'seller_name': None,
     'title': 'land rover discovery 3.0 tdv6 xs 5dr auto',
     'transmission': 'automatic',
     'trim': '3.0 tdv6 xs 5dr auto',
     'year': 2009}
{'auction_title': '',
 'c_o_2_emission_value': 244,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001019262-01983742-004.pdf',
 'color': 'RED',
 'currency': 'GBP',
 'engine': '3.0L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '17dea801-4624-57df-bf1c-82420db11734',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'GK59YBT',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/LAND%20ROVER/DISCOVERY?id=1019262',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'LAND ROVER',
 'model': 'DISCOVERY',
 'odometer': 135981,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-11-18',
 'seller_name': None,
 'title': 'LAND ROVER DISCOVERY 3.0 TDV6 XS 5dr Auto',
 'transmission': 'automatic',
 'trim': '3.0 TDV6 XS 5dr Auto',
 'year': 2009}
2025-12-03 06:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271019262%27 HTTP/1.1" 200 None
2025-12-03 06:01:35 [manheim.gb] INFO: Saving data for 1019262: {'auction_closing_time': 1764838800.0, 'created_time': 1764151334.413663, 'last_price_update_time': 1764741695.383566}
2025-12-03 06:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1019262') HTTP/1.1" 204 0
2025-12-03 06:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/939bc8ad-4dfd-418f-a0a5-f8af06d5272c_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001101758-01984290-002.pdf)
2025-12-03 06:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1101758-4004858-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001101758-01984290-002.pdf)
2025-12-03 06:01:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:01:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f633b6d0>
2025-12-03 06:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:01:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_722002fe-0a5f-57a0-868d-fdc59423d036/722002fe-0a5f-57a0-868d-fdc59423d036_image_12.jpg HTTP/1.1" 201 0
2025-12-03 06:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F939bc8ad-4dfd-418f-a0a5-f8af06d5272c_ext_4.jpg') HTTP/1.1" 204 0
2025-12-03 06:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/939bc8ad-4dfd-418f-a0a5-f8af06d5272c_ext_4.jpg saved to cache
2025-12-03 06:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 722002fe-0a5f-57a0-868d-fdc59423d036
2025-12-03 06:01:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:01:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f5bdc690>
2025-12-03 06:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:01:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_722002fe-0a5f-57a0-868d-fdc59423d036/722002fe-0a5f-57a0-868d-fdc59423d036_image_11.jpg HTTP/1.1" 201 0
2025-12-03 06:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F939bc8ad-4dfd-418f-a0a5-f8af06d5272c_ext_3.jpg') HTTP/1.1" 204 0
2025-12-03 06:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/939bc8ad-4dfd-418f-a0a5-f8af06d5272c_ext_3.jpg saved to cache
2025-12-03 06:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 722002fe-0a5f-57a0-868d-fdc59423d036
2025-12-03 06:01:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:01:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f5b89690>
2025-12-03 06:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:01:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 06:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_722002fe-0a5f-57a0-868d-fdc59423d036/722002fe-0a5f-57a0-868d-fdc59423d036_image_13.jpg HTTP/1.1" 201 0
2025-12-03 06:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1101758-4004858-13.jpg') HTTP/1.1" 204 0
2025-12-03 06:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1101758-4004858-13.jpg saved to cache
2025-12-03 06:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 722002fe-0a5f-57a0-868d-fdc59423d036
2025-12-03 06:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/939bc8ad-4dfd-418f-a0a5-f8af06d5272c_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001101758-01984290-002.pdf)
2025-12-03 06:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/939bc8ad-4dfd-418f-a0a5-f8af06d5272c_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001101758-01984290-002.pdf)
2025-12-03 06:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/939bc8ad-4dfd-418f-a0a5-f8af06d5272c_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001101758-01984290-002.pdf)
2025-12-03 06:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/939bc8ad-4dfd-418f-a0a5-f8af06d5272c_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001101758-01984290-002.pdf)
2025-12-03 06:01:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:01:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f52e15d0>
2025-12-03 06:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:01:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_722002fe-0a5f-57a0-868d-fdc59423d036/722002fe-0a5f-57a0-868d-fdc59423d036_image_9.jpg HTTP/1.1" 201 0
2025-12-03 06:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F939bc8ad-4dfd-418f-a0a5-f8af06d5272c_ext_2.jpg') HTTP/1.1" 204 0
2025-12-03 06:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/939bc8ad-4dfd-418f-a0a5-f8af06d5272c_ext_2.jpg saved to cache
2025-12-03 06:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 722002fe-0a5f-57a0-868d-fdc59423d036
2025-12-03 06:01:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:01:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f642d810>
2025-12-03 06:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:01:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_722002fe-0a5f-57a0-868d-fdc59423d036/722002fe-0a5f-57a0-868d-fdc59423d036_image_8.jpg HTTP/1.1" 201 0
2025-12-03 06:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F939bc8ad-4dfd-418f-a0a5-f8af06d5272c_9.jpg') HTTP/1.1" 204 0
2025-12-03 06:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/939bc8ad-4dfd-418f-a0a5-f8af06d5272c_9.jpg saved to cache
2025-12-03 06:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 722002fe-0a5f-57a0-868d-fdc59423d036
2025-12-03 06:01:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:01:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f52c2ed0>
2025-12-03 06:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:01:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_722002fe-0a5f-57a0-868d-fdc59423d036/722002fe-0a5f-57a0-868d-fdc59423d036_image_7.jpg HTTP/1.1" 201 0
2025-12-03 06:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F939bc8ad-4dfd-418f-a0a5-f8af06d5272c_10.jpg') HTTP/1.1" 204 0
2025-12-03 06:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/939bc8ad-4dfd-418f-a0a5-f8af06d5272c_10.jpg saved to cache
2025-12-03 06:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 722002fe-0a5f-57a0-868d-fdc59423d036
2025-12-03 06:01:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:01:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f65f14d0>
2025-12-03 06:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:01:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_722002fe-0a5f-57a0-868d-fdc59423d036/722002fe-0a5f-57a0-868d-fdc59423d036_image_10.jpg HTTP/1.1" 201 0
2025-12-03 06:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F939bc8ad-4dfd-418f-a0a5-f8af06d5272c_ext_5.jpg') HTTP/1.1" 204 0
2025-12-03 06:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/939bc8ad-4dfd-418f-a0a5-f8af06d5272c_ext_5.jpg saved to cache
2025-12-03 06:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 722002fe-0a5f-57a0-868d-fdc59423d036
2025-12-03 06:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/939bc8ad-4dfd-418f-a0a5-f8af06d5272c_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001101758-01984290-002.pdf)
2025-12-03 06:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/939bc8ad-4dfd-418f-a0a5-f8af06d5272c_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001101758-01984290-002.pdf)
2025-12-03 06:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/939bc8ad-4dfd-418f-a0a5-f8af06d5272c_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001101758-01984290-002.pdf)
2025-12-03 06:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/939bc8ad-4dfd-418f-a0a5-f8af06d5272c_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001101758-01984290-002.pdf)
2025-12-03 06:01:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:01:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f63e5550>
2025-12-03 06:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:01:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_722002fe-0a5f-57a0-868d-fdc59423d036/722002fe-0a5f-57a0-868d-fdc59423d036_image_3.jpg HTTP/1.1" 201 0
2025-12-03 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F939bc8ad-4dfd-418f-a0a5-f8af06d5272c_ext_1.jpg') HTTP/1.1" 204 0
2025-12-03 06:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/939bc8ad-4dfd-418f-a0a5-f8af06d5272c_ext_1.jpg saved to cache
2025-12-03 06:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 722002fe-0a5f-57a0-868d-fdc59423d036
2025-12-03 06:01:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:01:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f491d890>
2025-12-03 06:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:01:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 06:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_722002fe-0a5f-57a0-868d-fdc59423d036/722002fe-0a5f-57a0-868d-fdc59423d036_image_6.jpg HTTP/1.1" 201 0
2025-12-03 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F939bc8ad-4dfd-418f-a0a5-f8af06d5272c_11.jpg') HTTP/1.1" 204 0
2025-12-03 06:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/939bc8ad-4dfd-418f-a0a5-f8af06d5272c_11.jpg saved to cache
2025-12-03 06:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 722002fe-0a5f-57a0-868d-fdc59423d036
2025-12-03 06:01:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:01:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f52f3390>
2025-12-03 06:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:01:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_722002fe-0a5f-57a0-868d-fdc59423d036/722002fe-0a5f-57a0-868d-fdc59423d036_image_5.jpg HTTP/1.1" 201 0
2025-12-03 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F939bc8ad-4dfd-418f-a0a5-f8af06d5272c_4.jpg') HTTP/1.1" 204 0
2025-12-03 06:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/939bc8ad-4dfd-418f-a0a5-f8af06d5272c_4.jpg saved to cache
2025-12-03 06:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 722002fe-0a5f-57a0-868d-fdc59423d036
2025-12-03 06:01:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:01:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f5bd6210>
2025-12-03 06:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:01:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_722002fe-0a5f-57a0-868d-fdc59423d036/722002fe-0a5f-57a0-868d-fdc59423d036_image_4.jpg HTTP/1.1" 201 0
2025-12-03 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F939bc8ad-4dfd-418f-a0a5-f8af06d5272c_5.jpg') HTTP/1.1" 204 0
2025-12-03 06:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/939bc8ad-4dfd-418f-a0a5-f8af06d5272c_5.jpg saved to cache
2025-12-03 06:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 722002fe-0a5f-57a0-868d-fdc59423d036
2025-12-03 06:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/939bc8ad-4dfd-418f-a0a5-f8af06d5272c_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001101758-01984290-002.pdf)
2025-12-03 06:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/939bc8ad-4dfd-418f-a0a5-f8af06d5272c_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001101758-01984290-002.pdf)
2025-12-03 06:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/939bc8ad-4dfd-418f-a0a5-f8af06d5272c_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001101758-01984290-002.pdf)
2025-12-03 06:01:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:01:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f5bfba50>
2025-12-03 06:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:01:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_722002fe-0a5f-57a0-868d-fdc59423d036/722002fe-0a5f-57a0-868d-fdc59423d036_image_2.jpg HTTP/1.1" 201 0
2025-12-03 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F939bc8ad-4dfd-418f-a0a5-f8af06d5272c_ext_6.jpg') HTTP/1.1" 204 0
2025-12-03 06:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/939bc8ad-4dfd-418f-a0a5-f8af06d5272c_ext_6.jpg saved to cache
2025-12-03 06:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 722002fe-0a5f-57a0-868d-fdc59423d036
2025-12-03 06:01:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:01:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f4924850>
2025-12-03 06:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:01:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_722002fe-0a5f-57a0-868d-fdc59423d036/722002fe-0a5f-57a0-868d-fdc59423d036_image_0.jpg HTTP/1.1" 201 0
2025-12-03 06:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F939bc8ad-4dfd-418f-a0a5-f8af06d5272c_ext_7.jpg') HTTP/1.1" 204 0
2025-12-03 06:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/939bc8ad-4dfd-418f-a0a5-f8af06d5272c_ext_7.jpg saved to cache
2025-12-03 06:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 722002fe-0a5f-57a0-868d-fdc59423d036
2025-12-03 06:01:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:01:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f492a110>
2025-12-03 06:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:01:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_722002fe-0a5f-57a0-868d-fdc59423d036/722002fe-0a5f-57a0-868d-fdc59423d036_image_1.jpg HTTP/1.1" 201 0
2025-12-03 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F939bc8ad-4dfd-418f-a0a5-f8af06d5272c_ext_7.jpg') HTTP/1.1" 204 0
2025-12-03 06:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/939bc8ad-4dfd-418f-a0a5-f8af06d5272c_ext_7.jpg saved to cache
2025-12-03 06:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 722002fe-0a5f-57a0-868d-fdc59423d036
2025-12-03 06:01:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 722002fe-0a5f-57a0-868d-fdc59423d036, skipping ID generation
2025-12-03 06:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 722002fe-0a5f-57a0-868d-fdc59423d036 from tracking dictionaries
2025-12-03 06:01:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 722002fe-0a5f-57a0-868d-fdc59423d036 sending to next pipeline
2025-12-03 06:01:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 722002fe-0a5f-57a0-868d-fdc59423d036, identifier: 1101758
2025-12-03 06:01:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 722002fe-0a5f-57a0-868d-fdc59423d036 with identifier: 1101758
2025-12-03 06:01:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 722002fe-0a5f-57a0-868d-fdc59423d036 with identifier: 1101758
2025-12-03 06:01:40 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 13 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    13
2025-12-03 06:01:40 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: 722002fe-0a5f-57a0-868d-fdc59423d036 spider: manheim.gb
2025-12-03 06:01:40 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 722002fe-0a5f-57a0-868d-fdc59423d036 due to rule: registration_date_old.json, error: 13 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    13
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_722002fe-0a5f-57a0-868d-fdc59423d036/722002fe-0a5f-57a0-868d-fdc59423d036_expert_report_file_112ea212-0c1a-4302-8a95-9d1932192bad.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001101758-01984290-002.pdf',
 'color': 'BLUE',
 'currency': 'GBP',
 'engine': '1.4L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '722002fe-0a5f-57a0-868d-fdc59423d036',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'KN62LZX',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/AUDI/A1?id=1101758',
 'listing': 'auction',
 'location': 'Bristol',
 'make': 'AUDI',
 'model': 'A1',
 'odometer': 92297,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 55,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_722002fe-0a5f-57a0-868d-fdc59423d036/722002fe-0a5f-57a0-868d-fdc59423d036_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 278020,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/939bc8ad-4dfd-418f-a0a5-f8af06d5272c_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_722002fe-0a5f-57a0-868d-fdc59423d036/722002fe-0a5f-57a0-868d-fdc59423d036_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 278020,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/939bc8ad-4dfd-418f-a0a5-f8af06d5272c_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_722002fe-0a5f-57a0-868d-fdc59423d036/722002fe-0a5f-57a0-868d-fdc59423d036_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 229689,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/939bc8ad-4dfd-418f-a0a5-f8af06d5272c_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_722002fe-0a5f-57a0-868d-fdc59423d036/722002fe-0a5f-57a0-868d-fdc59423d036_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 170449,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/939bc8ad-4dfd-418f-a0a5-f8af06d5272c_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_722002fe-0a5f-57a0-868d-fdc59423d036/722002fe-0a5f-57a0-868d-fdc59423d036_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 255240,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/939bc8ad-4dfd-418f-a0a5-f8af06d5272c_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_722002fe-0a5f-57a0-868d-fdc59423d036/722002fe-0a5f-57a0-868d-fdc59423d036_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 235729,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/939bc8ad-4dfd-418f-a0a5-f8af06d5272c_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_722002fe-0a5f-57a0-868d-fdc59423d036/722002fe-0a5f-57a0-868d-fdc59423d036_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 246583,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/939bc8ad-4dfd-418f-a0a5-f8af06d5272c_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_722002fe-0a5f-57a0-868d-fdc59423d036/722002fe-0a5f-57a0-868d-fdc59423d036_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 214598,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/939bc8ad-4dfd-418f-a0a5-f8af06d5272c_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_722002fe-0a5f-57a0-868d-fdc59423d036/722002fe-0a5f-57a0-868d-fdc59423d036_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257996,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/939bc8ad-4dfd-418f-a0a5-f8af06d5272c_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_722002fe-0a5f-57a0-868d-fdc59423d036/722002fe-0a5f-57a0-868d-fdc59423d036_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 240852,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/939bc8ad-4dfd-418f-a0a5-f8af06d5272c_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_722002fe-0a5f-57a0-868d-fdc59423d036/722002fe-0a5f-57a0-868d-fdc59423d036_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 236016,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/939bc8ad-4dfd-418f-a0a5-f8af06d5272c_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_722002fe-0a5f-57a0-868d-fdc59423d036/722002fe-0a5f-57a0-868d-fdc59423d036_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 219214,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/939bc8ad-4dfd-418f-a0a5-f8af06d5272c_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_722002fe-0a5f-57a0-868d-fdc59423d036/722002fe-0a5f-57a0-868d-fdc59423d036_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 152367,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/939bc8ad-4dfd-418f-a0a5-f8af06d5272c_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_722002fe-0a5f-57a0-868d-fdc59423d036/722002fe-0a5f-57a0-868d-fdc59423d036_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 302566,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1101758-4004858-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_722002fe-0a5f-57a0-868d-fdc59423d036/722002fe-0a5f-57a0-868d-fdc59423d036_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 322861,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1101758-4004858-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_722002fe-0a5f-57a0-868d-fdc59423d036/722002fe-0a5f-57a0-868d-fdc59423d036_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 159161,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1101758-4004858-1001.jpg',
             'Width': 749},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_722002fe-0a5f-57a0-868d-fdc59423d036/722002fe-0a5f-57a0-868d-fdc59423d036_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 314729,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1101758-4004858-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_722002fe-0a5f-57a0-868d-fdc59423d036/722002fe-0a5f-57a0-868d-fdc59423d036_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 327847,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1101758-4004858-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_722002fe-0a5f-57a0-868d-fdc59423d036/722002fe-0a5f-57a0-868d-fdc59423d036_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 298206,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1101758-4004858-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_722002fe-0a5f-57a0-868d-fdc59423d036/722002fe-0a5f-57a0-868d-fdc59423d036_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 202564,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1101758-4004858-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-09',
 'seller_name': 'Mon Motors',
 'title': 'AUDI A1 1.4 TFSI S Line 5dr',
 'transmission': 'manual',
 'trim': '1.4 TFSI S Line 5dr',
 'year': 2012}
2025-12-03 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271101758%27 HTTP/1.1" 200 None
2025-12-03 06:01:40 [manheim.gb] INFO: Saving data for 1101758: {'created_time': 1764741700.818832, 'last_price_update_time': 1764741700.818845, 'auction_closing_time': 1764838800.0}
2025-12-03 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1101758') HTTP/1.1" 204 0
2025-12-03 06:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/FORD/FOCUS?id=1418917&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231418917&indx=30> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:01:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:01:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d313d20e-3e85-5824-9c26-e84f724785c6 with identifier: 1418917
2025-12-03 06:01:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d313d20e-3e85-5824-9c26-e84f724785c6 with scrape type 2
2025-12-03 06:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d313d20e-3e85-5824-9c26-e84f724785c6 with scrape type 2
2025-12-03 06:01:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: d313d20e-3e85-5824-9c26-e84f724785c6, identifier: 1418917
2025-12-03 06:01:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: d313d20e-3e85-5824-9c26-e84f724785c6 with identifier: 1418917
2025-12-03 06:01:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: d313d20e-3e85-5824-9c26-e84f724785c6 with identifier: 1418917
2025-12-03 06:01:47 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 157446 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    157446
2025-12-03 06:01:47 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: d313d20e-3e85-5824-9c26-e84f724785c6 spider: manheim.gb
2025-12-03 06:01:47 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: d313d20e-3e85-5824-9c26-e84f724785c6 due to rule: high_mileage_for_country.json, error: 157446 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    157446
{'auction_title': '',
 'c_o_2_emission_value': 98,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001418917-01981846-004.pdf',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '1.5L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'd313d20e-3e85-5824-9c26-e84f724785c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'YR65OOF',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FORD/FOCUS?id=1418917',
 'listing': 'auction',
 'location': 'Shotts',
 'make': 'FORD',
 'model': 'FOCUS',
 'odometer': 97833,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-30',
 'seller_name': None,
 'title': 'FORD FOCUS 1.5 TDCi 120 Titanium 5dr',
 'transmission': 'manual',
 'trim': '1.5 TDCi 120 Titanium 5dr',
 'year': 2015}
2025-12-03 06:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271418917%27 HTTP/1.1" 200 None
2025-12-03 06:01:47 [manheim.gb] INFO: Saving data for 1418917: {'auction_closing_time': 1764838800.0, 'created_time': 1764584221.653834, 'last_price_update_time': 1764741707.731634}
2025-12-03 06:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1418917') HTTP/1.1" 204 0
2025-12-03 06:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/refine> (referer: https://www.manheim.co.uk/search) ['zyte-api']
2025-12-03 06:01:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:01:49 [manheim.gb] INFO: Found listing with ID: 2243807
2025-12-03 06:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272243807%27 HTTP/1.1" 200 None
2025-12-03 06:01:49 [manheim.gb] INFO: Scrape type for 2243807: 2
2025-12-03 06:01:49 [manheim.gb] INFO: Found listing with ID: 2252704
2025-12-03 06:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272252704%27 HTTP/1.1" 200 None
2025-12-03 06:01:49 [manheim.gb] INFO: Scrape type for 2252704: 0
2025-12-03 06:01:49 [manheim.gb] INFO: Found listing with ID: 2255216
2025-12-03 06:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272255216%27 HTTP/1.1" 200 None
2025-12-03 06:01:49 [manheim.gb] INFO: Scrape type for 2255216: 1
2025-12-03 06:01:49 [manheim.gb] INFO: Found listing with ID: 2255783
2025-12-03 06:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272255783%27 HTTP/1.1" 200 None
2025-12-03 06:01:49 [manheim.gb] INFO: Scrape type for 2255783: 0
2025-12-03 06:01:49 [manheim.gb] INFO: Found listing with ID: 2262431
2025-12-03 06:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272262431%27 HTTP/1.1" 200 None
2025-12-03 06:01:50 [manheim.gb] INFO: Scrape type for 2262431: 1
2025-12-03 06:01:50 [manheim.gb] INFO: Found listing with ID: 2286249
2025-12-03 06:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272286249%27 HTTP/1.1" 200 None
2025-12-03 06:01:50 [manheim.gb] INFO: Scrape type for 2286249: 1
2025-12-03 06:01:50 [manheim.gb] INFO: Found listing with ID: 2292927
2025-12-03 06:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272292927%27 HTTP/1.1" 200 None
2025-12-03 06:01:50 [manheim.gb] INFO: Scrape type for 2292927: 2
2025-12-03 06:01:50 [manheim.gb] INFO: Found listing with ID: 2303707
2025-12-03 06:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272303707%27 HTTP/1.1" 200 None
2025-12-03 06:01:50 [manheim.gb] INFO: Scrape type for 2303707: 0
2025-12-03 06:01:50 [manheim.gb] INFO: Found listing with ID: 2316345
2025-12-03 06:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272316345%27 HTTP/1.1" 200 None
2025-12-03 06:01:50 [manheim.gb] INFO: Scrape type for 2316345: 0
2025-12-03 06:01:50 [manheim.gb] INFO: Found listing with ID: 2321815
2025-12-03 06:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272321815%27 HTTP/1.1" 200 None
2025-12-03 06:01:50 [manheim.gb] INFO: Scrape type for 2321815: 0
2025-12-03 06:01:50 [manheim.gb] INFO: Found listing with ID: 2326281
2025-12-03 06:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272326281%27 HTTP/1.1" 200 None
2025-12-03 06:01:50 [manheim.gb] INFO: Scrape type for 2326281: 1
2025-12-03 06:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/ALFA%20ROMEO/GIULIETTA?id=1473959&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231473959&indx=33> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:01:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:01:50 [manheim.gb] INFO: Found listing with ID: 2330511
2025-12-03 06:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272330511%27 HTTP/1.1" 200 None
2025-12-03 06:01:50 [manheim.gb] INFO: Scrape type for 2330511: 1
2025-12-03 06:01:50 [manheim.gb] INFO: Found listing with ID: 2354571
2025-12-03 06:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272354571%27 HTTP/1.1" 200 None
2025-12-03 06:01:50 [manheim.gb] INFO: Scrape type for 2354571: 2
2025-12-03 06:01:50 [manheim.gb] INFO: Found listing with ID: 2358676
2025-12-03 06:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272358676%27 HTTP/1.1" 200 None
2025-12-03 06:01:50 [manheim.gb] INFO: Scrape type for 2358676: 0
2025-12-03 06:01:50 [manheim.gb] INFO: Found listing with ID: 2359941
2025-12-03 06:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272359941%27 HTTP/1.1" 200 None
2025-12-03 06:01:50 [manheim.gb] INFO: Scrape type for 2359941: 2
2025-12-03 06:01:50 [manheim.gb] INFO: Found listing with ID: 2365471
2025-12-03 06:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272365471%27 HTTP/1.1" 200 None
2025-12-03 06:01:50 [manheim.gb] INFO: Scrape type for 2365471: 0
2025-12-03 06:01:50 [manheim.gb] INFO: Found listing with ID: 2374569
2025-12-03 06:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272374569%27 HTTP/1.1" 200 None
2025-12-03 06:01:50 [manheim.gb] INFO: Scrape type for 2374569: 2
2025-12-03 06:01:50 [manheim.gb] INFO: Found listing with ID: 2378382
2025-12-03 06:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272378382%27 HTTP/1.1" 200 None
2025-12-03 06:01:50 [manheim.gb] INFO: Scrape type for 2378382: 2
2025-12-03 06:01:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1110047e-8b55-52b8-89d0-099ad071e0f4 with identifier: 1473959
2025-12-03 06:01:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1110047e-8b55-52b8-89d0-099ad071e0f4 with scrape type 2
2025-12-03 06:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1110047e-8b55-52b8-89d0-099ad071e0f4 with scrape type 2
2025-12-03 06:01:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 1110047e-8b55-52b8-89d0-099ad071e0f4, identifier: 1473959
2025-12-03 06:01:50 [manheim.gb] INFO: Found listing with ID: 2383831
2025-12-03 06:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272383831%27 HTTP/1.1" 200 None
2025-12-03 06:01:50 [manheim.gb] INFO: Scrape type for 2383831: 2
2025-12-03 06:01:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 1110047e-8b55-52b8-89d0-099ad071e0f4 with identifier: 1473959
2025-12-03 06:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-03 06:01:50 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=WHITE HTTP/1.1" 200 None
2025-12-03 06:01:50 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-03 06:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-03 06:01:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 1110047e-8b55-52b8-89d0-099ad071e0f4 with identifier: 1473959
2025-12-03 06:01:50 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 12 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    12
2025-12-03 06:01:50 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: 1110047e-8b55-52b8-89d0-099ad071e0f4 spider: manheim.gb
2025-12-03 06:01:50 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 1110047e-8b55-52b8-89d0-099ad071e0f4 due to rule: registration_date_old.json, error: 12 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    12
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001473959-01976716-004.pdf',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '1.4L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '1110047e-8b55-52b8-89d0-099ad071e0f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'FE13KKR',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/ALFA%20ROMEO/GIULIETTA?id=1473959',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'ALFA ROMEO',
 'model': 'GIULIETTA',
 'odometer': 75006,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-28',
 'seller_name': 'Stellantis & You',
 'title': 'ALFA ROMEO GIULIETTA 1.4 TB MultiAir Lusso 5dr TCT',
 'transmission': 'automatic',
 'trim': '1.4 TB MultiAir Lusso 5dr TCT',
 'year': 2013}
2025-12-03 06:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271473959%27 HTTP/1.1" 200 None
2025-12-03 06:01:50 [manheim.gb] INFO: Saving data for 1473959: {'auction_closing_time': 1764838800.0, 'created_time': 1764584231.801743, 'last_price_update_time': 1764741710.821777}
2025-12-03 06:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1473959') HTTP/1.1" 204 0
2025-12-03 06:01:51 [manheim.gb] INFO: Found listing with ID: 2407950
2025-12-03 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272407950%27 HTTP/1.1" 200 None
2025-12-03 06:01:51 [manheim.gb] INFO: Scrape type for 2407950: 0
2025-12-03 06:01:51 [manheim.gb] INFO: Found listing with ID: 2437613
2025-12-03 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272437613%27 HTTP/1.1" 200 None
2025-12-03 06:01:51 [manheim.gb] INFO: Scrape type for 2437613: 2
2025-12-03 06:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=1479833&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231479833&indx=34> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:01:51 [manheim.gb] INFO: Found listing with ID: 2441700
2025-12-03 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272441700%27 HTTP/1.1" 200 None
2025-12-03 06:01:51 [manheim.gb] INFO: Scrape type for 2441700: 2
2025-12-03 06:01:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:01:51 [manheim.gb] INFO: Found listing with ID: 2443996
2025-12-03 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272443996%27 HTTP/1.1" 200 None
2025-12-03 06:01:51 [manheim.gb] INFO: Scrape type for 2443996: 1
2025-12-03 06:01:51 [manheim.gb] INFO: Found listing with ID: 2458076
2025-12-03 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272458076%27 HTTP/1.1" 200 None
2025-12-03 06:01:51 [manheim.gb] INFO: Scrape type for 2458076: 2
2025-12-03 06:01:51 [manheim.gb] INFO: Found listing with ID: 2461241
2025-12-03 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272461241%27 HTTP/1.1" 200 None
2025-12-03 06:01:51 [manheim.gb] INFO: Scrape type for 2461241: 2
2025-12-03 06:01:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef122e00-3e3f-57a1-86ec-bee4854c2ed3 with identifier: 1479833
2025-12-03 06:01:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef122e00-3e3f-57a1-86ec-bee4854c2ed3 with scrape type 2
2025-12-03 06:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef122e00-3e3f-57a1-86ec-bee4854c2ed3 with scrape type 2
2025-12-03 06:01:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: ef122e00-3e3f-57a1-86ec-bee4854c2ed3, identifier: 1479833
2025-12-03 06:01:51 [manheim.gb] INFO: Found listing with ID: 2512673
2025-12-03 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272512673%27 HTTP/1.1" 200 None
2025-12-03 06:01:51 [manheim.gb] INFO: Scrape type for 2512673: 0
2025-12-03 06:01:51 [manheim.gb] INFO: Found listing with ID: 2528107
2025-12-03 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272528107%27 HTTP/1.1" 200 None
2025-12-03 06:01:51 [manheim.gb] INFO: Scrape type for 2528107: 1
2025-12-03 06:01:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: ef122e00-3e3f-57a1-86ec-bee4854c2ed3 with identifier: 1479833
2025-12-03 06:01:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: ef122e00-3e3f-57a1-86ec-bee4854c2ed3 with identifier: 1479833
2025-12-03 06:01:51 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 10 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    10
2025-12-03 06:01:51 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: ef122e00-3e3f-57a1-86ec-bee4854c2ed3 spider: manheim.gb
2025-12-03 06:01:51 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: ef122e00-3e3f-57a1-86ec-bee4854c2ed3 due to rule: registration_date_old.json, error: 10 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    10
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001479833-01987353-003.pdf',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': '2025-12-05T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'ef122e00-3e3f-57a1-86ec-bee4854c2ed3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'KX15LVN',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=1479833',
 'listing': 'auction',
 'location': 'Birmingham',
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 58109,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-25',
 'seller_name': 'Sandicliffe',
 'title': 'NISSAN QASHQAI 1.2 DiG-T N-Tec 5dr',
 'transmission': 'manual',
 'trim': '1.2 DiG-T N-Tec 5dr',
 'year': 2015}
2025-12-03 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271479833%27 HTTP/1.1" 200 None
2025-12-03 06:01:51 [manheim.gb] INFO: Saving data for 1479833: {'auction_closing_time': 1764925200.0, 'created_time': 1764584239.187783, 'last_price_update_time': 1764741711.738337}
2025-12-03 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1479833') HTTP/1.1" 204 0
2025-12-03 06:01:51 [manheim.gb] INFO: Found listing with ID: 2531448
2025-12-03 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272531448%27 HTTP/1.1" 200 None
2025-12-03 06:01:51 [manheim.gb] INFO: Scrape type for 2531448: 2
2025-12-03 06:01:51 [manheim.gb] INFO: Found listing with ID: 2536974
2025-12-03 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272536974%27 HTTP/1.1" 200 None
2025-12-03 06:01:51 [manheim.gb] INFO: Scrape type for 2536974: 2
2025-12-03 06:01:51 [manheim.gb] INFO: Found listing with ID: 2542025
2025-12-03 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272542025%27 HTTP/1.1" 200 None
2025-12-03 06:01:51 [manheim.gb] INFO: Scrape type for 2542025: 2
2025-12-03 06:01:51 [manheim.gb] INFO: Found listing with ID: 2557325
2025-12-03 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272557325%27 HTTP/1.1" 200 None
2025-12-03 06:01:51 [manheim.gb] INFO: Scrape type for 2557325: 0
2025-12-03 06:01:51 [manheim.gb] INFO: Found listing with ID: 2562472
2025-12-03 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272562472%27 HTTP/1.1" 200 None
2025-12-03 06:01:51 [manheim.gb] INFO: Scrape type for 2562472: 1
2025-12-03 06:01:51 [manheim.gb] INFO: Found listing with ID: 2565829
2025-12-03 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272565829%27 HTTP/1.1" 200 None
2025-12-03 06:01:51 [manheim.gb] INFO: Scrape type for 2565829: 2
2025-12-03 06:01:51 [manheim.gb] INFO: Found listing with ID: 2577653
2025-12-03 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272577653%27 HTTP/1.1" 200 None
2025-12-03 06:01:51 [manheim.gb] INFO: Scrape type for 2577653: 0
2025-12-03 06:01:51 [manheim.gb] INFO: Found listing with ID: 2589156
2025-12-03 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272589156%27 HTTP/1.1" 200 None
2025-12-03 06:01:51 [manheim.gb] INFO: Scrape type for 2589156: 2
2025-12-03 06:01:51 [manheim.gb] INFO: Found listing with ID: 2616439
2025-12-03 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272616439%27 HTTP/1.1" 200 None
2025-12-03 06:01:51 [manheim.gb] INFO: Scrape type for 2616439: 0
2025-12-03 06:01:51 [manheim.gb] INFO: Found listing with ID: 2660446
2025-12-03 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272660446%27 HTTP/1.1" 200 None
2025-12-03 06:01:51 [manheim.gb] INFO: Scrape type for 2660446: 0
2025-12-03 06:01:51 [manheim.gb] INFO: Found listing with ID: 2664010
2025-12-03 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272664010%27 HTTP/1.1" 200 None
2025-12-03 06:01:52 [manheim.gb] INFO: Scrape type for 2664010: 2
2025-12-03 06:01:52 [manheim.gb] INFO: Found listing with ID: 2667513
2025-12-03 06:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272667513%27 HTTP/1.1" 200 None
2025-12-03 06:01:52 [manheim.gb] INFO: Scrape type for 2667513: 2
2025-12-03 06:01:52 [manheim.gb] INFO: Found listing with ID: 2683371
2025-12-03 06:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272683371%27 HTTP/1.1" 200 None
2025-12-03 06:01:52 [manheim.gb] INFO: Scrape type for 2683371: 2
2025-12-03 06:01:52 [manheim.gb] INFO: Found listing with ID: 2688065
2025-12-03 06:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272688065%27 HTTP/1.1" 200 None
2025-12-03 06:01:52 [manheim.gb] INFO: Scrape type for 2688065: 2
2025-12-03 06:01:52 [manheim.gb] INFO: Found listing with ID: 2698793
2025-12-03 06:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272698793%27 HTTP/1.1" 200 None
2025-12-03 06:01:52 [manheim.gb] INFO: Scrape type for 2698793: 0
2025-12-03 06:01:52 [manheim.gb] INFO: Found listing with ID: 2702180
2025-12-03 06:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272702180%27 HTTP/1.1" 200 None
2025-12-03 06:01:52 [manheim.gb] INFO: Scrape type for 2702180: 0
2025-12-03 06:01:52 [manheim.gb] INFO: Found listing with ID: 2702439
2025-12-03 06:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272702439%27 HTTP/1.1" 200 None
2025-12-03 06:01:52 [manheim.gb] INFO: Scrape type for 2702439: 2
2025-12-03 06:01:52 [manheim.gb] INFO: Found listing with ID: 2727315
2025-12-03 06:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272727315%27 HTTP/1.1" 200 None
2025-12-03 06:01:52 [manheim.gb] INFO: Scrape type for 2727315: 2
2025-12-03 06:01:52 [manheim.gb] INFO: Found listing with ID: 2729252
2025-12-03 06:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272729252%27 HTTP/1.1" 200 None
2025-12-03 06:01:52 [manheim.gb] INFO: Scrape type for 2729252: 2
2025-12-03 06:01:52 [manheim.gb] INFO: Found listing with ID: 2752960
2025-12-03 06:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272752960%27 HTTP/1.1" 200 None
2025-12-03 06:01:52 [manheim.gb] INFO: Scrape type for 2752960: 0
2025-12-03 06:01:52 [manheim.gb] INFO: Found listing with ID: 2757523
2025-12-03 06:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272757523%27 HTTP/1.1" 200 None
2025-12-03 06:01:52 [manheim.gb] INFO: Scrape type for 2757523: 2
2025-12-03 06:01:52 [manheim.gb] INFO: Found listing with ID: 2778685
2025-12-03 06:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272778685%27 HTTP/1.1" 200 None
2025-12-03 06:01:52 [manheim.gb] INFO: Scrape type for 2778685: 2
2025-12-03 06:01:52 [manheim.gb] INFO: Found listing with ID: 2803879
2025-12-03 06:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272803879%27 HTTP/1.1" 200 None
2025-12-03 06:01:52 [manheim.gb] INFO: Scrape type for 2803879: 2
2025-12-03 06:01:52 [manheim.gb] INFO: Found listing with ID: 2817812
2025-12-03 06:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272817812%27 HTTP/1.1" 200 None
2025-12-03 06:01:52 [manheim.gb] INFO: Scrape type for 2817812: 0
2025-12-03 06:01:52 [manheim.gb] INFO: Found listing with ID: 2830703
2025-12-03 06:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272830703%27 HTTP/1.1" 200 None
2025-12-03 06:01:52 [manheim.gb] INFO: Scrape type for 2830703: 0
2025-12-03 06:01:52 [manheim.gb] INFO: Found listing with ID: 2837848
2025-12-03 06:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272837848%27 HTTP/1.1" 200 None
2025-12-03 06:01:52 [manheim.gb] INFO: Scrape type for 2837848: 0
2025-12-03 06:01:52 [manheim.gb] INFO: Found listing with ID: 2871207
2025-12-03 06:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272871207%27 HTTP/1.1" 200 None
2025-12-03 06:01:52 [manheim.gb] INFO: Scrape type for 2871207: 2
2025-12-03 06:01:52 [manheim.gb] INFO: Found listing with ID: 2876443
2025-12-03 06:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272876443%27 HTTP/1.1" 200 None
2025-12-03 06:01:52 [manheim.gb] INFO: Scrape type for 2876443: 0
2025-12-03 06:01:52 [manheim.gb] INFO: Found listing with ID: 2891297
2025-12-03 06:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272891297%27 HTTP/1.1" 200 None
2025-12-03 06:01:52 [manheim.gb] INFO: Scrape type for 2891297: 2
2025-12-03 06:01:52 [manheim.gb] INFO: Found listing with ID: 2893691
2025-12-03 06:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272893691%27 HTTP/1.1" 200 None
2025-12-03 06:01:52 [manheim.gb] INFO: Scrape type for 2893691: 2
2025-12-03 06:01:52 [manheim.gb] INFO: Found listing with ID: 2896151
2025-12-03 06:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272896151%27 HTTP/1.1" 200 None
2025-12-03 06:01:52 [manheim.gb] INFO: Scrape type for 2896151: 2
2025-12-03 06:01:52 [manheim.gb] INFO: Found listing with ID: 2907665
2025-12-03 06:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272907665%27 HTTP/1.1" 200 None
2025-12-03 06:01:52 [manheim.gb] INFO: Scrape type for 2907665: 2
2025-12-03 06:01:52 [manheim.gb] INFO: Found listing with ID: 2933109
2025-12-03 06:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272933109%27 HTTP/1.1" 200 None
2025-12-03 06:01:52 [manheim.gb] INFO: Scrape type for 2933109: 0
2025-12-03 06:01:52 [manheim.gb] INFO: Found listing with ID: 2936956
2025-12-03 06:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272936956%27 HTTP/1.1" 200 None
2025-12-03 06:01:52 [manheim.gb] INFO: Scrape type for 2936956: 1
2025-12-03 06:01:52 [manheim.gb] INFO: Found listing with ID: 2939815
2025-12-03 06:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272939815%27 HTTP/1.1" 200 None
2025-12-03 06:01:52 [manheim.gb] INFO: Scrape type for 2939815: 1
2025-12-03 06:01:52 [manheim.gb] INFO: Found listing with ID: 2944079
2025-12-03 06:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272944079%27 HTTP/1.1" 200 None
2025-12-03 06:01:52 [manheim.gb] INFO: Scrape type for 2944079: 1
2025-12-03 06:01:52 [manheim.gb] INFO: Found listing with ID: 2948457
2025-12-03 06:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272948457%27 HTTP/1.1" 200 None
2025-12-03 06:01:52 [manheim.gb] INFO: Scrape type for 2948457: 1
2025-12-03 06:01:52 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field odometer is not nullable
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/manheim.py", line 201, in parse_listings
    scraped_item = self._extract_listing_item(item, expiration_date)
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/manheim.py", line 281, in _extract_listing_item
    item["odometer"] = odometer
    ~~~~^^^^^^^^^^^^
  File "/usr/src/app/crawlers/items.py", line 115, in __setitem__
    raise ValueError(f"Field {key} is not nullable")
ValueError: Field odometer is not nullable
2025-12-03 06:01:52 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field odometer is not nullable
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/manheim.py", line 201, in parse_listings
    scraped_item = self._extract_listing_item(item, expiration_date)
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/manheim.py", line 281, in _extract_listing_item
    item["odometer"] = odometer
    ~~~~^^^^^^^^^^^^
  File "/usr/src/app/crawlers/items.py", line 115, in __setitem__
    raise ValueError(f"Field {key} is not nullable")
ValueError: Field odometer is not nullable
2025-12-03 06:01:52 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field odometer is not nullable
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/manheim.py", line 201, in parse_listings
    scraped_item = self._extract_listing_item(item, expiration_date)
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/manheim.py", line 281, in _extract_listing_item
    item["odometer"] = odometer
    ~~~~^^^^^^^^^^^^
  File "/usr/src/app/crawlers/items.py", line 115, in __setitem__
    raise ValueError(f"Field {key} is not nullable")
ValueError: Field odometer is not nullable
2025-12-03 06:01:53 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field odometer is not nullable
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/manheim.py", line 201, in parse_listings
    scraped_item = self._extract_listing_item(item, expiration_date)
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/manheim.py", line 281, in _extract_listing_item
    item["odometer"] = odometer
    ~~~~^^^^^^^^^^^^
  File "/usr/src/app/crawlers/items.py", line 115, in __setitem__
    raise ValueError(f"Field {key} is not nullable")
ValueError: Field odometer is not nullable
2025-12-03 06:01:53 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field odometer is not nullable
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/manheim.py", line 201, in parse_listings
    scraped_item = self._extract_listing_item(item, expiration_date)
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/manheim.py", line 281, in _extract_listing_item
    item["odometer"] = odometer
    ~~~~^^^^^^^^^^^^
  File "/usr/src/app/crawlers/items.py", line 115, in __setitem__
    raise ValueError(f"Field {key} is not nullable")
ValueError: Field odometer is not nullable
2025-12-03 06:01:53 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field odometer is not nullable
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/manheim.py", line 201, in parse_listings
    scraped_item = self._extract_listing_item(item, expiration_date)
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/manheim.py", line 281, in _extract_listing_item
    item["odometer"] = odometer
    ~~~~^^^^^^^^^^^^
  File "/usr/src/app/crawlers/items.py", line 115, in __setitem__
    raise ValueError(f"Field {key} is not nullable")
ValueError: Field odometer is not nullable
2025-12-03 06:01:53 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field odometer is not nullable
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/manheim.py", line 201, in parse_listings
    scraped_item = self._extract_listing_item(item, expiration_date)
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/manheim.py", line 281, in _extract_listing_item
    item["odometer"] = odometer
    ~~~~^^^^^^^^^^^^
  File "/usr/src/app/crawlers/items.py", line 115, in __setitem__
    raise ValueError(f"Field {key} is not nullable")
ValueError: Field odometer is not nullable
2025-12-03 06:01:53 [scrapy.core.scraper] ERROR: Spider error processing <POST https://www.manheim.co.uk/search/refine> (referer: https://www.manheim.co.uk/search)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 295, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 374, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 355, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 374, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 355, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy_zyte_api/_middlewares.py", line 206, in process_spider_output_async
    async for item_or_request in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/manheim.py", line 201, in parse_listings
    scraped_item = self._extract_listing_item(item, expiration_date)
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/manheim.py", line 281, in _extract_listing_item
    item["odometer"] = odometer
    ~~~~^^^^^^^^^^^^
  File "/usr/src/app/crawlers/items.py", line 115, in __setitem__
    raise ValueError(f"Field {key} is not nullable")
ValueError: Field odometer is not nullable
2025-12-03 06:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/LAND%20ROVER/RANGEROVER?id=1490428&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231490428&indx=36> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:01:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:01:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33580bbc-f4fb-5453-afca-06c1a06e06fa with identifier: 1490428
2025-12-03 06:01:54 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 33580bbc-f4fb-5453-afca-06c1a06e06fa
2025-12-03 06:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/BMW/1SERIES?id=149524&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%23149524&indx=37> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:01:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:01:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 626f6545-94a5-5d6d-9741-423e0759ebb8 with identifier: 149524
2025-12-03 06:01:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 626f6545-94a5-5d6d-9741-423e0759ebb8 with scrape type 2
2025-12-03 06:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 626f6545-94a5-5d6d-9741-423e0759ebb8 with scrape type 2
2025-12-03 06:01:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 626f6545-94a5-5d6d-9741-423e0759ebb8, identifier: 149524
2025-12-03 06:01:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 626f6545-94a5-5d6d-9741-423e0759ebb8 with identifier: 149524
2025-12-03 06:01:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 626f6545-94a5-5d6d-9741-423e0759ebb8 with identifier: 149524
2025-12-03 06:01:55 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 0, 'seller_name': 'ocean bmw', 'price_includes_vat': False, 'title': 'bmw 1 series 118d m sport 5dr', 'price': 0, 'currency': 'gbp', 'make': 'bmw', 'model': '1 series', 'transmission': 'manual', 'engine': '2.0l', 'fuel_type': 'diesel', 'odometer': 124519, 'odometer_reading_unit': 'mi', 'registration_date': '2014-08-05', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/bmw/1%20series?id=149524', 'location': 'plymouth', 'origin_country_code': 'gb', 'trim': '118d m sport 5dr', 'license_plate': 'yl14npk', 'year': 2014, 'listing': 'auction', 'c_o_2_emission_value': 115, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0000149524-01984418-005.pdf', 'expiration_date': '2025-12-03t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': '626f6545-94a5-5d6d-9741-423e0759ebb8', 'current_year_diff': 11, 'age_in_months': 135, 'make_model': 'bmw 1 series', 'sanitized_make': 'bmw', 'odometer_in_km': 200393}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 135,
     'auction_title': '',
     'c_o_2_emission_value': 115,
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0000149524-01984418-005.pdf',
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 11,
     'engine': '2.0l',
     'expiration_date': '2025-12-03t09:00:00z',
     'fuel_type': 'diesel',
     'id': '626f6545-94a5-5d6d-9741-423e0759ebb8',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'yl14npk',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/bmw/1%20series?id=149524',
     'listing': 'auction',
     'location': 'plymouth',
     'make': 'bmw',
     'make_model': 'bmw 1 series',
     'model': '1 series',
     'odometer': 124519,
     'odometer_in_km': 200393,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2014-08-05',
     'sanitized_make': 'bmw',
     'seller_name': 'ocean bmw',
     'title': 'bmw 1 series 118d m sport 5dr',
     'transmission': 'manual',
     'trim': '118d m sport 5dr',
     'year': 2014}
2025-12-03 06:01:55 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 626f6545-94a5-5d6d-9741-423e0759ebb8 spider: manheim.gb
2025-12-03 06:01:55 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 626f6545-94a5-5d6d-9741-423e0759ebb8 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 0, 'seller_name': 'ocean bmw', 'price_includes_vat': False, 'title': 'bmw 1 series 118d m sport 5dr', 'price': 0, 'currency': 'gbp', 'make': 'bmw', 'model': '1 series', 'transmission': 'manual', 'engine': '2.0l', 'fuel_type': 'diesel', 'odometer': 124519, 'odometer_reading_unit': 'mi', 'registration_date': '2014-08-05', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/bmw/1%20series?id=149524', 'location': 'plymouth', 'origin_country_code': 'gb', 'trim': '118d m sport 5dr', 'license_plate': 'yl14npk', 'year': 2014, 'listing': 'auction', 'c_o_2_emission_value': 115, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0000149524-01984418-005.pdf', 'expiration_date': '2025-12-03t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': '626f6545-94a5-5d6d-9741-423e0759ebb8', 'current_year_diff': 11, 'age_in_months': 135, 'make_model': 'bmw 1 series', 'sanitized_make': 'bmw', 'odometer_in_km': 200393}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 135,
     'auction_title': '',
     'c_o_2_emission_value': 115,
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0000149524-01984418-005.pdf',
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 11,
     'engine': '2.0l',
     'expiration_date': '2025-12-03t09:00:00z',
     'fuel_type': 'diesel',
     'id': '626f6545-94a5-5d6d-9741-423e0759ebb8',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'yl14npk',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/bmw/1%20series?id=149524',
     'listing': 'auction',
     'location': 'plymouth',
     'make': 'bmw',
     'make_model': 'bmw 1 series',
     'model': '1 series',
     'odometer': 124519,
     'odometer_in_km': 200393,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2014-08-05',
     'sanitized_make': 'bmw',
     'seller_name': 'ocean bmw',
     'title': 'bmw 1 series 118d m sport 5dr',
     'transmission': 'manual',
     'trim': '118d m sport 5dr',
     'year': 2014}
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0000149524-01984418-005.pdf',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': '2025-12-03T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '626f6545-94a5-5d6d-9741-423e0759ebb8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'YL14NPK',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/BMW/1%20SERIES?id=149524',
 'listing': 'auction',
 'location': 'Plymouth',
 'make': 'BMW',
 'model': '1 SERIES',
 'odometer': 124519,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-05',
 'seller_name': 'Ocean BMW',
 'title': 'BMW 1 SERIES 118d M Sport 5dr',
 'transmission': 'manual',
 'trim': '118d M Sport 5dr',
 'year': 2014}
2025-12-03 06:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27149524%27 HTTP/1.1" 200 None
2025-12-03 06:01:55 [manheim.gb] INFO: Saving data for 149524: {'auction_closing_time': 1764752400.0, 'created_time': 1764584178.768042, 'last_price_update_time': 1764741715.366498}
2025-12-03 06:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='149524') HTTP/1.1" 204 0
2025-12-03 06:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0001490428-01986223-002.pdf> (referer: None)
2025-12-03 06:01:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:01:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:01:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:01:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6055b90>
2025-12-03 06:01:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:01:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33580bbc-f4fb-5453-afca-06c1a06e06fa/33580bbc-f4fb-5453-afca-06c1a06e06fa_expert_report_file_37443c73-5667-4566-b727-88262073ea94.pdf HTTP/1.1" 201 0
2025-12-03 06:01:56 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 33580bbc-f4fb-5453-afca-06c1a06e06fa
2025-12-03 06:01:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 33580bbc-f4fb-5453-afca-06c1a06e06fa, skipping ID generation
2025-12-03 06:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 33580bbc-f4fb-5453-afca-06c1a06e06fa
2025-12-03 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F60d8ddb8-52a8-41c1-9946-ea66b39cd52f_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/60d8ddb8-52a8-41c1-9946-ea66b39cd52f_ext_7.jpg not downloaded yet
2025-12-03 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F60d8ddb8-52a8-41c1-9946-ea66b39cd52f_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/60d8ddb8-52a8-41c1-9946-ea66b39cd52f_ext_7.jpg not downloaded yet
2025-12-03 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F60d8ddb8-52a8-41c1-9946-ea66b39cd52f_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/60d8ddb8-52a8-41c1-9946-ea66b39cd52f_ext_6.jpg not downloaded yet
2025-12-03 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F60d8ddb8-52a8-41c1-9946-ea66b39cd52f_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/60d8ddb8-52a8-41c1-9946-ea66b39cd52f_ext_1.jpg not downloaded yet
2025-12-03 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F60d8ddb8-52a8-41c1-9946-ea66b39cd52f_5.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/60d8ddb8-52a8-41c1-9946-ea66b39cd52f_5.jpg not downloaded yet
2025-12-03 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F60d8ddb8-52a8-41c1-9946-ea66b39cd52f_4.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/60d8ddb8-52a8-41c1-9946-ea66b39cd52f_4.jpg not downloaded yet
2025-12-03 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F60d8ddb8-52a8-41c1-9946-ea66b39cd52f_11.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/60d8ddb8-52a8-41c1-9946-ea66b39cd52f_11.jpg not downloaded yet
2025-12-03 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F60d8ddb8-52a8-41c1-9946-ea66b39cd52f_10.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/60d8ddb8-52a8-41c1-9946-ea66b39cd52f_10.jpg not downloaded yet
2025-12-03 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F60d8ddb8-52a8-41c1-9946-ea66b39cd52f_9.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/60d8ddb8-52a8-41c1-9946-ea66b39cd52f_9.jpg not downloaded yet
2025-12-03 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F60d8ddb8-52a8-41c1-9946-ea66b39cd52f_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/60d8ddb8-52a8-41c1-9946-ea66b39cd52f_ext_2.jpg not downloaded yet
2025-12-03 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F60d8ddb8-52a8-41c1-9946-ea66b39cd52f_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/60d8ddb8-52a8-41c1-9946-ea66b39cd52f_ext_5.jpg not downloaded yet
2025-12-03 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F60d8ddb8-52a8-41c1-9946-ea66b39cd52f_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/60d8ddb8-52a8-41c1-9946-ea66b39cd52f_ext_3.jpg not downloaded yet
2025-12-03 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F60d8ddb8-52a8-41c1-9946-ea66b39cd52f_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/60d8ddb8-52a8-41c1-9946-ea66b39cd52f_ext_4.jpg not downloaded yet
2025-12-03 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1490428-4004918-13.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1490428-4004918-13.jpg not downloaded yet
2025-12-03 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1490428-4004918-1000.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1490428-4004918-1000.jpg not downloaded yet
2025-12-03 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1490428-4004918-1001.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1490428-4004918-1001.jpg not downloaded yet
2025-12-03 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1490428-4004918-1002.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1490428-4004918-1002.jpg not downloaded yet
2025-12-03 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1490428-4004918-1003.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1490428-4004918-1003.jpg not downloaded yet
2025-12-03 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1490428-4004918-1004.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1490428-4004918-1004.jpg not downloaded yet
2025-12-03 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1490428-4004918-1005.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1490428-4004918-1005.jpg not downloaded yet
2025-12-03 06:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1490428-4004918-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001490428-01986223-002.pdf)
2025-12-03 06:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/DS/DS4?id=1541191&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231541191&indx=41> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:01:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:01:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:01:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f5b736d0>
2025-12-03 06:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:01:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33580bbc-f4fb-5453-afca-06c1a06e06fa/33580bbc-f4fb-5453-afca-06c1a06e06fa_image_19.jpg HTTP/1.1" 201 0
2025-12-03 06:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1490428-4004918-1005.jpg') HTTP/1.1" 204 0
2025-12-03 06:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1490428-4004918-1005.jpg saved to cache
2025-12-03 06:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 33580bbc-f4fb-5453-afca-06c1a06e06fa
2025-12-03 06:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1490428-4004918-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001490428-01986223-002.pdf)
2025-12-03 06:01:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f9cc0f6-8f1c-550d-a3b4-e095cb0e8c4d with identifier: 1541191
2025-12-03 06:01:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f9cc0f6-8f1c-550d-a3b4-e095cb0e8c4d with scrape type 2
2025-12-03 06:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f9cc0f6-8f1c-550d-a3b4-e095cb0e8c4d with scrape type 2
2025-12-03 06:01:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 7f9cc0f6-8f1c-550d-a3b4-e095cb0e8c4d, identifier: 1541191
2025-12-03 06:01:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 7f9cc0f6-8f1c-550d-a3b4-e095cb0e8c4d with identifier: 1541191
2025-12-03 06:01:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 7f9cc0f6-8f1c-550d-a3b4-e095cb0e8c4d with identifier: 1541191
2025-12-03 06:01:57 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 7f9cc0f6-8f1c-550d-a3b4-e095cb0e8c4d with identifier: 1541191 to the API
2025-12-03 06:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 06:01:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 06:01:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/DS/DS4?id=1541191&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231541191&indx=41>
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001541191-01986958-004.pdf',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '7f9cc0f6-8f1c-550d-a3b4-e095cb0e8c4d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'NU16RKE',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/DS/DS%204?id=1541191',
 'listing': 'auction',
 'location': 'Shotts',
 'make': 'DS',
 'model': 'DS 4',
 'odometer': 79280,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-16',
 'seller_name': 'Parks Motor Group',
 'title': 'DS DS 4 1.6 BlueHDi Prestige 5dr',
 'transmission': 'manual',
 'trim': '1.6 BlueHDi Prestige 5dr',
 'year': 2016}
2025-12-03 06:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271541191%27 HTTP/1.1" 200 None
2025-12-03 06:01:58 [manheim.gb] INFO: Saving data for 1541191: {'auction_closing_time': 1764838800.0, 'created_time': 1764584185.261476, 'last_price_update_time': 1764741718.042909}
2025-12-03 06:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1541191') HTTP/1.1" 204 0
2025-12-03 06:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1490428-4004918-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001490428-01986223-002.pdf)
2025-12-03 06:01:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:01:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f614f610>
2025-12-03 06:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:01:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33580bbc-f4fb-5453-afca-06c1a06e06fa/33580bbc-f4fb-5453-afca-06c1a06e06fa_image_18.jpg HTTP/1.1" 201 0
2025-12-03 06:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1490428-4004918-1004.jpg') HTTP/1.1" 204 0
2025-12-03 06:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1490428-4004918-1004.jpg saved to cache
2025-12-03 06:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 33580bbc-f4fb-5453-afca-06c1a06e06fa
2025-12-03 06:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1490428-4004918-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001490428-01986223-002.pdf)
2025-12-03 06:01:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:01:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6143550>
2025-12-03 06:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:01:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33580bbc-f4fb-5453-afca-06c1a06e06fa/33580bbc-f4fb-5453-afca-06c1a06e06fa_image_17.jpg HTTP/1.1" 201 0
2025-12-03 06:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1490428-4004918-1003.jpg') HTTP/1.1" 204 0
2025-12-03 06:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1490428-4004918-1003.jpg saved to cache
2025-12-03 06:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 33580bbc-f4fb-5453-afca-06c1a06e06fa
2025-12-03 06:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1490428-4004918-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001490428-01986223-002.pdf)
2025-12-03 06:01:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:01:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:01:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:01:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f5b736d0>
2025-12-03 06:01:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:01:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 06:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:01:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33580bbc-f4fb-5453-afca-06c1a06e06fa/33580bbc-f4fb-5453-afca-06c1a06e06fa_image_16.jpg HTTP/1.1" 201 0
2025-12-03 06:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1490428-4004918-1002.jpg') HTTP/1.1" 204 0
2025-12-03 06:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1490428-4004918-1002.jpg saved to cache
2025-12-03 06:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 33580bbc-f4fb-5453-afca-06c1a06e06fa
2025-12-03 06:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1490428-4004918-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001490428-01986223-002.pdf)
2025-12-03 06:01:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:01:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:01:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:01:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f605c790>
2025-12-03 06:01:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:01:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:01:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33580bbc-f4fb-5453-afca-06c1a06e06fa/33580bbc-f4fb-5453-afca-06c1a06e06fa_image_15.jpg HTTP/1.1" 201 0
2025-12-03 06:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1490428-4004918-1001.jpg') HTTP/1.1" 204 0
2025-12-03 06:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1490428-4004918-1001.jpg saved to cache
2025-12-03 06:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 33580bbc-f4fb-5453-afca-06c1a06e06fa
2025-12-03 06:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/60d8ddb8-52a8-41c1-9946-ea66b39cd52f_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001490428-01986223-002.pdf)
2025-12-03 06:01:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:01:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:01:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:01:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f614f310>
2025-12-03 06:01:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:02:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 06:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33580bbc-f4fb-5453-afca-06c1a06e06fa/33580bbc-f4fb-5453-afca-06c1a06e06fa_image_14.jpg HTTP/1.1" 201 0
2025-12-03 06:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1490428-4004918-1000.jpg') HTTP/1.1" 204 0
2025-12-03 06:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1490428-4004918-1000.jpg saved to cache
2025-12-03 06:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 33580bbc-f4fb-5453-afca-06c1a06e06fa
2025-12-03 06:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1490428-4004918-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001490428-01986223-002.pdf)
2025-12-03 06:02:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:02:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f62ea750>
2025-12-03 06:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:02:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33580bbc-f4fb-5453-afca-06c1a06e06fa/33580bbc-f4fb-5453-afca-06c1a06e06fa_image_12.jpg HTTP/1.1" 201 0
2025-12-03 06:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F60d8ddb8-52a8-41c1-9946-ea66b39cd52f_ext_4.jpg') HTTP/1.1" 204 0
2025-12-03 06:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/60d8ddb8-52a8-41c1-9946-ea66b39cd52f_ext_4.jpg saved to cache
2025-12-03 06:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 33580bbc-f4fb-5453-afca-06c1a06e06fa
2025-12-03 06:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/60d8ddb8-52a8-41c1-9946-ea66b39cd52f_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001490428-01986223-002.pdf)
2025-12-03 06:02:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:02:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f628b250>
2025-12-03 06:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:02:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33580bbc-f4fb-5453-afca-06c1a06e06fa/33580bbc-f4fb-5453-afca-06c1a06e06fa_image_13.jpg HTTP/1.1" 201 0
2025-12-03 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1490428-4004918-13.jpg') HTTP/1.1" 204 0
2025-12-03 06:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1490428-4004918-13.jpg saved to cache
2025-12-03 06:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 33580bbc-f4fb-5453-afca-06c1a06e06fa
2025-12-03 06:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/60d8ddb8-52a8-41c1-9946-ea66b39cd52f_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001490428-01986223-002.pdf)
2025-12-03 06:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/60d8ddb8-52a8-41c1-9946-ea66b39cd52f_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001490428-01986223-002.pdf)
2025-12-03 06:02:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:02:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6112410>
2025-12-03 06:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:02:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33580bbc-f4fb-5453-afca-06c1a06e06fa/33580bbc-f4fb-5453-afca-06c1a06e06fa_image_11.jpg HTTP/1.1" 201 0
2025-12-03 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F60d8ddb8-52a8-41c1-9946-ea66b39cd52f_ext_3.jpg') HTTP/1.1" 204 0
2025-12-03 06:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/60d8ddb8-52a8-41c1-9946-ea66b39cd52f_ext_3.jpg saved to cache
2025-12-03 06:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 33580bbc-f4fb-5453-afca-06c1a06e06fa
2025-12-03 06:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/BMW/2SERIES?id=1501704&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231501704&indx=39> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:02:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:02:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:02:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f61ce550>
2025-12-03 06:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:02:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 06:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33580bbc-f4fb-5453-afca-06c1a06e06fa/33580bbc-f4fb-5453-afca-06c1a06e06fa_image_10.jpg HTTP/1.1" 201 0
2025-12-03 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F60d8ddb8-52a8-41c1-9946-ea66b39cd52f_ext_5.jpg') HTTP/1.1" 204 0
2025-12-03 06:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/60d8ddb8-52a8-41c1-9946-ea66b39cd52f_ext_5.jpg saved to cache
2025-12-03 06:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 33580bbc-f4fb-5453-afca-06c1a06e06fa
2025-12-03 06:02:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:02:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f5b436d0>
2025-12-03 06:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:02:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 06:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33580bbc-f4fb-5453-afca-06c1a06e06fa/33580bbc-f4fb-5453-afca-06c1a06e06fa_image_9.jpg HTTP/1.1" 201 0
2025-12-03 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F60d8ddb8-52a8-41c1-9946-ea66b39cd52f_ext_2.jpg') HTTP/1.1" 204 0
2025-12-03 06:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/60d8ddb8-52a8-41c1-9946-ea66b39cd52f_ext_2.jpg saved to cache
2025-12-03 06:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 33580bbc-f4fb-5453-afca-06c1a06e06fa
2025-12-03 06:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/60d8ddb8-52a8-41c1-9946-ea66b39cd52f_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001490428-01986223-002.pdf)
2025-12-03 06:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/60d8ddb8-52a8-41c1-9946-ea66b39cd52f_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001490428-01986223-002.pdf)
2025-12-03 06:02:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b648cc7e-d78f-531d-9ab6-03fcb9a5c6f4 with identifier: 1501704
2025-12-03 06:02:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b648cc7e-d78f-531d-9ab6-03fcb9a5c6f4 with scrape type 2
2025-12-03 06:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b648cc7e-d78f-531d-9ab6-03fcb9a5c6f4 with scrape type 2
2025-12-03 06:02:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: b648cc7e-d78f-531d-9ab6-03fcb9a5c6f4, identifier: 1501704
2025-12-03 06:02:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: b648cc7e-d78f-531d-9ab6-03fcb9a5c6f4 with identifier: 1501704
2025-12-03 06:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-03 06:02:02 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Silver HTTP/1.1" 200 None
2025-12-03 06:02:02 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-03 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-03 06:02:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: b648cc7e-d78f-531d-9ab6-03fcb9a5c6f4 with identifier: 1501704
2025-12-03 06:02:02 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 10 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    10
2025-12-03 06:02:02 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: b648cc7e-d78f-531d-9ab6-03fcb9a5c6f4 spider: manheim.gb
2025-12-03 06:02:02 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: b648cc7e-d78f-531d-9ab6-03fcb9a5c6f4 due to rule: registration_date_old.json, error: 10 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    10
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001501704-01955830-003.pdf',
 'color': 'Silver',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'b648cc7e-d78f-531d-9ab6-03fcb9a5c6f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'LF15UMM',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/BMW/2%20SERIES?id=1501704',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'BMW',
 'model': '2 SERIES',
 'odometer': 44800,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-17',
 'seller_name': 'Lookers',
 'title': 'BMW 2 SERIES 220i Sport 2dr',
 'transmission': 'manual',
 'trim': '220i Sport 2dr',
 'year': 2015}
2025-12-03 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271501704%27 HTTP/1.1" 200 None
2025-12-03 06:02:02 [manheim.gb] INFO: Saving data for 1501704: {'auction_closing_time': 1764838800.0, 'created_time': 1764584157.927598, 'last_price_update_time': 1764741722.794442}
2025-12-03 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1501704') HTTP/1.1" 204 0
2025-12-03 06:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/60d8ddb8-52a8-41c1-9946-ea66b39cd52f_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001490428-01986223-002.pdf)
2025-12-03 06:02:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:02:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6044550>
2025-12-03 06:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:02:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33580bbc-f4fb-5453-afca-06c1a06e06fa/33580bbc-f4fb-5453-afca-06c1a06e06fa_image_7.jpg HTTP/1.1" 201 0
2025-12-03 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F60d8ddb8-52a8-41c1-9946-ea66b39cd52f_10.jpg') HTTP/1.1" 204 0
2025-12-03 06:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/60d8ddb8-52a8-41c1-9946-ea66b39cd52f_10.jpg saved to cache
2025-12-03 06:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 33580bbc-f4fb-5453-afca-06c1a06e06fa
2025-12-03 06:02:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:02:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f611f810>
2025-12-03 06:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:02:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 06:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33580bbc-f4fb-5453-afca-06c1a06e06fa/33580bbc-f4fb-5453-afca-06c1a06e06fa_image_8.jpg HTTP/1.1" 201 0
2025-12-03 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F60d8ddb8-52a8-41c1-9946-ea66b39cd52f_9.jpg') HTTP/1.1" 204 0
2025-12-03 06:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/60d8ddb8-52a8-41c1-9946-ea66b39cd52f_9.jpg saved to cache
2025-12-03 06:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 33580bbc-f4fb-5453-afca-06c1a06e06fa
2025-12-03 06:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/60d8ddb8-52a8-41c1-9946-ea66b39cd52f_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001490428-01986223-002.pdf)
2025-12-03 06:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/60d8ddb8-52a8-41c1-9946-ea66b39cd52f_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001490428-01986223-002.pdf)
2025-12-03 06:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/CITROEN/C4CACTUS?id=1554861&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231554861&indx=43> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:02:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:02:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:02:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f61436d0>
2025-12-03 06:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:02:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33580bbc-f4fb-5453-afca-06c1a06e06fa/33580bbc-f4fb-5453-afca-06c1a06e06fa_image_6.jpg HTTP/1.1" 201 0
2025-12-03 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F60d8ddb8-52a8-41c1-9946-ea66b39cd52f_11.jpg') HTTP/1.1" 204 0
2025-12-03 06:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/60d8ddb8-52a8-41c1-9946-ea66b39cd52f_11.jpg saved to cache
2025-12-03 06:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 33580bbc-f4fb-5453-afca-06c1a06e06fa
2025-12-03 06:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/60d8ddb8-52a8-41c1-9946-ea66b39cd52f_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001490428-01986223-002.pdf)
2025-12-03 06:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/60d8ddb8-52a8-41c1-9946-ea66b39cd52f_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001490428-01986223-002.pdf)
2025-12-03 06:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/60d8ddb8-52a8-41c1-9946-ea66b39cd52f_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001490428-01986223-002.pdf)
2025-12-03 06:02:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:02:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f61db6d0>
2025-12-03 06:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:02:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33580bbc-f4fb-5453-afca-06c1a06e06fa/33580bbc-f4fb-5453-afca-06c1a06e06fa_image_5.jpg HTTP/1.1" 201 0
2025-12-03 06:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F60d8ddb8-52a8-41c1-9946-ea66b39cd52f_4.jpg') HTTP/1.1" 204 0
2025-12-03 06:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/60d8ddb8-52a8-41c1-9946-ea66b39cd52f_4.jpg saved to cache
2025-12-03 06:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 33580bbc-f4fb-5453-afca-06c1a06e06fa
2025-12-03 06:02:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:02:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f63f4250>
2025-12-03 06:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:02:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33580bbc-f4fb-5453-afca-06c1a06e06fa/33580bbc-f4fb-5453-afca-06c1a06e06fa_image_4.jpg HTTP/1.1" 201 0
2025-12-03 06:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F60d8ddb8-52a8-41c1-9946-ea66b39cd52f_5.jpg') HTTP/1.1" 204 0
2025-12-03 06:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/60d8ddb8-52a8-41c1-9946-ea66b39cd52f_5.jpg saved to cache
2025-12-03 06:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 33580bbc-f4fb-5453-afca-06c1a06e06fa
2025-12-03 06:02:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 789df230-e172-576e-8848-8f3b6a643b2d with identifier: 1554861
2025-12-03 06:02:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 789df230-e172-576e-8848-8f3b6a643b2d with scrape type 2
2025-12-03 06:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 789df230-e172-576e-8848-8f3b6a643b2d with scrape type 2
2025-12-03 06:02:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 789df230-e172-576e-8848-8f3b6a643b2d, identifier: 1554861
2025-12-03 06:02:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 789df230-e172-576e-8848-8f3b6a643b2d with identifier: 1554861
2025-12-03 06:02:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 789df230-e172-576e-8848-8f3b6a643b2d with identifier: 1554861
2025-12-03 06:02:04 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 175047 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    175047
2025-12-03 06:02:04 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 789df230-e172-576e-8848-8f3b6a643b2d spider: manheim.gb
2025-12-03 06:02:04 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 789df230-e172-576e-8848-8f3b6a643b2d due to rule: high_mileage_for_country.json, error: 175047 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    175047
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001554861-01978269-002.pdf',
 'color': 'White',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': '2025-12-03T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '789df230-e172-576e-8848-8f3b6a643b2d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'PJ16VYT',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/CITROEN/C4%20CACTUS?id=1554861',
 'listing': 'auction',
 'location': 'Birmingham',
 'make': 'CITROEN',
 'model': 'C4 CACTUS',
 'odometer': 108770,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-29',
 'seller_name': 'J T Hughes LTD',
 'title': 'CITROEN C4 CACTUS 1.2 PureTech [82] Feel 5dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech [82] Feel 5dr',
 'year': 2016}
2025-12-03 06:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271554861%27 HTTP/1.1" 200 None
2025-12-03 06:02:05 [manheim.gb] INFO: Saving data for 1554861: {'auction_closing_time': 1764752400.0, 'created_time': 1764584186.68865, 'last_price_update_time': 1764741725.005512}
2025-12-03 06:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1554861') HTTP/1.1" 204 0
2025-12-03 06:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/60d8ddb8-52a8-41c1-9946-ea66b39cd52f_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001490428-01986223-002.pdf)
2025-12-03 06:02:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:02:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6249b10>
2025-12-03 06:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:02:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 06:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33580bbc-f4fb-5453-afca-06c1a06e06fa/33580bbc-f4fb-5453-afca-06c1a06e06fa_image_3.jpg HTTP/1.1" 201 0
2025-12-03 06:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F60d8ddb8-52a8-41c1-9946-ea66b39cd52f_ext_1.jpg') HTTP/1.1" 204 0
2025-12-03 06:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/60d8ddb8-52a8-41c1-9946-ea66b39cd52f_ext_1.jpg saved to cache
2025-12-03 06:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 33580bbc-f4fb-5453-afca-06c1a06e06fa
2025-12-03 06:02:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:02:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f61048d0>
2025-12-03 06:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:02:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33580bbc-f4fb-5453-afca-06c1a06e06fa/33580bbc-f4fb-5453-afca-06c1a06e06fa_image_2.jpg HTTP/1.1" 201 0
2025-12-03 06:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F60d8ddb8-52a8-41c1-9946-ea66b39cd52f_ext_6.jpg') HTTP/1.1" 204 0
2025-12-03 06:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/60d8ddb8-52a8-41c1-9946-ea66b39cd52f_ext_6.jpg saved to cache
2025-12-03 06:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 33580bbc-f4fb-5453-afca-06c1a06e06fa
2025-12-03 06:02:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:02:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6022090>
2025-12-03 06:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:02:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 06:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33580bbc-f4fb-5453-afca-06c1a06e06fa/33580bbc-f4fb-5453-afca-06c1a06e06fa_image_1.jpg HTTP/1.1" 201 0
2025-12-03 06:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F60d8ddb8-52a8-41c1-9946-ea66b39cd52f_ext_7.jpg') HTTP/1.1" 204 0
2025-12-03 06:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/60d8ddb8-52a8-41c1-9946-ea66b39cd52f_ext_7.jpg saved to cache
2025-12-03 06:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 33580bbc-f4fb-5453-afca-06c1a06e06fa
2025-12-03 06:02:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:02:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6113610>
2025-12-03 06:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:02:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33580bbc-f4fb-5453-afca-06c1a06e06fa/33580bbc-f4fb-5453-afca-06c1a06e06fa_image_0.jpg HTTP/1.1" 201 0
2025-12-03 06:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F60d8ddb8-52a8-41c1-9946-ea66b39cd52f_ext_7.jpg') HTTP/1.1" 204 0
2025-12-03 06:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/60d8ddb8-52a8-41c1-9946-ea66b39cd52f_ext_7.jpg saved to cache
2025-12-03 06:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 33580bbc-f4fb-5453-afca-06c1a06e06fa
2025-12-03 06:02:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 33580bbc-f4fb-5453-afca-06c1a06e06fa, skipping ID generation
2025-12-03 06:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 33580bbc-f4fb-5453-afca-06c1a06e06fa from tracking dictionaries
2025-12-03 06:02:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 33580bbc-f4fb-5453-afca-06c1a06e06fa sending to next pipeline
2025-12-03 06:02:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 33580bbc-f4fb-5453-afca-06c1a06e06fa, identifier: 1490428
2025-12-03 06:02:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 33580bbc-f4fb-5453-afca-06c1a06e06fa with identifier: 1490428
2025-12-03 06:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-03 06:02:06 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=BLACK HTTP/1.1" 200 None
2025-12-03 06:02:06 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-03 06:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-03 06:02:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 33580bbc-f4fb-5453-afca-06c1a06e06fa with identifier: 1490428
2025-12-03 06:02:06 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 168095 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    168095
2025-12-03 06:02:06 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 33580bbc-f4fb-5453-afca-06c1a06e06fa spider: manheim.gb
2025-12-03 06:02:07 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 33580bbc-f4fb-5453-afca-06c1a06e06fa due to rule: high_mileage_for_country.json, error: 168095 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    168095
{'auction_title': '',
 'c_o_2_emission_value': 253,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33580bbc-f4fb-5453-afca-06c1a06e06fa/33580bbc-f4fb-5453-afca-06c1a06e06fa_expert_report_file_37443c73-5667-4566-b727-88262073ea94.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001490428-01986223-002.pdf',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '4.4L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '33580bbc-f4fb-5453-afca-06c1a06e06fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'NU12DLF',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/LAND%20ROVER/RANGE%20ROVER?id=1490428',
 'listing': 'auction',
 'location': 'Leeds',
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER',
 'odometer': 104450,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 41,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33580bbc-f4fb-5453-afca-06c1a06e06fa/33580bbc-f4fb-5453-afca-06c1a06e06fa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 214664,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/60d8ddb8-52a8-41c1-9946-ea66b39cd52f_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33580bbc-f4fb-5453-afca-06c1a06e06fa/33580bbc-f4fb-5453-afca-06c1a06e06fa_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 214664,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/60d8ddb8-52a8-41c1-9946-ea66b39cd52f_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33580bbc-f4fb-5453-afca-06c1a06e06fa/33580bbc-f4fb-5453-afca-06c1a06e06fa_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 228262,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/60d8ddb8-52a8-41c1-9946-ea66b39cd52f_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33580bbc-f4fb-5453-afca-06c1a06e06fa/33580bbc-f4fb-5453-afca-06c1a06e06fa_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 166009,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/60d8ddb8-52a8-41c1-9946-ea66b39cd52f_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33580bbc-f4fb-5453-afca-06c1a06e06fa/33580bbc-f4fb-5453-afca-06c1a06e06fa_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 204297,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/60d8ddb8-52a8-41c1-9946-ea66b39cd52f_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33580bbc-f4fb-5453-afca-06c1a06e06fa/33580bbc-f4fb-5453-afca-06c1a06e06fa_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 214906,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/60d8ddb8-52a8-41c1-9946-ea66b39cd52f_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33580bbc-f4fb-5453-afca-06c1a06e06fa/33580bbc-f4fb-5453-afca-06c1a06e06fa_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 204171,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/60d8ddb8-52a8-41c1-9946-ea66b39cd52f_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33580bbc-f4fb-5453-afca-06c1a06e06fa/33580bbc-f4fb-5453-afca-06c1a06e06fa_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 218637,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/60d8ddb8-52a8-41c1-9946-ea66b39cd52f_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33580bbc-f4fb-5453-afca-06c1a06e06fa/33580bbc-f4fb-5453-afca-06c1a06e06fa_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 235432,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/60d8ddb8-52a8-41c1-9946-ea66b39cd52f_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33580bbc-f4fb-5453-afca-06c1a06e06fa/33580bbc-f4fb-5453-afca-06c1a06e06fa_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 233861,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/60d8ddb8-52a8-41c1-9946-ea66b39cd52f_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33580bbc-f4fb-5453-afca-06c1a06e06fa/33580bbc-f4fb-5453-afca-06c1a06e06fa_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 210198,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/60d8ddb8-52a8-41c1-9946-ea66b39cd52f_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33580bbc-f4fb-5453-afca-06c1a06e06fa/33580bbc-f4fb-5453-afca-06c1a06e06fa_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 185730,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/60d8ddb8-52a8-41c1-9946-ea66b39cd52f_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33580bbc-f4fb-5453-afca-06c1a06e06fa/33580bbc-f4fb-5453-afca-06c1a06e06fa_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 124869,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/60d8ddb8-52a8-41c1-9946-ea66b39cd52f_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33580bbc-f4fb-5453-afca-06c1a06e06fa/33580bbc-f4fb-5453-afca-06c1a06e06fa_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 373826,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1490428-4004918-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33580bbc-f4fb-5453-afca-06c1a06e06fa/33580bbc-f4fb-5453-afca-06c1a06e06fa_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 320440,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1490428-4004918-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33580bbc-f4fb-5453-afca-06c1a06e06fa/33580bbc-f4fb-5453-afca-06c1a06e06fa_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 315472,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1490428-4004918-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33580bbc-f4fb-5453-afca-06c1a06e06fa/33580bbc-f4fb-5453-afca-06c1a06e06fa_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257984,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1490428-4004918-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33580bbc-f4fb-5453-afca-06c1a06e06fa/33580bbc-f4fb-5453-afca-06c1a06e06fa_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 350579,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1490428-4004918-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33580bbc-f4fb-5453-afca-06c1a06e06fa/33580bbc-f4fb-5453-afca-06c1a06e06fa_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 254963,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1490428-4004918-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33580bbc-f4fb-5453-afca-06c1a06e06fa/33580bbc-f4fb-5453-afca-06c1a06e06fa_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 290616,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1490428-4004918-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-30',
 'seller_name': 'Pentagon Group',
 'title': 'LAND ROVER RANGE ROVER 4.4 TDV8 Autobiography 4dr Auto',
 'transmission': 'automatic',
 'trim': '4.4 TDV8 Autobiography 4dr Auto',
 'year': 2012}
2025-12-03 06:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271490428%27 HTTP/1.1" 200 None
2025-12-03 06:02:07 [manheim.gb] INFO: Saving data for 1490428: {'created_time': 1764741727.054156, 'last_price_update_time': 1764741727.05417, 'auction_closing_time': 1764838800.0}
2025-12-03 06:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1490428') HTTP/1.1" 204 0
2025-12-03 06:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VAUXHALL/INSIGNIA?id=2213672&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232213672&indx=98> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:02:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:02:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ba4398d-22ae-5110-9b32-0ce2c03feac0 with identifier: 2213672
2025-12-03 06:02:14 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 2ba4398d-22ae-5110-9b32-0ce2c03feac0
2025-12-03 06:02:20 [scrapy.extensions.logstats] INFO: Crawled 22 pages (at 20 pages/min), scraped 3 items (at 3 items/min)
2025-12-03 06:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VOLVO/V60?id=2192411&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232192411&indx=95> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:02:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:02:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9be67069-1d6c-50c1-a7b6-df9e65e39784 with identifier: 2192411
2025-12-03 06:02:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9be67069-1d6c-50c1-a7b6-df9e65e39784 with scrape type 2
2025-12-03 06:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9be67069-1d6c-50c1-a7b6-df9e65e39784 with scrape type 2
2025-12-03 06:02:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 9be67069-1d6c-50c1-a7b6-df9e65e39784, identifier: 2192411
2025-12-03 06:02:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 9be67069-1d6c-50c1-a7b6-df9e65e39784 with identifier: 2192411
2025-12-03 06:02:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 9be67069-1d6c-50c1-a7b6-df9e65e39784 with identifier: 2192411
2025-12-03 06:02:21 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': 'riverside motors', 'price_includes_vat': False, 'title': 'volvo v60 d3 [150] business edition 5dr', 'price': 0, 'currency': 'gbp', 'make': 'volvo', 'model': 'v60', 'transmission': 'manual', 'engine': '2.0l', 'fuel_type': 'diesel', 'odometer': 138812, 'odometer_reading_unit': 'mi', 'registration_date': '2016-09-22', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/volvo/v60?id=2192411', 'location': 'leeds', 'origin_country_code': 'gb', 'trim': 'd3 [150] business edition 5dr', 'license_plate': 'ae66ukp', 'year': 2016, 'listing': 'auction', 'c_o_2_emission_value': 105, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002192411-01986909-004.pdf', 'expiration_date': '2025-12-03t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': '9be67069-1d6c-50c1-a7b6-df9e65e39784', 'current_year_diff': 9, 'age_in_months': 110, 'make_model': 'volvo v60', 'sanitized_make': 'volvo', 'odometer_in_km': 223395}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 110,
     'auction_title': '',
     'c_o_2_emission_value': 105,
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002192411-01986909-004.pdf',
     'color': 'white',
     'currency': 'gbp',
     'current_year_diff': 9,
     'engine': '2.0l',
     'expiration_date': '2025-12-03t09:00:00z',
     'fuel_type': 'diesel',
     'id': '9be67069-1d6c-50c1-a7b6-df9e65e39784',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'ae66ukp',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/volvo/v60?id=2192411',
     'listing': 'auction',
     'location': 'leeds',
     'make': 'volvo',
     'make_model': 'volvo v60',
     'model': 'v60',
     'odometer': 138812,
     'odometer_in_km': 223395,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2016-09-22',
     'sanitized_make': 'volvo',
     'seller_name': 'riverside motors',
     'title': 'volvo v60 d3 [150] business edition 5dr',
     'transmission': 'manual',
     'trim': 'd3 [150] business edition 5dr',
     'year': 2016}
2025-12-03 06:02:21 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 9be67069-1d6c-50c1-a7b6-df9e65e39784 spider: manheim.gb
2025-12-03 06:02:21 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 9be67069-1d6c-50c1-a7b6-df9e65e39784 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': 'riverside motors', 'price_includes_vat': False, 'title': 'volvo v60 d3 [150] business edition 5dr', 'price': 0, 'currency': 'gbp', 'make': 'volvo', 'model': 'v60', 'transmission': 'manual', 'engine': '2.0l', 'fuel_type': 'diesel', 'odometer': 138812, 'odometer_reading_unit': 'mi', 'registration_date': '2016-09-22', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/volvo/v60?id=2192411', 'location': 'leeds', 'origin_country_code': 'gb', 'trim': 'd3 [150] business edition 5dr', 'license_plate': 'ae66ukp', 'year': 2016, 'listing': 'auction', 'c_o_2_emission_value': 105, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002192411-01986909-004.pdf', 'expiration_date': '2025-12-03t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': '9be67069-1d6c-50c1-a7b6-df9e65e39784', 'current_year_diff': 9, 'age_in_months': 110, 'make_model': 'volvo v60', 'sanitized_make': 'volvo', 'odometer_in_km': 223395}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 110,
     'auction_title': '',
     'c_o_2_emission_value': 105,
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002192411-01986909-004.pdf',
     'color': 'white',
     'currency': 'gbp',
     'current_year_diff': 9,
     'engine': '2.0l',
     'expiration_date': '2025-12-03t09:00:00z',
     'fuel_type': 'diesel',
     'id': '9be67069-1d6c-50c1-a7b6-df9e65e39784',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'ae66ukp',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/volvo/v60?id=2192411',
     'listing': 'auction',
     'location': 'leeds',
     'make': 'volvo',
     'make_model': 'volvo v60',
     'model': 'v60',
     'odometer': 138812,
     'odometer_in_km': 223395,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2016-09-22',
     'sanitized_make': 'volvo',
     'seller_name': 'riverside motors',
     'title': 'volvo v60 d3 [150] business edition 5dr',
     'transmission': 'manual',
     'trim': 'd3 [150] business edition 5dr',
     'year': 2016}
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002192411-01986909-004.pdf',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': '2025-12-03T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '9be67069-1d6c-50c1-a7b6-df9e65e39784',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'AE66UKP',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VOLVO/V60?id=2192411',
 'listing': 'auction',
 'location': 'Leeds',
 'make': 'VOLVO',
 'model': 'V60',
 'odometer': 138812,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-22',
 'seller_name': 'Riverside Motors',
 'title': 'VOLVO V60 D3 [150] Business Edition 5dr',
 'transmission': 'manual',
 'trim': 'D3 [150] Business Edition 5dr',
 'year': 2016}
2025-12-03 06:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272192411%27 HTTP/1.1" 200 None
2025-12-03 06:02:21 [manheim.gb] INFO: Saving data for 2192411: {'auction_closing_time': 1764752400.0, 'created_time': 1764583390.592706, 'last_price_update_time': 1764741741.376935}
2025-12-03 06:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2192411') HTTP/1.1" 204 0
2025-12-03 06:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/AUDI/A5?id=2186514&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232186514&indx=94> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:02:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0002213672-01989421-002.pdf> (referer: None)
2025-12-03 06:02:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46fd0ce5-841d-52a8-a8d4-ce6b1226c23f with identifier: 2186514
2025-12-03 06:02:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46fd0ce5-841d-52a8-a8d4-ce6b1226c23f with scrape type 2
2025-12-03 06:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46fd0ce5-841d-52a8-a8d4-ce6b1226c23f with scrape type 2
2025-12-03 06:02:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 46fd0ce5-841d-52a8-a8d4-ce6b1226c23f, identifier: 2186514
2025-12-03 06:02:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 46fd0ce5-841d-52a8-a8d4-ce6b1226c23f with identifier: 2186514
2025-12-03 06:02:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 46fd0ce5-841d-52a8-a8d4-ce6b1226c23f with identifier: 2186514
2025-12-03 06:02:21 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 158186 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    158186
2025-12-03 06:02:21 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 46fd0ce5-841d-52a8-a8d4-ce6b1226c23f spider: manheim.gb
2025-12-03 06:02:21 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 46fd0ce5-841d-52a8-a8d4-ce6b1226c23f due to rule: high_mileage_for_country.json, error: 158186 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    158186
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002186514-01984034-003.pdf',
 'color': 'Black',
 'currency': 'GBP',
 'engine': '1.8L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '46fd0ce5-841d-52a8-a8d4-ce6b1226c23f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'LK13LBP',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/AUDI/A5?id=2186514',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'AUDI',
 'model': 'A5',
 'odometer': 98293,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-20',
 'seller_name': 'Harwoods Group',
 'title': 'AUDI A5 1.8T FSI Black Edition 5dr Multitronic [5 Seat]',
 'transmission': 'automatic',
 'trim': '1.8T FSI Black Edition 5dr Multitronic [5 Seat]',
 'year': 2013}
2025-12-03 06:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272186514%27 HTTP/1.1" 200 None
2025-12-03 06:02:21 [manheim.gb] INFO: Saving data for 2186514: {'auction_closing_time': 1764838800.0, 'created_time': 1764583444.4361, 'last_price_update_time': 1764741741.823269}
2025-12-03 06:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2186514') HTTP/1.1" 204 0
2025-12-03 06:02:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:02:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f5b72f90>
2025-12-03 06:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:02:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ba4398d-22ae-5110-9b32-0ce2c03feac0/2ba4398d-22ae-5110-9b32-0ce2c03feac0_expert_report_file_5574b6e1-ca83-4a17-89a3-735b56afe5c4.pdf HTTP/1.1" 201 0
2025-12-03 06:02:22 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 2ba4398d-22ae-5110-9b32-0ce2c03feac0
2025-12-03 06:02:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2ba4398d-22ae-5110-9b32-0ce2c03feac0, skipping ID generation
2025-12-03 06:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 2ba4398d-22ae-5110-9b32-0ce2c03feac0
2025-12-03 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2213672-9999999-336111855-004.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2213672-9999999-336111855-004.jpg not downloaded yet
2025-12-03 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2213672-9999999-336111855-008.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2213672-9999999-336111855-008.jpg not downloaded yet
2025-12-03 06:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/MINI/HATCHBACK?id=2175705&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232175705&indx=92> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2213672-9999999-336111855-001.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2213672-9999999-336111855-001.jpg not downloaded yet
2025-12-03 06:02:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2213672-9999999-336111855-002.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2213672-9999999-336111855-002.jpg not downloaded yet
2025-12-03 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2213672-9999999-336111855-003.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2213672-9999999-336111855-003.jpg not downloaded yet
2025-12-03 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2213672-9999999-336111855-005.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2213672-9999999-336111855-005.jpg not downloaded yet
2025-12-03 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2213672-9999999-336111855-006.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2213672-9999999-336111855-006.jpg not downloaded yet
2025-12-03 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2213672-9999999-336111855-007.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2213672-9999999-336111855-007.jpg not downloaded yet
2025-12-03 06:02:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b7a2716-042c-5fd3-96d0-371aaf84f933 with identifier: 2175705
2025-12-03 06:02:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b7a2716-042c-5fd3-96d0-371aaf84f933 with scrape type 2
2025-12-03 06:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b7a2716-042c-5fd3-96d0-371aaf84f933 with scrape type 2
2025-12-03 06:02:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 2b7a2716-042c-5fd3-96d0-371aaf84f933, identifier: 2175705
2025-12-03 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2213672-9999999-336111855-009.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2213672-9999999-336111855-009.jpg not downloaded yet
2025-12-03 06:02:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 2b7a2716-042c-5fd3-96d0-371aaf84f933 with identifier: 2175705
2025-12-03 06:02:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 2b7a2716-042c-5fd3-96d0-371aaf84f933 with identifier: 2175705
2025-12-03 06:02:22 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 152385 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    152385
2025-12-03 06:02:22 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 2b7a2716-042c-5fd3-96d0-371aaf84f933 spider: manheim.gb
2025-12-03 06:02:22 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 2b7a2716-042c-5fd3-96d0-371aaf84f933 due to rule: high_mileage_for_country.json, error: 152385 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    152385
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002175705-01985573-004.pdf',
 'color': 'BLUE',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': '2025-12-03T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '2b7a2716-042c-5fd3-96d0-371aaf84f933',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'SB61XCS',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MINI/HATCHBACK?id=2175705',
 'listing': 'auction',
 'location': 'Birmingham',
 'make': 'MINI',
 'model': 'HATCHBACK',
 'odometer': 94688,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-05',
 'seller_name': 'Hilton Garage Ltd',
 'title': 'MINI HATCHBACK 1.6 Cooper 3dr',
 'transmission': 'manual',
 'trim': '1.6 Cooper 3dr',
 'year': 2011}
2025-12-03 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272175705%27 HTTP/1.1" 200 None
2025-12-03 06:02:22 [manheim.gb] INFO: Saving data for 2175705: {'auction_closing_time': 1764752400.0, 'created_time': 1764583944.272426, 'last_price_update_time': 1764741742.9512}
2025-12-03 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2175705') HTTP/1.1" 204 0
2025-12-03 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2213672-9999999-336111855-010.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2213672-9999999-336111855-010.jpg not downloaded yet
2025-12-03 06:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2213672-9999999-336111855-011.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2213672-9999999-336111855-011.jpg not downloaded yet
2025-12-03 06:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2213672-9999999-336111855-008.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002213672-01989421-002.pdf)
2025-12-03 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2213672-9999999-336111855-012.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2213672-9999999-336111855-012.jpg not downloaded yet
2025-12-03 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2213672-4004628-13.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2213672-4004628-13.jpg not downloaded yet
2025-12-03 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2213672-4004628-1000.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2213672-4004628-1000.jpg not downloaded yet
2025-12-03 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2213672-4004628-1001.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2213672-4004628-1001.jpg not downloaded yet
2025-12-03 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2213672-4004628-1002.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2213672-4004628-1002.jpg not downloaded yet
2025-12-03 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2213672-4004628-1003.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2213672-4004628-1003.jpg not downloaded yet
2025-12-03 06:02:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:02:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f61bf850>
2025-12-03 06:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:02:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ba4398d-22ae-5110-9b32-0ce2c03feac0/2ba4398d-22ae-5110-9b32-0ce2c03feac0_image_1.jpg HTTP/1.1" 201 0
2025-12-03 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2213672-9999999-336111855-008.jpg') HTTP/1.1" 204 0
2025-12-03 06:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2213672-9999999-336111855-008.jpg saved to cache
2025-12-03 06:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2ba4398d-22ae-5110-9b32-0ce2c03feac0
2025-12-03 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2213672-4004628-1004.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2213672-4004628-1004.jpg not downloaded yet
2025-12-03 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2213672-4004628-1005.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2213672-4004628-1005.jpg not downloaded yet
2025-12-03 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2213672-4004628-1006.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2213672-4004628-1006.jpg not downloaded yet
2025-12-03 06:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2213672-9999999-336111855-011.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002213672-01989421-002.pdf)
2025-12-03 06:02:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:02:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f614de50>
2025-12-03 06:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:02:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 06:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ba4398d-22ae-5110-9b32-0ce2c03feac0/2ba4398d-22ae-5110-9b32-0ce2c03feac0_image_10.jpg HTTP/1.1" 201 0
2025-12-03 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2213672-9999999-336111855-011.jpg') HTTP/1.1" 204 0
2025-12-03 06:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2213672-9999999-336111855-011.jpg saved to cache
2025-12-03 06:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 2ba4398d-22ae-5110-9b32-0ce2c03feac0
2025-12-03 06:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2213672-4004628-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002213672-01989421-002.pdf)
2025-12-03 06:02:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:02:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6163090>
2025-12-03 06:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:02:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 06:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ba4398d-22ae-5110-9b32-0ce2c03feac0/2ba4398d-22ae-5110-9b32-0ce2c03feac0_image_18.jpg HTTP/1.1" 201 0
2025-12-03 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2213672-4004628-1005.jpg') HTTP/1.1" 204 0
2025-12-03 06:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2213672-4004628-1005.jpg saved to cache
2025-12-03 06:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 2ba4398d-22ae-5110-9b32-0ce2c03feac0
2025-12-03 06:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2213672-4004628-1006.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002213672-01989421-002.pdf)
2025-12-03 06:02:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:02:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f60177d0>
2025-12-03 06:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:02:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ba4398d-22ae-5110-9b32-0ce2c03feac0/2ba4398d-22ae-5110-9b32-0ce2c03feac0_image_19.jpg HTTP/1.1" 201 0
2025-12-03 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2213672-4004628-1006.jpg') HTTP/1.1" 204 0
2025-12-03 06:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2213672-4004628-1006.jpg saved to cache
2025-12-03 06:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 2ba4398d-22ae-5110-9b32-0ce2c03feac0
2025-12-03 06:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2213672-4004628-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002213672-01989421-002.pdf)
2025-12-03 06:02:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:02:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:02:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:02:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6069cd0>
2025-12-03 06:02:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:02:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ba4398d-22ae-5110-9b32-0ce2c03feac0/2ba4398d-22ae-5110-9b32-0ce2c03feac0_image_17.jpg HTTP/1.1" 201 0
2025-12-03 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2213672-4004628-1004.jpg') HTTP/1.1" 204 0
2025-12-03 06:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2213672-4004628-1004.jpg saved to cache
2025-12-03 06:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 2ba4398d-22ae-5110-9b32-0ce2c03feac0
2025-12-03 06:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/SKODA/YETIOUTDOOR?id=216223&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%23216223&indx=90> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:02:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2213672-4004628-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002213672-01989421-002.pdf)
2025-12-03 06:02:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c7b9a97-a361-5c40-acc8-14dbb5bf07d3 with identifier: 216223
2025-12-03 06:02:25 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 6c7b9a97-a361-5c40-acc8-14dbb5bf07d3
2025-12-03 06:02:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:02:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:02:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:02:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f5233bd0>
2025-12-03 06:02:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:02:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ba4398d-22ae-5110-9b32-0ce2c03feac0/2ba4398d-22ae-5110-9b32-0ce2c03feac0_image_16.jpg HTTP/1.1" 201 0
2025-12-03 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2213672-4004628-1003.jpg') HTTP/1.1" 204 0
2025-12-03 06:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2213672-4004628-1003.jpg saved to cache
2025-12-03 06:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 2ba4398d-22ae-5110-9b32-0ce2c03feac0
2025-12-03 06:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2213672-4004628-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002213672-01989421-002.pdf)
2025-12-03 06:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2213672-4004628-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002213672-01989421-002.pdf)
2025-12-03 06:02:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:02:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:02:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:02:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f605ee10>
2025-12-03 06:02:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:02:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ba4398d-22ae-5110-9b32-0ce2c03feac0/2ba4398d-22ae-5110-9b32-0ce2c03feac0_image_14.jpg HTTP/1.1" 201 0
2025-12-03 06:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2213672-4004628-1001.jpg') HTTP/1.1" 204 0
2025-12-03 06:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2213672-4004628-1001.jpg saved to cache
2025-12-03 06:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 2ba4398d-22ae-5110-9b32-0ce2c03feac0
2025-12-03 06:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/NISSAN/LEAF?id=2195912&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232195912&indx=96> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:02:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:02:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f63b1d90>
2025-12-03 06:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:02:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ba4398d-22ae-5110-9b32-0ce2c03feac0/2ba4398d-22ae-5110-9b32-0ce2c03feac0_image_15.jpg HTTP/1.1" 201 0
2025-12-03 06:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2213672-4004628-1002.jpg') HTTP/1.1" 204 0
2025-12-03 06:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2213672-4004628-1002.jpg saved to cache
2025-12-03 06:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 2ba4398d-22ae-5110-9b32-0ce2c03feac0
2025-12-03 06:02:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2213672-4004628-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002213672-01989421-002.pdf)
2025-12-03 06:02:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4016f7c2-4cf2-5888-bc0c-35c47ab19c82 with identifier: 2195912
2025-12-03 06:02:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4016f7c2-4cf2-5888-bc0c-35c47ab19c82 with scrape type 2
2025-12-03 06:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4016f7c2-4cf2-5888-bc0c-35c47ab19c82 with scrape type 2
2025-12-03 06:02:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 4016f7c2-4cf2-5888-bc0c-35c47ab19c82, identifier: 2195912
2025-12-03 06:02:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 4016f7c2-4cf2-5888-bc0c-35c47ab19c82 with identifier: 2195912
2025-12-03 06:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-03 06:02:26 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Electric HTTP/1.1" 200 None
2025-12-03 06:02:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-03 06:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-03 06:02:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 4016f7c2-4cf2-5888-bc0c-35c47ab19c82 with identifier: 2195912
2025-12-03 06:02:26 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 0, 'seller_name': 'lookers', 'price_includes_vat': False, 'title': 'nissan leaf 80kw acenta 24kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'nissan', 'model': 'leaf', 'transmission': 'automatic', 'engine': '0.0l', 'fuel_type': 'electric', 'odometer': 79530, 'odometer_reading_unit': 'mi', 'registration_date': '2016-09-14', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/nissan/leaf?id=2195912', 'location': 'washington', 'origin_country_code': 'gb', 'trim': '80kw acenta 24kwh 5dr auto', 'license_plate': 'na66pne', 'year': 2016, 'listing': 'auction', 'c_o_2_emission_value': 0, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002195912-01982895-002.pdf', 'expiration_date': '2025-12-03t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': '4016f7c2-4cf2-5888-bc0c-35c47ab19c82', 'current_year_diff': 9, 'age_in_months': 110, 'make_model': 'nissan leaf', 'sanitized_make': 'nissan', 'odometer_in_km': 127990} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 110,
     'auction_title': '',
     'c_o_2_emission_value': 0,
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002195912-01982895-002.pdf',
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 9,
     'engine': '0.0l',
     'expiration_date': '2025-12-03t09:00:00z',
     'fuel_type': 'electric',
     'id': '4016f7c2-4cf2-5888-bc0c-35c47ab19c82',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'na66pne',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/nissan/leaf?id=2195912',
     'listing': 'auction',
     'location': 'washington',
     'make': 'nissan',
     'make_model': 'nissan leaf',
     'model': 'leaf',
     'odometer': 79530,
     'odometer_in_km': 127990,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2016-09-14',
     'sanitized_make': 'nissan',
     'seller_name': 'lookers',
     'title': 'nissan leaf 80kw acenta 24kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '80kw acenta 24kwh 5dr auto',
     'year': 2016}
2025-12-03 06:02:26 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 4016f7c2-4cf2-5888-bc0c-35c47ab19c82 spider: manheim.gb
2025-12-03 06:02:27 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 4016f7c2-4cf2-5888-bc0c-35c47ab19c82 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 0, 'seller_name': 'lookers', 'price_includes_vat': False, 'title': 'nissan leaf 80kw acenta 24kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'nissan', 'model': 'leaf', 'transmission': 'automatic', 'engine': '0.0l', 'fuel_type': 'electric', 'odometer': 79530, 'odometer_reading_unit': 'mi', 'registration_date': '2016-09-14', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/nissan/leaf?id=2195912', 'location': 'washington', 'origin_country_code': 'gb', 'trim': '80kw acenta 24kwh 5dr auto', 'license_plate': 'na66pne', 'year': 2016, 'listing': 'auction', 'c_o_2_emission_value': 0, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002195912-01982895-002.pdf', 'expiration_date': '2025-12-03t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': '4016f7c2-4cf2-5888-bc0c-35c47ab19c82', 'current_year_diff': 9, 'age_in_months': 110, 'make_model': 'nissan leaf', 'sanitized_make': 'nissan', 'odometer_in_km': 127990} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 110,
     'auction_title': '',
     'c_o_2_emission_value': 0,
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002195912-01982895-002.pdf',
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 9,
     'engine': '0.0l',
     'expiration_date': '2025-12-03t09:00:00z',
     'fuel_type': 'electric',
     'id': '4016f7c2-4cf2-5888-bc0c-35c47ab19c82',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'na66pne',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/nissan/leaf?id=2195912',
     'listing': 'auction',
     'location': 'washington',
     'make': 'nissan',
     'make_model': 'nissan leaf',
     'model': 'leaf',
     'odometer': 79530,
     'odometer_in_km': 127990,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2016-09-14',
     'sanitized_make': 'nissan',
     'seller_name': 'lookers',
     'title': 'nissan leaf 80kw acenta 24kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '80kw acenta 24kwh 5dr auto',
     'year': 2016}
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002195912-01982895-002.pdf',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '0.0L',
 'expiration_date': '2025-12-03T09:00:00Z',
 'fuel_type': 'Electric',
 'id': '4016f7c2-4cf2-5888-bc0c-35c47ab19c82',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'NA66PNE',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/NISSAN/LEAF?id=2195912',
 'listing': 'auction',
 'location': 'Washington',
 'make': 'NISSAN',
 'model': 'LEAF',
 'odometer': 79530,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-14',
 'seller_name': 'Lookers',
 'title': 'NISSAN LEAF 80kW Acenta 24kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '80kW Acenta 24kWh 5dr Auto',
 'year': 2016}
2025-12-03 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272195912%27 HTTP/1.1" 200 None
2025-12-03 06:02:27 [manheim.gb] INFO: Saving data for 2195912: {'auction_closing_time': 1764752400.0, 'created_time': 1764583445.787641, 'last_price_update_time': 1764741747.119236}
2025-12-03 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2195912') HTTP/1.1" 204 0
2025-12-03 06:02:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:02:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6254150>
2025-12-03 06:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:02:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ba4398d-22ae-5110-9b32-0ce2c03feac0/2ba4398d-22ae-5110-9b32-0ce2c03feac0_image_13.jpg HTTP/1.1" 201 0
2025-12-03 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2213672-4004628-1000.jpg') HTTP/1.1" 204 0
2025-12-03 06:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2213672-4004628-1000.jpg saved to cache
2025-12-03 06:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 2ba4398d-22ae-5110-9b32-0ce2c03feac0
2025-12-03 06:02:27 [scrapy.core.engine] DEBUG: Crawled (404) <GET https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=1995165&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231995165&indx=78> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2213672-4004628-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002213672-01989421-002.pdf)
2025-12-03 06:02:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2213672-9999999-336111855-012.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002213672-01989421-002.pdf)
2025-12-03 06:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0000216223-01989382-003.pdf> (referer: None)
2025-12-03 06:02:27 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Ignoring non-200 response
NoneType: None
2025-12-03 06:02:27 [scrapy.core.scraper] ERROR: Spider error processing <GET https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=1995165&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231995165&indx=78> (referer: https://www.manheim.co.uk/search/refine)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 301, in process_spider_exception
    return self._process_spider_exception(response, spider, _failure)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/httperror.py", line 46, in process_spider_input
    raise HttpError(response, "Ignoring non-200 response")
scrapy.spidermiddlewares.httperror.HttpError: Ignoring non-200 response
2025-12-03 06:02:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:02:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f5bc8810>
2025-12-03 06:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:02:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 06:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ba4398d-22ae-5110-9b32-0ce2c03feac0/2ba4398d-22ae-5110-9b32-0ce2c03feac0_image_12.jpg HTTP/1.1" 201 0
2025-12-03 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2213672-4004628-13.jpg') HTTP/1.1" 204 0
2025-12-03 06:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2213672-4004628-13.jpg saved to cache
2025-12-03 06:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 2ba4398d-22ae-5110-9b32-0ce2c03feac0
2025-12-03 06:02:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:02:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6020890>
2025-12-03 06:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:02:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ba4398d-22ae-5110-9b32-0ce2c03feac0/2ba4398d-22ae-5110-9b32-0ce2c03feac0_image_11.jpg HTTP/1.1" 201 0
2025-12-03 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2213672-9999999-336111855-012.jpg') HTTP/1.1" 204 0
2025-12-03 06:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2213672-9999999-336111855-012.jpg saved to cache
2025-12-03 06:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 2ba4398d-22ae-5110-9b32-0ce2c03feac0
2025-12-03 06:02:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:02:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f62103d0>
2025-12-03 06:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:02:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c7b9a97-a361-5c40-acc8-14dbb5bf07d3/6c7b9a97-a361-5c40-acc8-14dbb5bf07d3_expert_report_file_480d6197-5eb3-488f-bf10-c2f574b91ac0.pdf HTTP/1.1" 201 0
2025-12-03 06:02:28 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 6c7b9a97-a361-5c40-acc8-14dbb5bf07d3
2025-12-03 06:02:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6c7b9a97-a361-5c40-acc8-14dbb5bf07d3, skipping ID generation
2025-12-03 06:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 6c7b9a97-a361-5c40-acc8-14dbb5bf07d3
2025-12-03 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F216223-9999999-336091611-004.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/216223-9999999-336091611-004.jpg not downloaded yet
2025-12-03 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F216223-9999999-336091611-008.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/216223-9999999-336091611-008.jpg not downloaded yet
2025-12-03 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F216223-9999999-336091611-001.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/216223-9999999-336091611-001.jpg not downloaded yet
2025-12-03 06:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2213672-9999999-336111855-007.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002213672-01989421-002.pdf)
2025-12-03 06:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2213672-9999999-336111855-009.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002213672-01989421-002.pdf)
2025-12-03 06:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2213672-9999999-336111855-010.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002213672-01989421-002.pdf)
2025-12-03 06:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2213672-9999999-336111855-006.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002213672-01989421-002.pdf)
2025-12-03 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F216223-9999999-336091611-002.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/216223-9999999-336091611-002.jpg not downloaded yet
2025-12-03 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F216223-9999999-336091611-003.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/216223-9999999-336091611-003.jpg not downloaded yet
2025-12-03 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F216223-9999999-336091611-005.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/216223-9999999-336091611-005.jpg not downloaded yet
2025-12-03 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F216223-9999999-336091611-006.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/216223-9999999-336091611-006.jpg not downloaded yet
2025-12-03 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F216223-9999999-336091611-007.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/216223-9999999-336091611-007.jpg not downloaded yet
2025-12-03 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F216223-9999999-336091611-009.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/216223-9999999-336091611-009.jpg not downloaded yet
2025-12-03 06:02:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:02:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f5b55650>
2025-12-03 06:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:02:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ba4398d-22ae-5110-9b32-0ce2c03feac0/2ba4398d-22ae-5110-9b32-0ce2c03feac0_image_7.jpg HTTP/1.1" 201 0
2025-12-03 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2213672-9999999-336111855-007.jpg') HTTP/1.1" 204 0
2025-12-03 06:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2213672-9999999-336111855-007.jpg saved to cache
2025-12-03 06:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2ba4398d-22ae-5110-9b32-0ce2c03feac0
2025-12-03 06:02:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:02:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6407a50>
2025-12-03 06:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:02:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ba4398d-22ae-5110-9b32-0ce2c03feac0/2ba4398d-22ae-5110-9b32-0ce2c03feac0_image_8.jpg HTTP/1.1" 201 0
2025-12-03 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2213672-9999999-336111855-009.jpg') HTTP/1.1" 204 0
2025-12-03 06:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2213672-9999999-336111855-009.jpg saved to cache
2025-12-03 06:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2ba4398d-22ae-5110-9b32-0ce2c03feac0
2025-12-03 06:02:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:02:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6424650>
2025-12-03 06:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:02:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ba4398d-22ae-5110-9b32-0ce2c03feac0/2ba4398d-22ae-5110-9b32-0ce2c03feac0_image_9.jpg HTTP/1.1" 201 0
2025-12-03 06:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2213672-9999999-336111855-010.jpg') HTTP/1.1" 204 0
2025-12-03 06:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2213672-9999999-336111855-010.jpg saved to cache
2025-12-03 06:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2ba4398d-22ae-5110-9b32-0ce2c03feac0
2025-12-03 06:02:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:02:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6405610>
2025-12-03 06:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:02:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ba4398d-22ae-5110-9b32-0ce2c03feac0/2ba4398d-22ae-5110-9b32-0ce2c03feac0_image_6.jpg HTTP/1.1" 201 0
2025-12-03 06:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2213672-9999999-336111855-006.jpg') HTTP/1.1" 204 0
2025-12-03 06:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2213672-9999999-336111855-006.jpg saved to cache
2025-12-03 06:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2ba4398d-22ae-5110-9b32-0ce2c03feac0
2025-12-03 06:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F216223-9999999-336091611-010.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/216223-9999999-336091611-010.jpg not downloaded yet
2025-12-03 06:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F216223-9999999-336091611-011.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/216223-9999999-336091611-011.jpg not downloaded yet
2025-12-03 06:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/216223-9999999-336091611-001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000216223-01989382-003.pdf)
2025-12-03 06:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/216223-9999999-336091611-008.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000216223-01989382-003.pdf)
2025-12-03 06:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/216223-9999999-336091611-004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000216223-01989382-003.pdf)
2025-12-03 06:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F216223-9999999-336091611-012.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/216223-9999999-336091611-012.jpg not downloaded yet
2025-12-03 06:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2213672-9999999-336111855-005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002213672-01989421-002.pdf)
2025-12-03 06:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-216223-4003950-13.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-216223-4003950-13.jpg not downloaded yet
2025-12-03 06:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-216223-4003950-1000.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-216223-4003950-1000.jpg not downloaded yet
2025-12-03 06:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-216223-4003950-1001.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-216223-4003950-1001.jpg not downloaded yet
2025-12-03 06:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-216223-4003950-1002.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-216223-4003950-1002.jpg not downloaded yet
2025-12-03 06:02:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:02:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f52d4950>
2025-12-03 06:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:02:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c7b9a97-a361-5c40-acc8-14dbb5bf07d3/6c7b9a97-a361-5c40-acc8-14dbb5bf07d3_image_2.jpg HTTP/1.1" 201 0
2025-12-03 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F216223-9999999-336091611-001.jpg') HTTP/1.1" 204 0
2025-12-03 06:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/216223-9999999-336091611-001.jpg saved to cache
2025-12-03 06:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6c7b9a97-a361-5c40-acc8-14dbb5bf07d3
2025-12-03 06:02:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:02:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6212a10>
2025-12-03 06:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:02:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c7b9a97-a361-5c40-acc8-14dbb5bf07d3/6c7b9a97-a361-5c40-acc8-14dbb5bf07d3_image_1.jpg HTTP/1.1" 201 0
2025-12-03 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F216223-9999999-336091611-008.jpg') HTTP/1.1" 204 0
2025-12-03 06:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/216223-9999999-336091611-008.jpg saved to cache
2025-12-03 06:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6c7b9a97-a361-5c40-acc8-14dbb5bf07d3
2025-12-03 06:02:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:02:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f62eaf50>
2025-12-03 06:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:02:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 06:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c7b9a97-a361-5c40-acc8-14dbb5bf07d3/6c7b9a97-a361-5c40-acc8-14dbb5bf07d3_image_0.jpg HTTP/1.1" 201 0
2025-12-03 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F216223-9999999-336091611-004.jpg') HTTP/1.1" 204 0
2025-12-03 06:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/216223-9999999-336091611-004.jpg saved to cache
2025-12-03 06:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6c7b9a97-a361-5c40-acc8-14dbb5bf07d3
2025-12-03 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-216223-4003950-1003.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-216223-4003950-1003.jpg not downloaded yet
2025-12-03 06:02:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:02:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f613d5d0>
2025-12-03 06:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:02:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ba4398d-22ae-5110-9b32-0ce2c03feac0/2ba4398d-22ae-5110-9b32-0ce2c03feac0_image_5.jpg HTTP/1.1" 201 0
2025-12-03 06:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2213672-9999999-336111855-005.jpg') HTTP/1.1" 204 0
2025-12-03 06:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2213672-9999999-336111855-005.jpg saved to cache
2025-12-03 06:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2ba4398d-22ae-5110-9b32-0ce2c03feac0
2025-12-03 06:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-216223-4003950-1004.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-216223-4003950-1004.jpg not downloaded yet
2025-12-03 06:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/RENAULT/MEGANE?id=2093385&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232093385&indx=86> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/216223-9999999-336091611-010.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000216223-01989382-003.pdf)
2025-12-03 06:02:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/216223-9999999-336091611-011.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000216223-01989382-003.pdf)
2025-12-03 06:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/216223-9999999-336091611-009.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000216223-01989382-003.pdf)
2025-12-03 06:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/216223-9999999-336091611-012.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000216223-01989382-003.pdf)
2025-12-03 06:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-216223-4003950-1005.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-216223-4003950-1005.jpg not downloaded yet
2025-12-03 06:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-216223-4003950-1006.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-216223-4003950-1006.jpg not downloaded yet
2025-12-03 06:02:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89b8d5c2-e7bc-5d92-8c77-0de0f0c0978e with identifier: 2093385
2025-12-03 06:02:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89b8d5c2-e7bc-5d92-8c77-0de0f0c0978e with scrape type 2
2025-12-03 06:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 89b8d5c2-e7bc-5d92-8c77-0de0f0c0978e with scrape type 2
2025-12-03 06:02:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 89b8d5c2-e7bc-5d92-8c77-0de0f0c0978e, identifier: 2093385
2025-12-03 06:02:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 89b8d5c2-e7bc-5d92-8c77-0de0f0c0978e with identifier: 2093385
2025-12-03 06:02:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 89b8d5c2-e7bc-5d92-8c77-0de0f0c0978e with identifier: 2093385
2025-12-03 06:02:32 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 89b8d5c2-e7bc-5d92-8c77-0de0f0c0978e with identifier: 2093385 to the API
2025-12-03 06:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 06:02:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 06:02:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/RENAULT/MEGANE?id=2093385&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232093385&indx=86>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002093385-01977123-002.pdf',
 'color': 'BLUE',
 'currency': 'GBP',
 'engine': '1.3L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '89b8d5c2-e7bc-5d92-8c77-0de0f0c0978e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'BG68UTX',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/RENAULT/MEGANE?id=2093385',
 'listing': 'auction',
 'location': 'Manchester',
 'make': 'RENAULT',
 'model': 'MEGANE',
 'odometer': 53810,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-26',
 'seller_name': 'FCA Group',
 'title': 'RENAULT MEGANE 1.3 TCE GT Line 5dr',
 'transmission': 'manual',
 'trim': '1.3 TCE GT Line 5dr',
 'year': 2018}
2025-12-03 06:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272093385%27 HTTP/1.1" 200 None
2025-12-03 06:02:32 [manheim.gb] INFO: Saving data for 2093385: {'auction_closing_time': 1764838800.0, 'created_time': 1764583942.182081, 'last_price_update_time': 1764741752.867059}
2025-12-03 06:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2093385') HTTP/1.1" 204 0
2025-12-03 06:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-216223-4003950-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000216223-01989382-003.pdf)
2025-12-03 06:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-216223-4003950-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000216223-01989382-003.pdf)
2025-12-03 06:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-216223-4003950-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000216223-01989382-003.pdf)
2025-12-03 06:02:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:02:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f5b5cf50>
2025-12-03 06:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:02:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c7b9a97-a361-5c40-acc8-14dbb5bf07d3/6c7b9a97-a361-5c40-acc8-14dbb5bf07d3_image_9.jpg HTTP/1.1" 201 0
2025-12-03 06:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F216223-9999999-336091611-010.jpg') HTTP/1.1" 204 0
2025-12-03 06:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/216223-9999999-336091611-010.jpg saved to cache
2025-12-03 06:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6c7b9a97-a361-5c40-acc8-14dbb5bf07d3
2025-12-03 06:02:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:02:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f64bc3d0>
2025-12-03 06:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:02:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 06:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c7b9a97-a361-5c40-acc8-14dbb5bf07d3/6c7b9a97-a361-5c40-acc8-14dbb5bf07d3_image_10.jpg HTTP/1.1" 201 0
2025-12-03 06:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F216223-9999999-336091611-011.jpg') HTTP/1.1" 204 0
2025-12-03 06:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/216223-9999999-336091611-011.jpg saved to cache
2025-12-03 06:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 6c7b9a97-a361-5c40-acc8-14dbb5bf07d3
2025-12-03 06:02:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:02:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f630e710>
2025-12-03 06:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:02:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c7b9a97-a361-5c40-acc8-14dbb5bf07d3/6c7b9a97-a361-5c40-acc8-14dbb5bf07d3_image_8.jpg HTTP/1.1" 201 0
2025-12-03 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F216223-9999999-336091611-009.jpg') HTTP/1.1" 204 0
2025-12-03 06:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/216223-9999999-336091611-009.jpg saved to cache
2025-12-03 06:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6c7b9a97-a361-5c40-acc8-14dbb5bf07d3
2025-12-03 06:02:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:02:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6174c10>
2025-12-03 06:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:02:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c7b9a97-a361-5c40-acc8-14dbb5bf07d3/6c7b9a97-a361-5c40-acc8-14dbb5bf07d3_image_11.jpg HTTP/1.1" 201 0
2025-12-03 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F216223-9999999-336091611-012.jpg') HTTP/1.1" 204 0
2025-12-03 06:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/216223-9999999-336091611-012.jpg saved to cache
2025-12-03 06:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 6c7b9a97-a361-5c40-acc8-14dbb5bf07d3
2025-12-03 06:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-216223-4003950-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000216223-01989382-003.pdf)
2025-12-03 06:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-216223-4003950-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000216223-01989382-003.pdf)
2025-12-03 06:02:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:02:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f62ad610>
2025-12-03 06:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:02:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 06:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c7b9a97-a361-5c40-acc8-14dbb5bf07d3/6c7b9a97-a361-5c40-acc8-14dbb5bf07d3_image_17.jpg HTTP/1.1" 201 0
2025-12-03 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-216223-4003950-1004.jpg') HTTP/1.1" 204 0
2025-12-03 06:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-216223-4003950-1004.jpg saved to cache
2025-12-03 06:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 6c7b9a97-a361-5c40-acc8-14dbb5bf07d3
2025-12-03 06:02:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:02:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f635d7d0>
2025-12-03 06:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:02:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c7b9a97-a361-5c40-acc8-14dbb5bf07d3/6c7b9a97-a361-5c40-acc8-14dbb5bf07d3_image_16.jpg HTTP/1.1" 201 0
2025-12-03 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-216223-4003950-1003.jpg') HTTP/1.1" 204 0
2025-12-03 06:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-216223-4003950-1003.jpg saved to cache
2025-12-03 06:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 6c7b9a97-a361-5c40-acc8-14dbb5bf07d3
2025-12-03 06:02:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:02:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f635ced0>
2025-12-03 06:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:02:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 06:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c7b9a97-a361-5c40-acc8-14dbb5bf07d3/6c7b9a97-a361-5c40-acc8-14dbb5bf07d3_image_14.jpg HTTP/1.1" 201 0
2025-12-03 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-216223-4003950-1001.jpg') HTTP/1.1" 204 0
2025-12-03 06:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-216223-4003950-1001.jpg saved to cache
2025-12-03 06:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 6c7b9a97-a361-5c40-acc8-14dbb5bf07d3
2025-12-03 06:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-216223-4003950-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000216223-01989382-003.pdf)
2025-12-03 06:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-216223-4003950-1006.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000216223-01989382-003.pdf)
2025-12-03 06:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/216223-9999999-336091611-007.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000216223-01989382-003.pdf)
2025-12-03 06:02:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:02:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f659f350>
2025-12-03 06:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:02:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c7b9a97-a361-5c40-acc8-14dbb5bf07d3/6c7b9a97-a361-5c40-acc8-14dbb5bf07d3_image_15.jpg HTTP/1.1" 201 0
2025-12-03 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-216223-4003950-1002.jpg') HTTP/1.1" 204 0
2025-12-03 06:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-216223-4003950-1002.jpg saved to cache
2025-12-03 06:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 6c7b9a97-a361-5c40-acc8-14dbb5bf07d3
2025-12-03 06:02:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:02:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6111750>
2025-12-03 06:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:02:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c7b9a97-a361-5c40-acc8-14dbb5bf07d3/6c7b9a97-a361-5c40-acc8-14dbb5bf07d3_image_13.jpg HTTP/1.1" 201 0
2025-12-03 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-216223-4003950-1000.jpg') HTTP/1.1" 204 0
2025-12-03 06:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-216223-4003950-1000.jpg saved to cache
2025-12-03 06:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 6c7b9a97-a361-5c40-acc8-14dbb5bf07d3
2025-12-03 06:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-216223-4003950-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000216223-01989382-003.pdf)
2025-12-03 06:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/216223-9999999-336091611-006.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000216223-01989382-003.pdf)
2025-12-03 06:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/216223-9999999-336091611-005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000216223-01989382-003.pdf)
2025-12-03 06:02:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:02:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f635f2d0>
2025-12-03 06:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:02:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c7b9a97-a361-5c40-acc8-14dbb5bf07d3/6c7b9a97-a361-5c40-acc8-14dbb5bf07d3_image_18.jpg HTTP/1.1" 201 0
2025-12-03 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-216223-4003950-1005.jpg') HTTP/1.1" 204 0
2025-12-03 06:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-216223-4003950-1005.jpg saved to cache
2025-12-03 06:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 6c7b9a97-a361-5c40-acc8-14dbb5bf07d3
2025-12-03 06:02:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:02:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f627bc50>
2025-12-03 06:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:02:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 06:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c7b9a97-a361-5c40-acc8-14dbb5bf07d3/6c7b9a97-a361-5c40-acc8-14dbb5bf07d3_image_19.jpg HTTP/1.1" 201 0
2025-12-03 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-216223-4003950-1006.jpg') HTTP/1.1" 204 0
2025-12-03 06:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-216223-4003950-1006.jpg saved to cache
2025-12-03 06:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 6c7b9a97-a361-5c40-acc8-14dbb5bf07d3
2025-12-03 06:02:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:02:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6355d90>
2025-12-03 06:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:02:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c7b9a97-a361-5c40-acc8-14dbb5bf07d3/6c7b9a97-a361-5c40-acc8-14dbb5bf07d3_image_7.jpg HTTP/1.1" 201 0
2025-12-03 06:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F216223-9999999-336091611-007.jpg') HTTP/1.1" 204 0
2025-12-03 06:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/216223-9999999-336091611-007.jpg saved to cache
2025-12-03 06:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6c7b9a97-a361-5c40-acc8-14dbb5bf07d3
2025-12-03 06:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/216223-9999999-336091611-002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000216223-01989382-003.pdf)
2025-12-03 06:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/216223-9999999-336091611-003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000216223-01989382-003.pdf)
2025-12-03 06:02:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:02:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f632a090>
2025-12-03 06:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:02:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c7b9a97-a361-5c40-acc8-14dbb5bf07d3/6c7b9a97-a361-5c40-acc8-14dbb5bf07d3_image_12.jpg HTTP/1.1" 201 0
2025-12-03 06:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-216223-4003950-13.jpg') HTTP/1.1" 204 0
2025-12-03 06:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-216223-4003950-13.jpg saved to cache
2025-12-03 06:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 6c7b9a97-a361-5c40-acc8-14dbb5bf07d3
2025-12-03 06:02:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:02:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f65ad610>
2025-12-03 06:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:02:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c7b9a97-a361-5c40-acc8-14dbb5bf07d3/6c7b9a97-a361-5c40-acc8-14dbb5bf07d3_image_6.jpg HTTP/1.1" 201 0
2025-12-03 06:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F216223-9999999-336091611-006.jpg') HTTP/1.1" 204 0
2025-12-03 06:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/216223-9999999-336091611-006.jpg saved to cache
2025-12-03 06:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6c7b9a97-a361-5c40-acc8-14dbb5bf07d3
2025-12-03 06:02:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:02:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f65ac190>
2025-12-03 06:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:02:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 06:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c7b9a97-a361-5c40-acc8-14dbb5bf07d3/6c7b9a97-a361-5c40-acc8-14dbb5bf07d3_image_5.jpg HTTP/1.1" 201 0
2025-12-03 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F216223-9999999-336091611-005.jpg') HTTP/1.1" 204 0
2025-12-03 06:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/216223-9999999-336091611-005.jpg saved to cache
2025-12-03 06:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6c7b9a97-a361-5c40-acc8-14dbb5bf07d3
2025-12-03 06:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2213672-9999999-336111855-003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002213672-01989421-002.pdf)
2025-12-03 06:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2213672-9999999-336111855-002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002213672-01989421-002.pdf)
2025-12-03 06:02:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:02:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f642f8d0>
2025-12-03 06:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:02:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 06:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c7b9a97-a361-5c40-acc8-14dbb5bf07d3/6c7b9a97-a361-5c40-acc8-14dbb5bf07d3_image_3.jpg HTTP/1.1" 201 0
2025-12-03 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F216223-9999999-336091611-002.jpg') HTTP/1.1" 204 0
2025-12-03 06:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/216223-9999999-336091611-002.jpg saved to cache
2025-12-03 06:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6c7b9a97-a361-5c40-acc8-14dbb5bf07d3
2025-12-03 06:02:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:02:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f600e050>
2025-12-03 06:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:02:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 06:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c7b9a97-a361-5c40-acc8-14dbb5bf07d3/6c7b9a97-a361-5c40-acc8-14dbb5bf07d3_image_4.jpg HTTP/1.1" 201 0
2025-12-03 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F216223-9999999-336091611-003.jpg') HTTP/1.1" 204 0
2025-12-03 06:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/216223-9999999-336091611-003.jpg saved to cache
2025-12-03 06:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6c7b9a97-a361-5c40-acc8-14dbb5bf07d3
2025-12-03 06:02:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6c7b9a97-a361-5c40-acc8-14dbb5bf07d3, skipping ID generation
2025-12-03 06:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 6c7b9a97-a361-5c40-acc8-14dbb5bf07d3 from tracking dictionaries
2025-12-03 06:02:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6c7b9a97-a361-5c40-acc8-14dbb5bf07d3 sending to next pipeline
2025-12-03 06:02:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 6c7b9a97-a361-5c40-acc8-14dbb5bf07d3, identifier: 216223
2025-12-03 06:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2213672-9999999-336111855-001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002213672-01989421-002.pdf)
2025-12-03 06:02:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 6c7b9a97-a361-5c40-acc8-14dbb5bf07d3 with identifier: 216223
2025-12-03 06:02:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 6c7b9a97-a361-5c40-acc8-14dbb5bf07d3 with identifier: 216223
2025-12-03 06:02:39 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 10 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    10
2025-12-03 06:02:39 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: 6c7b9a97-a361-5c40-acc8-14dbb5bf07d3 spider: manheim.gb
2025-12-03 06:02:39 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 6c7b9a97-a361-5c40-acc8-14dbb5bf07d3 due to rule: registration_date_old.json, error: 10 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    10
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c7b9a97-a361-5c40-acc8-14dbb5bf07d3/6c7b9a97-a361-5c40-acc8-14dbb5bf07d3_expert_report_file_480d6197-5eb3-488f-bf10-c2f574b91ac0.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0000216223-01989382-003.pdf',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': '2025-12-03T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '6c7b9a97-a361-5c40-acc8-14dbb5bf07d3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'KY64ODP',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/SKODA/YETI%20OUTDOOR?id=216223',
 'listing': 'auction',
 'location': 'Washington',
 'make': 'SKODA',
 'model': 'YETI OUTDOOR',
 'odometer': 88039,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c7b9a97-a361-5c40-acc8-14dbb5bf07d3/6c7b9a97-a361-5c40-acc8-14dbb5bf07d3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 211769,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/216223-9999999-336091611-004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c7b9a97-a361-5c40-acc8-14dbb5bf07d3/6c7b9a97-a361-5c40-acc8-14dbb5bf07d3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 251240,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/216223-9999999-336091611-008.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c7b9a97-a361-5c40-acc8-14dbb5bf07d3/6c7b9a97-a361-5c40-acc8-14dbb5bf07d3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 185823,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/216223-9999999-336091611-001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c7b9a97-a361-5c40-acc8-14dbb5bf07d3/6c7b9a97-a361-5c40-acc8-14dbb5bf07d3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 199745,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/216223-9999999-336091611-002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c7b9a97-a361-5c40-acc8-14dbb5bf07d3/6c7b9a97-a361-5c40-acc8-14dbb5bf07d3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 210411,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/216223-9999999-336091611-003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c7b9a97-a361-5c40-acc8-14dbb5bf07d3/6c7b9a97-a361-5c40-acc8-14dbb5bf07d3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 216501,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/216223-9999999-336091611-005.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c7b9a97-a361-5c40-acc8-14dbb5bf07d3/6c7b9a97-a361-5c40-acc8-14dbb5bf07d3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 182808,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/216223-9999999-336091611-006.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c7b9a97-a361-5c40-acc8-14dbb5bf07d3/6c7b9a97-a361-5c40-acc8-14dbb5bf07d3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 219304,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/216223-9999999-336091611-007.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c7b9a97-a361-5c40-acc8-14dbb5bf07d3/6c7b9a97-a361-5c40-acc8-14dbb5bf07d3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 253988,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/216223-9999999-336091611-009.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c7b9a97-a361-5c40-acc8-14dbb5bf07d3/6c7b9a97-a361-5c40-acc8-14dbb5bf07d3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 195558,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/216223-9999999-336091611-010.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c7b9a97-a361-5c40-acc8-14dbb5bf07d3/6c7b9a97-a361-5c40-acc8-14dbb5bf07d3_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 198120,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/216223-9999999-336091611-011.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c7b9a97-a361-5c40-acc8-14dbb5bf07d3/6c7b9a97-a361-5c40-acc8-14dbb5bf07d3_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257893,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/216223-9999999-336091611-012.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c7b9a97-a361-5c40-acc8-14dbb5bf07d3/6c7b9a97-a361-5c40-acc8-14dbb5bf07d3_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 323368,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-216223-4003950-13.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c7b9a97-a361-5c40-acc8-14dbb5bf07d3/6c7b9a97-a361-5c40-acc8-14dbb5bf07d3_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 220453,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-216223-4003950-1000.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c7b9a97-a361-5c40-acc8-14dbb5bf07d3/6c7b9a97-a361-5c40-acc8-14dbb5bf07d3_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 189290,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-216223-4003950-1001.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c7b9a97-a361-5c40-acc8-14dbb5bf07d3/6c7b9a97-a361-5c40-acc8-14dbb5bf07d3_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 304360,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-216223-4003950-1002.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c7b9a97-a361-5c40-acc8-14dbb5bf07d3/6c7b9a97-a361-5c40-acc8-14dbb5bf07d3_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 145475,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-216223-4003950-1003.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c7b9a97-a361-5c40-acc8-14dbb5bf07d3/6c7b9a97-a361-5c40-acc8-14dbb5bf07d3_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 179794,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-216223-4003950-1004.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c7b9a97-a361-5c40-acc8-14dbb5bf07d3/6c7b9a97-a361-5c40-acc8-14dbb5bf07d3_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 128165,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-216223-4003950-1005.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c7b9a97-a361-5c40-acc8-14dbb5bf07d3/6c7b9a97-a361-5c40-acc8-14dbb5bf07d3_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 164180,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-216223-4003950-1006.jpg',
             'Width': 1500}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-12',
 'seller_name': 'Lookers',
 'title': 'SKODA YETI OUTDOOR 2.0 TDI CR [140] Elegance 4x4 5dr',
 'transmission': 'manual',
 'trim': '2.0 TDI CR [140] Elegance 4x4 5dr',
 'year': 2015}
2025-12-03 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27216223%27 HTTP/1.1" 200 None
2025-12-03 06:02:39 [manheim.gb] INFO: Saving data for 216223: {'created_time': 1764741759.356139, 'last_price_update_time': 1764741759.356149, 'auction_closing_time': 1764752400.0}
2025-12-03 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='216223') HTTP/1.1" 204 0
2025-12-03 06:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/PEUGEOT/3008?id=1989795&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231989795&indx=77> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:02:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:02:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:02:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f62f5810>
2025-12-03 06:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:02:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ba4398d-22ae-5110-9b32-0ce2c03feac0/2ba4398d-22ae-5110-9b32-0ce2c03feac0_image_4.jpg HTTP/1.1" 201 0
2025-12-03 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2213672-9999999-336111855-003.jpg') HTTP/1.1" 204 0
2025-12-03 06:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2213672-9999999-336111855-003.jpg saved to cache
2025-12-03 06:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2ba4398d-22ae-5110-9b32-0ce2c03feac0
2025-12-03 06:02:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:02:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f659c490>
2025-12-03 06:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:02:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ba4398d-22ae-5110-9b32-0ce2c03feac0/2ba4398d-22ae-5110-9b32-0ce2c03feac0_image_3.jpg HTTP/1.1" 201 0
2025-12-03 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2213672-9999999-336111855-002.jpg') HTTP/1.1" 204 0
2025-12-03 06:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2213672-9999999-336111855-002.jpg saved to cache
2025-12-03 06:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2ba4398d-22ae-5110-9b32-0ce2c03feac0
2025-12-03 06:02:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:02:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f52df910>
2025-12-03 06:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:02:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 06:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ba4398d-22ae-5110-9b32-0ce2c03feac0/2ba4398d-22ae-5110-9b32-0ce2c03feac0_image_2.jpg HTTP/1.1" 201 0
2025-12-03 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2213672-9999999-336111855-001.jpg') HTTP/1.1" 204 0
2025-12-03 06:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2213672-9999999-336111855-001.jpg saved to cache
2025-12-03 06:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2ba4398d-22ae-5110-9b32-0ce2c03feac0
2025-12-03 06:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2213672-9999999-336111855-004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002213672-01989421-002.pdf)
2025-12-03 06:02:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4af8e61e-64eb-53f5-a8e3-f43242a72ef1 with identifier: 1989795
2025-12-03 06:02:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4af8e61e-64eb-53f5-a8e3-f43242a72ef1 with scrape type 2
2025-12-03 06:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4af8e61e-64eb-53f5-a8e3-f43242a72ef1 with scrape type 2
2025-12-03 06:02:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 4af8e61e-64eb-53f5-a8e3-f43242a72ef1, identifier: 1989795
2025-12-03 06:02:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 4af8e61e-64eb-53f5-a8e3-f43242a72ef1 with identifier: 1989795
2025-12-03 06:02:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 4af8e61e-64eb-53f5-a8e3-f43242a72ef1 with identifier: 1989795
2025-12-03 06:02:40 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 4af8e61e-64eb-53f5-a8e3-f43242a72ef1 with identifier: 1989795 to the API
2025-12-03 06:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 06:02:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-03 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%274af8e61e-64eb-53f5-a8e3-f43242a72ef1%27 HTTP/1.1" 200 None
2025-12-03 06:02:40 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id 4af8e61e-64eb-53f5-a8e3-f43242a72ef1: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 03 Dec 2025 06:02:39 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-03 06:02:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/PEUGEOT/3008?id=1989795&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231989795&indx=77>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001989795-01977577-002.pdf',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '1.5L',
 'expiration_date': '2025-12-03T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '4af8e61e-64eb-53f5-a8e3-f43242a72ef1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'KS18HDF',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/PEUGEOT/3008?id=1989795',
 'listing': 'auction',
 'location': 'Leeds',
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 55449,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-18',
 'seller_name': 'Stellantis & You',
 'title': 'PEUGEOT 3008 1.5 BlueHDi Allure 5dr',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi Allure 5dr',
 'year': 2018}
2025-12-03 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271989795%27 HTTP/1.1" 200 None
2025-12-03 06:02:40 [manheim.gb] INFO: Saving data for 1989795: {'auction_closing_time': 1764752400.0, 'created_time': 1764583986.995423, 'last_price_update_time': 1764741760.99416}
2025-12-03 06:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1989795') HTTP/1.1" 204 0
2025-12-03 06:02:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:02:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6354190>
2025-12-03 06:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:02:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ba4398d-22ae-5110-9b32-0ce2c03feac0/2ba4398d-22ae-5110-9b32-0ce2c03feac0_image_0.jpg HTTP/1.1" 201 0
2025-12-03 06:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2213672-9999999-336111855-004.jpg') HTTP/1.1" 204 0
2025-12-03 06:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2213672-9999999-336111855-004.jpg saved to cache
2025-12-03 06:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2ba4398d-22ae-5110-9b32-0ce2c03feac0
2025-12-03 06:02:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2ba4398d-22ae-5110-9b32-0ce2c03feac0, skipping ID generation
2025-12-03 06:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 2ba4398d-22ae-5110-9b32-0ce2c03feac0 from tracking dictionaries
2025-12-03 06:02:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2ba4398d-22ae-5110-9b32-0ce2c03feac0 sending to next pipeline
2025-12-03 06:02:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 2ba4398d-22ae-5110-9b32-0ce2c03feac0, identifier: 2213672
2025-12-03 06:02:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 2ba4398d-22ae-5110-9b32-0ce2c03feac0 with identifier: 2213672
2025-12-03 06:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-03 06:02:41 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=GREEN HTTP/1.1" 200 None
2025-12-03 06:02:41 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-03 06:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-03 06:02:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 2ba4398d-22ae-5110-9b32-0ce2c03feac0 with identifier: 2213672
2025-12-03 06:02:41 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 187055 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    187055
2025-12-03 06:02:41 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 2ba4398d-22ae-5110-9b32-0ce2c03feac0 spider: manheim.gb
2025-12-03 06:02:41 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 2ba4398d-22ae-5110-9b32-0ce2c03feac0 due to rule: high_mileage_for_country.json, error: 187055 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    187055
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ba4398d-22ae-5110-9b32-0ce2c03feac0/2ba4398d-22ae-5110-9b32-0ce2c03feac0_expert_report_file_5574b6e1-ca83-4a17-89a3-735b56afe5c4.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002213672-01989421-002.pdf',
 'color': 'GREEN',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': '2025-12-03T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '2ba4398d-22ae-5110-9b32-0ce2c03feac0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'FN16CVR',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VAUXHALL/INSIGNIA?id=2213672',
 'listing': 'auction',
 'location': 'Washington',
 'make': 'VAUXHALL',
 'model': 'INSIGNIA',
 'odometer': 116231,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 41,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ba4398d-22ae-5110-9b32-0ce2c03feac0/2ba4398d-22ae-5110-9b32-0ce2c03feac0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 319507,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2213672-9999999-336111855-004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ba4398d-22ae-5110-9b32-0ce2c03feac0/2ba4398d-22ae-5110-9b32-0ce2c03feac0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 273307,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2213672-9999999-336111855-008.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ba4398d-22ae-5110-9b32-0ce2c03feac0/2ba4398d-22ae-5110-9b32-0ce2c03feac0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 289484,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2213672-9999999-336111855-001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ba4398d-22ae-5110-9b32-0ce2c03feac0/2ba4398d-22ae-5110-9b32-0ce2c03feac0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 253566,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2213672-9999999-336111855-002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ba4398d-22ae-5110-9b32-0ce2c03feac0/2ba4398d-22ae-5110-9b32-0ce2c03feac0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 293601,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2213672-9999999-336111855-003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ba4398d-22ae-5110-9b32-0ce2c03feac0/2ba4398d-22ae-5110-9b32-0ce2c03feac0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 270627,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2213672-9999999-336111855-005.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ba4398d-22ae-5110-9b32-0ce2c03feac0/2ba4398d-22ae-5110-9b32-0ce2c03feac0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 310009,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2213672-9999999-336111855-006.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ba4398d-22ae-5110-9b32-0ce2c03feac0/2ba4398d-22ae-5110-9b32-0ce2c03feac0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 261574,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2213672-9999999-336111855-007.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ba4398d-22ae-5110-9b32-0ce2c03feac0/2ba4398d-22ae-5110-9b32-0ce2c03feac0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 316424,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2213672-9999999-336111855-009.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ba4398d-22ae-5110-9b32-0ce2c03feac0/2ba4398d-22ae-5110-9b32-0ce2c03feac0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 279502,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2213672-9999999-336111855-010.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ba4398d-22ae-5110-9b32-0ce2c03feac0/2ba4398d-22ae-5110-9b32-0ce2c03feac0_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 282732,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2213672-9999999-336111855-011.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ba4398d-22ae-5110-9b32-0ce2c03feac0/2ba4398d-22ae-5110-9b32-0ce2c03feac0_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 243758,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2213672-9999999-336111855-012.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ba4398d-22ae-5110-9b32-0ce2c03feac0/2ba4398d-22ae-5110-9b32-0ce2c03feac0_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 405910,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2213672-4004628-13.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ba4398d-22ae-5110-9b32-0ce2c03feac0/2ba4398d-22ae-5110-9b32-0ce2c03feac0_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 258429,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2213672-4004628-1000.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ba4398d-22ae-5110-9b32-0ce2c03feac0/2ba4398d-22ae-5110-9b32-0ce2c03feac0_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 282942,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2213672-4004628-1001.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ba4398d-22ae-5110-9b32-0ce2c03feac0/2ba4398d-22ae-5110-9b32-0ce2c03feac0_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 269846,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2213672-4004628-1002.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ba4398d-22ae-5110-9b32-0ce2c03feac0/2ba4398d-22ae-5110-9b32-0ce2c03feac0_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 294385,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2213672-4004628-1003.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ba4398d-22ae-5110-9b32-0ce2c03feac0/2ba4398d-22ae-5110-9b32-0ce2c03feac0_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 331126,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2213672-4004628-1004.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ba4398d-22ae-5110-9b32-0ce2c03feac0/2ba4398d-22ae-5110-9b32-0ce2c03feac0_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 327593,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2213672-4004628-1005.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ba4398d-22ae-5110-9b32-0ce2c03feac0/2ba4398d-22ae-5110-9b32-0ce2c03feac0_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 379254,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2213672-4004628-1006.jpg',
             'Width': 1500}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-31',
 'seller_name': 'Lookers',
 'title': 'VAUXHALL INSIGNIA 1.6 CDTi SRi Vx-line Nav 5dr [Start Stop]',
 'transmission': 'manual',
 'trim': '1.6 CDTi SRi Vx-line Nav 5dr [Start Stop]',
 'year': 2016}
2025-12-03 06:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272213672%27 HTTP/1.1" 200 None
2025-12-03 06:02:41 [manheim.gb] INFO: Saving data for 2213672: {'created_time': 1764741761.881281, 'last_price_update_time': 1764741761.881292, 'auction_closing_time': 1764752400.0}
2025-12-03 06:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2213672') HTTP/1.1" 204 0
2025-12-03 06:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/PASSAT?id=2292927&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232292927&indx=111> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:02:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:02:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57ef5ea6-afe6-50b8-95a1-f7f2c46852cb with identifier: 2292927
2025-12-03 06:02:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57ef5ea6-afe6-50b8-95a1-f7f2c46852cb with scrape type 2
2025-12-03 06:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 57ef5ea6-afe6-50b8-95a1-f7f2c46852cb with scrape type 2
2025-12-03 06:02:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 57ef5ea6-afe6-50b8-95a1-f7f2c46852cb, identifier: 2292927
2025-12-03 06:02:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 57ef5ea6-afe6-50b8-95a1-f7f2c46852cb with identifier: 2292927
2025-12-03 06:02:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 57ef5ea6-afe6-50b8-95a1-f7f2c46852cb with identifier: 2292927
2025-12-03 06:02:47 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 173356 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    173356
2025-12-03 06:02:47 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 57ef5ea6-afe6-50b8-95a1-f7f2c46852cb spider: manheim.gb
2025-12-03 06:02:47 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 57ef5ea6-afe6-50b8-95a1-f7f2c46852cb due to rule: high_mileage_for_country.json, error: 173356 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    173356
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002292927-01960245-007.pdf',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '57ef5ea6-afe6-50b8-95a1-f7f2c46852cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'SL15LZM',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/PASSAT?id=2292927',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT',
 'odometer': 107719,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-27',
 'seller_name': 'Big Motoring World Ltd',
 'title': 'VOLKSWAGEN PASSAT 1.6 TDI SE Business 5dr',
 'transmission': 'manual',
 'trim': '1.6 TDI SE Business 5dr',
 'year': 2015}
2025-12-03 06:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272292927%27 HTTP/1.1" 200 None
2025-12-03 06:02:47 [manheim.gb] INFO: Saving data for 2292927: {'auction_closing_time': 1764838800.0, 'created_time': 1764583868.58709, 'last_price_update_time': 1764741767.524937}
2025-12-03 06:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2292927') HTTP/1.1" 204 0
2025-12-03 06:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/FORD/FOCUS?id=2437613&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232437613&indx=131> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:02:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:02:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00ab3a24-8ec7-5aa6-b9a1-789576a1c9a4 with identifier: 2437613
2025-12-03 06:02:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00ab3a24-8ec7-5aa6-b9a1-789576a1c9a4 with scrape type 2
2025-12-03 06:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00ab3a24-8ec7-5aa6-b9a1-789576a1c9a4 with scrape type 2
2025-12-03 06:02:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 00ab3a24-8ec7-5aa6-b9a1-789576a1c9a4, identifier: 2437613
2025-12-03 06:02:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 00ab3a24-8ec7-5aa6-b9a1-789576a1c9a4 with identifier: 2437613
2025-12-03 06:02:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 00ab3a24-8ec7-5aa6-b9a1-789576a1c9a4 with identifier: 2437613
2025-12-03 06:02:50 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 00ab3a24-8ec7-5aa6-b9a1-789576a1c9a4 with identifier: 2437613 to the API
2025-12-03 06:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 06:02:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 06:02:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/FORD/FOCUS?id=2437613&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232437613&indx=131>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002437613-01987146-008.pdf',
 'color': 'SILVER',
 'currency': 'GBP',
 'engine': '1.0L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '00ab3a24-8ec7-5aa6-b9a1-789576a1c9a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'WM19RVJ',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FORD/FOCUS?id=2437613',
 'listing': 'auction',
 'location': 'Manchester',
 'make': 'FORD',
 'model': 'FOCUS',
 'odometer': 48051,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-07',
 'seller_name': 'Santander Consumer',
 'title': 'FORD FOCUS 1.0 EcoBoost 125 ST-Line 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.0 EcoBoost 125 ST-Line 5dr Auto',
 'year': 2019}
2025-12-03 06:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272437613%27 HTTP/1.1" 200 None
2025-12-03 06:02:50 [manheim.gb] INFO: Saving data for 2437613: {'auction_closing_time': 1764838800.0, 'created_time': 1764583890.435912, 'last_price_update_time': 1764741770.276238}
2025-12-03 06:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2437613') HTTP/1.1" 204 0
2025-12-03 06:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/ALFA%20ROMEO/GIULIETTA?id=2939815&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232939815&indx=186> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:02:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:02:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ae5adda-d662-5517-bf59-4f4e341057e9 with identifier: 2939815
2025-12-03 06:02:51 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 4ae5adda-d662-5517-bf59-4f4e341057e9
2025-12-03 06:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/CCLASS?id=2944079&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232944079&indx=187> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:02:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:02:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f89780c6-849e-5731-a797-a059e7e90159 with identifier: 2944079
2025-12-03 06:02:51 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item f89780c6-849e-5731-a797-a059e7e90159
2025-12-03 06:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0002939815-01982696-003.pdf> (referer: None)
2025-12-03 06:02:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:02:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6073890>
2025-12-03 06:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:02:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ae5adda-d662-5517-bf59-4f4e341057e9/4ae5adda-d662-5517-bf59-4f4e341057e9_expert_report_file_4f8c1a7e-2d29-4428-83a3-d87025247099.pdf HTTP/1.1" 201 0
2025-12-03 06:02:52 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 4ae5adda-d662-5517-bf59-4f4e341057e9
2025-12-03 06:02:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4ae5adda-d662-5517-bf59-4f4e341057e9, skipping ID generation
2025-12-03 06:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 4ae5adda-d662-5517-bf59-4f4e341057e9
2025-12-03 06:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7055a81f-1bb7-4d01-8318-d48b827a2bc3_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7055a81f-1bb7-4d01-8318-d48b827a2bc3_ext_7.jpg not downloaded yet
2025-12-03 06:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7055a81f-1bb7-4d01-8318-d48b827a2bc3_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7055a81f-1bb7-4d01-8318-d48b827a2bc3_ext_7.jpg not downloaded yet
2025-12-03 06:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7055a81f-1bb7-4d01-8318-d48b827a2bc3_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7055a81f-1bb7-4d01-8318-d48b827a2bc3_ext_6.jpg not downloaded yet
2025-12-03 06:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7055a81f-1bb7-4d01-8318-d48b827a2bc3_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7055a81f-1bb7-4d01-8318-d48b827a2bc3_ext_1.jpg not downloaded yet
2025-12-03 06:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7055a81f-1bb7-4d01-8318-d48b827a2bc3_5.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7055a81f-1bb7-4d01-8318-d48b827a2bc3_5.jpg not downloaded yet
2025-12-03 06:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7055a81f-1bb7-4d01-8318-d48b827a2bc3_4.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7055a81f-1bb7-4d01-8318-d48b827a2bc3_4.jpg not downloaded yet
2025-12-03 06:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7055a81f-1bb7-4d01-8318-d48b827a2bc3_11.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7055a81f-1bb7-4d01-8318-d48b827a2bc3_11.jpg not downloaded yet
2025-12-03 06:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7055a81f-1bb7-4d01-8318-d48b827a2bc3_10.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7055a81f-1bb7-4d01-8318-d48b827a2bc3_10.jpg not downloaded yet
2025-12-03 06:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7055a81f-1bb7-4d01-8318-d48b827a2bc3_9.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7055a81f-1bb7-4d01-8318-d48b827a2bc3_9.jpg not downloaded yet
2025-12-03 06:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7055a81f-1bb7-4d01-8318-d48b827a2bc3_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7055a81f-1bb7-4d01-8318-d48b827a2bc3_ext_2.jpg not downloaded yet
2025-12-03 06:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7055a81f-1bb7-4d01-8318-d48b827a2bc3_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7055a81f-1bb7-4d01-8318-d48b827a2bc3_ext_5.jpg not downloaded yet
2025-12-03 06:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7055a81f-1bb7-4d01-8318-d48b827a2bc3_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7055a81f-1bb7-4d01-8318-d48b827a2bc3_ext_3.jpg not downloaded yet
2025-12-03 06:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7055a81f-1bb7-4d01-8318-d48b827a2bc3_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7055a81f-1bb7-4d01-8318-d48b827a2bc3_ext_4.jpg not downloaded yet
2025-12-03 06:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2939815-3998414-13.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2939815-3998414-13.jpg not downloaded yet
2025-12-03 06:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2939815-3998414-1000.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2939815-3998414-1000.jpg not downloaded yet
2025-12-03 06:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2939815-3998414-1001.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2939815-3998414-1001.jpg not downloaded yet
2025-12-03 06:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2939815-3998414-1002.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2939815-3998414-1002.jpg not downloaded yet
2025-12-03 06:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2939815-3998414-1003.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2939815-3998414-1003.jpg not downloaded yet
2025-12-03 06:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2939815-3998414-1004.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2939815-3998414-1004.jpg not downloaded yet
2025-12-03 06:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2939815-3998414-1005.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2939815-3998414-1005.jpg not downloaded yet
2025-12-03 06:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0002944079-01990142-008.pdf> (referer: None)
2025-12-03 06:02:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:02:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6221510>
2025-12-03 06:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:02:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f89780c6-849e-5731-a797-a059e7e90159/f89780c6-849e-5731-a797-a059e7e90159_expert_report_file_b39511d7-7a53-489a-9a47-a4347502abfd.pdf HTTP/1.1" 201 0
2025-12-03 06:02:53 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item f89780c6-849e-5731-a797-a059e7e90159
2025-12-03 06:02:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f89780c6-849e-5731-a797-a059e7e90159, skipping ID generation
2025-12-03 06:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item f89780c6-849e-5731-a797-a059e7e90159
2025-12-03 06:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F310038da-5227-480b-a9d0-49dbb21de4c9_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/310038da-5227-480b-a9d0-49dbb21de4c9_ext_7.jpg not downloaded yet
2025-12-03 06:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F310038da-5227-480b-a9d0-49dbb21de4c9_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/310038da-5227-480b-a9d0-49dbb21de4c9_ext_7.jpg not downloaded yet
2025-12-03 06:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F310038da-5227-480b-a9d0-49dbb21de4c9_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/310038da-5227-480b-a9d0-49dbb21de4c9_ext_6.jpg not downloaded yet
2025-12-03 06:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2939815-3998414-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002939815-01982696-003.pdf)
2025-12-03 06:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F310038da-5227-480b-a9d0-49dbb21de4c9_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/310038da-5227-480b-a9d0-49dbb21de4c9_ext_1.jpg not downloaded yet
2025-12-03 06:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F310038da-5227-480b-a9d0-49dbb21de4c9_5.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/310038da-5227-480b-a9d0-49dbb21de4c9_5.jpg not downloaded yet
2025-12-03 06:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F310038da-5227-480b-a9d0-49dbb21de4c9_4.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/310038da-5227-480b-a9d0-49dbb21de4c9_4.jpg not downloaded yet
2025-12-03 06:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F310038da-5227-480b-a9d0-49dbb21de4c9_11.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/310038da-5227-480b-a9d0-49dbb21de4c9_11.jpg not downloaded yet
2025-12-03 06:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F310038da-5227-480b-a9d0-49dbb21de4c9_10.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/310038da-5227-480b-a9d0-49dbb21de4c9_10.jpg not downloaded yet
2025-12-03 06:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F310038da-5227-480b-a9d0-49dbb21de4c9_9.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/310038da-5227-480b-a9d0-49dbb21de4c9_9.jpg not downloaded yet
2025-12-03 06:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F310038da-5227-480b-a9d0-49dbb21de4c9_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/310038da-5227-480b-a9d0-49dbb21de4c9_ext_2.jpg not downloaded yet
2025-12-03 06:02:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:02:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f62af510>
2025-12-03 06:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:02:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 06:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ae5adda-d662-5517-bf59-4f4e341057e9/4ae5adda-d662-5517-bf59-4f4e341057e9_image_19.jpg HTTP/1.1" 201 0
2025-12-03 06:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2939815-3998414-1005.jpg') HTTP/1.1" 204 0
2025-12-03 06:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2939815-3998414-1005.jpg saved to cache
2025-12-03 06:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 4ae5adda-d662-5517-bf59-4f4e341057e9
2025-12-03 06:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F310038da-5227-480b-a9d0-49dbb21de4c9_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/310038da-5227-480b-a9d0-49dbb21de4c9_ext_5.jpg not downloaded yet
2025-12-03 06:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F310038da-5227-480b-a9d0-49dbb21de4c9_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/310038da-5227-480b-a9d0-49dbb21de4c9_ext_3.jpg not downloaded yet
2025-12-03 06:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/310038da-5227-480b-a9d0-49dbb21de4c9_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002944079-01990142-008.pdf)
2025-12-03 06:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F310038da-5227-480b-a9d0-49dbb21de4c9_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/310038da-5227-480b-a9d0-49dbb21de4c9_ext_4.jpg not downloaded yet
2025-12-03 06:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2944079-4005370-13.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2944079-4005370-13.jpg not downloaded yet
2025-12-03 06:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2944079-4005370-1000.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2944079-4005370-1000.jpg not downloaded yet
2025-12-03 06:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2944079-4005370-1001.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2944079-4005370-1001.jpg not downloaded yet
2025-12-03 06:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2944079-4005370-1002.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2944079-4005370-1002.jpg not downloaded yet
2025-12-03 06:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2944079-4005370-1003.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2944079-4005370-1003.jpg not downloaded yet
2025-12-03 06:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2944079-4005370-1004.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2944079-4005370-1004.jpg not downloaded yet
2025-12-03 06:02:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:02:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6220a10>
2025-12-03 06:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:02:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f89780c6-849e-5731-a797-a059e7e90159/f89780c6-849e-5731-a797-a059e7e90159_image_2.jpg HTTP/1.1" 201 0
2025-12-03 06:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F310038da-5227-480b-a9d0-49dbb21de4c9_ext_6.jpg') HTTP/1.1" 204 0
2025-12-03 06:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/310038da-5227-480b-a9d0-49dbb21de4c9_ext_6.jpg saved to cache
2025-12-03 06:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f89780c6-849e-5731-a797-a059e7e90159
2025-12-03 06:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2944079-4005370-1005.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2944079-4005370-1005.jpg not downloaded yet
2025-12-03 06:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/310038da-5227-480b-a9d0-49dbb21de4c9_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002944079-01990142-008.pdf)
2025-12-03 06:02:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:02:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6222810>
2025-12-03 06:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:02:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f89780c6-849e-5731-a797-a059e7e90159/f89780c6-849e-5731-a797-a059e7e90159_image_11.jpg HTTP/1.1" 201 0
2025-12-03 06:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F310038da-5227-480b-a9d0-49dbb21de4c9_ext_3.jpg') HTTP/1.1" 204 0
2025-12-03 06:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/310038da-5227-480b-a9d0-49dbb21de4c9_ext_3.jpg saved to cache
2025-12-03 06:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item f89780c6-849e-5731-a797-a059e7e90159
2025-12-03 06:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2944079-4005370-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002944079-01990142-008.pdf)
2025-12-03 06:02:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:02:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f61bd110>
2025-12-03 06:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:02:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f89780c6-849e-5731-a797-a059e7e90159/f89780c6-849e-5731-a797-a059e7e90159_image_19.jpg HTTP/1.1" 201 0
2025-12-03 06:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2944079-4005370-1005.jpg') HTTP/1.1" 204 0
2025-12-03 06:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2944079-4005370-1005.jpg saved to cache
2025-12-03 06:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item f89780c6-849e-5731-a797-a059e7e90159
2025-12-03 06:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/RENAULT/CAPTUR?id=2907665&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232907665&indx=182> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:02:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2944079-4005370-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002944079-01990142-008.pdf)
2025-12-03 06:02:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abcb8dad-48c9-5dcd-97c7-4b80de57376d with identifier: 2907665
2025-12-03 06:02:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abcb8dad-48c9-5dcd-97c7-4b80de57376d with scrape type 2
2025-12-03 06:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item abcb8dad-48c9-5dcd-97c7-4b80de57376d with scrape type 2
2025-12-03 06:02:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: abcb8dad-48c9-5dcd-97c7-4b80de57376d, identifier: 2907665
2025-12-03 06:02:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: abcb8dad-48c9-5dcd-97c7-4b80de57376d with identifier: 2907665
2025-12-03 06:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-03 06:02:55 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=RED+AND+BLACK HTTP/1.1" 200 None
2025-12-03 06:02:55 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-03 06:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-03 06:02:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: abcb8dad-48c9-5dcd-97c7-4b80de57376d with identifier: 2907665
2025-12-03 06:02:55 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: abcb8dad-48c9-5dcd-97c7-4b80de57376d with identifier: 2907665 to the API
2025-12-03 06:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 06:02:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 06:02:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/RENAULT/CAPTUR?id=2907665&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232907665&indx=182>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002907665-01983048-003.pdf',
 'color': 'RED AND BLACK',
 'currency': 'GBP',
 'engine': '1.0L',
 'expiration_date': '2025-12-03T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'abcb8dad-48c9-5dcd-97c7-4b80de57376d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'HN21AXX',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/RENAULT/CAPTUR?id=2907665',
 'listing': 'auction',
 'location': 'Plymouth',
 'make': 'RENAULT',
 'model': 'CAPTUR',
 'odometer': 44876,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-26',
 'seller_name': 'Murray',
 'title': 'RENAULT CAPTUR 1.0 TCE 90 Iconic 5dr',
 'transmission': 'manual',
 'trim': '1.0 TCE 90 Iconic 5dr',
 'year': 2021}
2025-12-03 06:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272907665%27 HTTP/1.1" 200 None
2025-12-03 06:02:56 [manheim.gb] INFO: Saving data for 2907665: {'auction_closing_time': 1764752400.0, 'created_time': 1764583418.396425, 'last_price_update_time': 1764741776.134498}
2025-12-03 06:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2907665') HTTP/1.1" 204 0
2025-12-03 06:02:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:02:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f63e7850>
2025-12-03 06:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:02:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f89780c6-849e-5731-a797-a059e7e90159/f89780c6-849e-5731-a797-a059e7e90159_image_18.jpg HTTP/1.1" 201 0
2025-12-03 06:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2944079-4005370-1004.jpg') HTTP/1.1" 204 0
2025-12-03 06:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2944079-4005370-1004.jpg saved to cache
2025-12-03 06:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item f89780c6-849e-5731-a797-a059e7e90159
2025-12-03 06:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2944079-4005370-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002944079-01990142-008.pdf)
2025-12-03 06:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2944079-4005370-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002944079-01990142-008.pdf)
2025-12-03 06:02:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:02:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f62ebdd0>
2025-12-03 06:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:02:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f89780c6-849e-5731-a797-a059e7e90159/f89780c6-849e-5731-a797-a059e7e90159_image_17.jpg HTTP/1.1" 201 0
2025-12-03 06:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2944079-4005370-1003.jpg') HTTP/1.1" 204 0
2025-12-03 06:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2944079-4005370-1003.jpg saved to cache
2025-12-03 06:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item f89780c6-849e-5731-a797-a059e7e90159
2025-12-03 06:02:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:02:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f63c2150>
2025-12-03 06:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:02:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f89780c6-849e-5731-a797-a059e7e90159/f89780c6-849e-5731-a797-a059e7e90159_image_16.jpg HTTP/1.1" 201 0
2025-12-03 06:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2944079-4005370-1002.jpg') HTTP/1.1" 204 0
2025-12-03 06:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2944079-4005370-1002.jpg saved to cache
2025-12-03 06:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item f89780c6-849e-5731-a797-a059e7e90159
2025-12-03 06:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2944079-4005370-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002944079-01990142-008.pdf)
2025-12-03 06:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2944079-4005370-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002944079-01990142-008.pdf)
2025-12-03 06:02:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:02:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f52d88d0>
2025-12-03 06:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:02:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f89780c6-849e-5731-a797-a059e7e90159/f89780c6-849e-5731-a797-a059e7e90159_image_14.jpg HTTP/1.1" 201 0
2025-12-03 06:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2944079-4005370-1000.jpg') HTTP/1.1" 204 0
2025-12-03 06:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2944079-4005370-1000.jpg saved to cache
2025-12-03 06:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item f89780c6-849e-5731-a797-a059e7e90159
2025-12-03 06:02:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:02:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f65f3310>
2025-12-03 06:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:02:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 06:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f89780c6-849e-5731-a797-a059e7e90159/f89780c6-849e-5731-a797-a059e7e90159_image_15.jpg HTTP/1.1" 201 0
2025-12-03 06:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2944079-4005370-1001.jpg') HTTP/1.1" 204 0
2025-12-03 06:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2944079-4005370-1001.jpg saved to cache
2025-12-03 06:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item f89780c6-849e-5731-a797-a059e7e90159
2025-12-03 06:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/310038da-5227-480b-a9d0-49dbb21de4c9_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002944079-01990142-008.pdf)
2025-12-03 06:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2944079-4005370-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002944079-01990142-008.pdf)
2025-12-03 06:02:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:02:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6071b10>
2025-12-03 06:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:02:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f89780c6-849e-5731-a797-a059e7e90159/f89780c6-849e-5731-a797-a059e7e90159_image_12.jpg HTTP/1.1" 201 0
2025-12-03 06:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F310038da-5227-480b-a9d0-49dbb21de4c9_ext_4.jpg') HTTP/1.1" 204 0
2025-12-03 06:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/310038da-5227-480b-a9d0-49dbb21de4c9_ext_4.jpg saved to cache
2025-12-03 06:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item f89780c6-849e-5731-a797-a059e7e90159
2025-12-03 06:02:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:02:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f631d050>
2025-12-03 06:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:02:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f89780c6-849e-5731-a797-a059e7e90159/f89780c6-849e-5731-a797-a059e7e90159_image_13.jpg HTTP/1.1" 201 0
2025-12-03 06:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2944079-4005370-13.jpg') HTTP/1.1" 204 0
2025-12-03 06:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2944079-4005370-13.jpg saved to cache
2025-12-03 06:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item f89780c6-849e-5731-a797-a059e7e90159
2025-12-03 06:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/310038da-5227-480b-a9d0-49dbb21de4c9_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002944079-01990142-008.pdf)
2025-12-03 06:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/310038da-5227-480b-a9d0-49dbb21de4c9_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002944079-01990142-008.pdf)
2025-12-03 06:02:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:02:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f62f5810>
2025-12-03 06:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:02:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f89780c6-849e-5731-a797-a059e7e90159/f89780c6-849e-5731-a797-a059e7e90159_image_10.jpg HTTP/1.1" 201 0
2025-12-03 06:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F310038da-5227-480b-a9d0-49dbb21de4c9_ext_5.jpg') HTTP/1.1" 204 0
2025-12-03 06:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/310038da-5227-480b-a9d0-49dbb21de4c9_ext_5.jpg saved to cache
2025-12-03 06:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item f89780c6-849e-5731-a797-a059e7e90159
2025-12-03 06:02:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:02:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6392750>
2025-12-03 06:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:02:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f89780c6-849e-5731-a797-a059e7e90159/f89780c6-849e-5731-a797-a059e7e90159_image_9.jpg HTTP/1.1" 201 0
2025-12-03 06:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F310038da-5227-480b-a9d0-49dbb21de4c9_ext_2.jpg') HTTP/1.1" 204 0
2025-12-03 06:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/310038da-5227-480b-a9d0-49dbb21de4c9_ext_2.jpg saved to cache
2025-12-03 06:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f89780c6-849e-5731-a797-a059e7e90159
2025-12-03 06:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/310038da-5227-480b-a9d0-49dbb21de4c9_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002944079-01990142-008.pdf)
2025-12-03 06:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/310038da-5227-480b-a9d0-49dbb21de4c9_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002944079-01990142-008.pdf)
2025-12-03 06:02:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:02:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f63c2a10>
2025-12-03 06:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:03:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 06:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f89780c6-849e-5731-a797-a059e7e90159/f89780c6-849e-5731-a797-a059e7e90159_image_7.jpg HTTP/1.1" 201 0
2025-12-03 06:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F310038da-5227-480b-a9d0-49dbb21de4c9_10.jpg') HTTP/1.1" 204 0
2025-12-03 06:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/310038da-5227-480b-a9d0-49dbb21de4c9_10.jpg saved to cache
2025-12-03 06:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f89780c6-849e-5731-a797-a059e7e90159
2025-12-03 06:03:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:03:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f64a3f50>
2025-12-03 06:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:03:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f89780c6-849e-5731-a797-a059e7e90159/f89780c6-849e-5731-a797-a059e7e90159_image_8.jpg HTTP/1.1" 201 0
2025-12-03 06:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F310038da-5227-480b-a9d0-49dbb21de4c9_9.jpg') HTTP/1.1" 204 0
2025-12-03 06:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/310038da-5227-480b-a9d0-49dbb21de4c9_9.jpg saved to cache
2025-12-03 06:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f89780c6-849e-5731-a797-a059e7e90159
2025-12-03 06:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VAUXHALL/MOKKA?id=2936956&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232936956&indx=185> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/310038da-5227-480b-a9d0-49dbb21de4c9_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002944079-01990142-008.pdf)
2025-12-03 06:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/310038da-5227-480b-a9d0-49dbb21de4c9_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002944079-01990142-008.pdf)
2025-12-03 06:03:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:03:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44df412c-3345-521c-9331-79ebb8a6946d with identifier: 2936956
2025-12-03 06:03:00 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 44df412c-3345-521c-9331-79ebb8a6946d
2025-12-03 06:03:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:03:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6257890>
2025-12-03 06:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:03:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 06:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f89780c6-849e-5731-a797-a059e7e90159/f89780c6-849e-5731-a797-a059e7e90159_image_5.jpg HTTP/1.1" 201 0
2025-12-03 06:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F310038da-5227-480b-a9d0-49dbb21de4c9_4.jpg') HTTP/1.1" 204 0
2025-12-03 06:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/310038da-5227-480b-a9d0-49dbb21de4c9_4.jpg saved to cache
2025-12-03 06:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f89780c6-849e-5731-a797-a059e7e90159
2025-12-03 06:03:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:03:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f60305d0>
2025-12-03 06:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:03:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f89780c6-849e-5731-a797-a059e7e90159/f89780c6-849e-5731-a797-a059e7e90159_image_6.jpg HTTP/1.1" 201 0
2025-12-03 06:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F310038da-5227-480b-a9d0-49dbb21de4c9_11.jpg') HTTP/1.1" 204 0
2025-12-03 06:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/310038da-5227-480b-a9d0-49dbb21de4c9_11.jpg saved to cache
2025-12-03 06:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f89780c6-849e-5731-a797-a059e7e90159
2025-12-03 06:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/310038da-5227-480b-a9d0-49dbb21de4c9_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002944079-01990142-008.pdf)
2025-12-03 06:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/310038da-5227-480b-a9d0-49dbb21de4c9_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002944079-01990142-008.pdf)
2025-12-03 06:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/310038da-5227-480b-a9d0-49dbb21de4c9_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002944079-01990142-008.pdf)
2025-12-03 06:03:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:03:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f63293d0>
2025-12-03 06:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:03:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 06:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f89780c6-849e-5731-a797-a059e7e90159/f89780c6-849e-5731-a797-a059e7e90159_image_1.jpg HTTP/1.1" 201 0
2025-12-03 06:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F310038da-5227-480b-a9d0-49dbb21de4c9_ext_7.jpg') HTTP/1.1" 204 0
2025-12-03 06:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/310038da-5227-480b-a9d0-49dbb21de4c9_ext_7.jpg saved to cache
2025-12-03 06:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f89780c6-849e-5731-a797-a059e7e90159
2025-12-03 06:03:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:03:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6483e90>
2025-12-03 06:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:03:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 06:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f89780c6-849e-5731-a797-a059e7e90159/f89780c6-849e-5731-a797-a059e7e90159_image_4.jpg HTTP/1.1" 201 0
2025-12-03 06:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F310038da-5227-480b-a9d0-49dbb21de4c9_5.jpg') HTTP/1.1" 204 0
2025-12-03 06:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/310038da-5227-480b-a9d0-49dbb21de4c9_5.jpg saved to cache
2025-12-03 06:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f89780c6-849e-5731-a797-a059e7e90159
2025-12-03 06:03:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:03:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f632b6d0>
2025-12-03 06:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:03:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:03:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f89780c6-849e-5731-a797-a059e7e90159/f89780c6-849e-5731-a797-a059e7e90159_image_3.jpg HTTP/1.1" 201 0
2025-12-03 06:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F310038da-5227-480b-a9d0-49dbb21de4c9_ext_1.jpg') HTTP/1.1" 204 0
2025-12-03 06:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/310038da-5227-480b-a9d0-49dbb21de4c9_ext_1.jpg saved to cache
2025-12-03 06:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f89780c6-849e-5731-a797-a059e7e90159
2025-12-03 06:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/310038da-5227-480b-a9d0-49dbb21de4c9_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002944079-01990142-008.pdf)
2025-12-03 06:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2939815-3998414-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002939815-01982696-003.pdf)
2025-12-03 06:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0002936956-01974977-003.pdf> (referer: None)
2025-12-03 06:03:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:03:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:03:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:03:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f631d950>
2025-12-03 06:03:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:03:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 06:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:03:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f89780c6-849e-5731-a797-a059e7e90159/f89780c6-849e-5731-a797-a059e7e90159_image_0.jpg HTTP/1.1" 201 0
2025-12-03 06:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F310038da-5227-480b-a9d0-49dbb21de4c9_ext_7.jpg') HTTP/1.1" 204 0
2025-12-03 06:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/310038da-5227-480b-a9d0-49dbb21de4c9_ext_7.jpg saved to cache
2025-12-03 06:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f89780c6-849e-5731-a797-a059e7e90159
2025-12-03 06:03:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f89780c6-849e-5731-a797-a059e7e90159, skipping ID generation
2025-12-03 06:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Removing item f89780c6-849e-5731-a797-a059e7e90159 from tracking dictionaries
2025-12-03 06:03:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f89780c6-849e-5731-a797-a059e7e90159 sending to next pipeline
2025-12-03 06:03:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: f89780c6-849e-5731-a797-a059e7e90159, identifier: 2944079
2025-12-03 06:03:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: f89780c6-849e-5731-a797-a059e7e90159 with identifier: 2944079
2025-12-03 06:03:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: f89780c6-849e-5731-a797-a059e7e90159 with identifier: 2944079
2025-12-03 06:03:02 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: f89780c6-849e-5731-a797-a059e7e90159 with identifier: 2944079 to the API
2025-12-03 06:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 06:03:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 06:03:03 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/310038da-5227-480b-a9d0-49dbb21de4c9_ext_7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f89780c6-849e-5731-a797-a059e7e90159/f89780c6-849e-5731-a797-a059e7e90159_expert_report_file_b39511d7-7a53-489a-9a47-a4347502abfd.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002944079-01990142-008.pdf',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'f89780c6-849e-5731-a797-a059e7e90159',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'WX19OSC',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/C%20CLASS?id=2944079',
 'listing': 'auction',
 'location': 'Manchester',
 'make': 'MERCEDES-BENZ',
 'model': 'C CLASS',
 'odometer': 89412,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 45,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f89780c6-849e-5731-a797-a059e7e90159/f89780c6-849e-5731-a797-a059e7e90159_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 187170,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/310038da-5227-480b-a9d0-49dbb21de4c9_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f89780c6-849e-5731-a797-a059e7e90159/f89780c6-849e-5731-a797-a059e7e90159_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 187170,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/310038da-5227-480b-a9d0-49dbb21de4c9_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f89780c6-849e-5731-a797-a059e7e90159/f89780c6-849e-5731-a797-a059e7e90159_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 248058,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/310038da-5227-480b-a9d0-49dbb21de4c9_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f89780c6-849e-5731-a797-a059e7e90159/f89780c6-849e-5731-a797-a059e7e90159_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 201706,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/310038da-5227-480b-a9d0-49dbb21de4c9_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f89780c6-849e-5731-a797-a059e7e90159/f89780c6-849e-5731-a797-a059e7e90159_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 189591,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/310038da-5227-480b-a9d0-49dbb21de4c9_5.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f89780c6-849e-5731-a797-a059e7e90159/f89780c6-849e-5731-a797-a059e7e90159_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 192148,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/310038da-5227-480b-a9d0-49dbb21de4c9_4.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f89780c6-849e-5731-a797-a059e7e90159/f89780c6-849e-5731-a797-a059e7e90159_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 193851,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/310038da-5227-480b-a9d0-49dbb21de4c9_11.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f89780c6-849e-5731-a797-a059e7e90159/f89780c6-849e-5731-a797-a059e7e90159_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 185879,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/310038da-5227-480b-a9d0-49dbb21de4c9_10.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f89780c6-849e-5731-a797-a059e7e90159/f89780c6-849e-5731-a797-a059e7e90159_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 187175,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/310038da-5227-480b-a9d0-49dbb21de4c9_9.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f89780c6-849e-5731-a797-a059e7e90159/f89780c6-849e-5731-a797-a059e7e90159_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 262077,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/310038da-5227-480b-a9d0-49dbb21de4c9_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f89780c6-849e-5731-a797-a059e7e90159/f89780c6-849e-5731-a797-a059e7e90159_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 211242,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/310038da-5227-480b-a9d0-49dbb21de4c9_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f89780c6-849e-5731-a797-a059e7e90159/f89780c6-849e-5731-a797-a059e7e90159_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 231306,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/310038da-5227-480b-a9d0-49dbb21de4c9_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f89780c6-849e-5731-a797-a059e7e90159/f89780c6-849e-5731-a797-a059e7e90159_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 278430,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/310038da-5227-480b-a9d0-49dbb21de4c9_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f89780c6-849e-5731-a797-a059e7e90159/f89780c6-849e-5731-a797-a059e7e90159_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 401972,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2944079-4005370-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f89780c6-849e-5731-a797-a059e7e90159/f89780c6-849e-5731-a797-a059e7e90159_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 353084,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2944079-4005370-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f89780c6-849e-5731-a797-a059e7e90159/f89780c6-849e-5731-a797-a059e7e90159_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 483721,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2944079-4005370-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f89780c6-849e-5731-a797-a059e7e90159/f89780c6-849e-5731-a797-a059e7e90159_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 308402,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2944079-4005370-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f89780c6-849e-5731-a797-a059e7e90159/f89780c6-849e-5731-a797-a059e7e90159_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 246760,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2944079-4005370-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f89780c6-849e-5731-a797-a059e7e90159/f89780c6-849e-5731-a797-a059e7e90159_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 206662,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2944079-4005370-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f89780c6-849e-5731-a797-a059e7e90159/f89780c6-849e-5731-a797-a059e7e90159_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 230893,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2944079-4005370-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-29',
 'seller_name': 'MotoNovo Finance',
 'title': 'MERCEDES-BENZ C CLASS C220d AMG Line Premium 5dr 9G-Tronic',
 'transmission': 'automatic',
 'trim': 'C220d AMG Line Premium 5dr 9G-Tronic',
 'year': 2019}
2025-12-03 06:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272944079%27 HTTP/1.1" 200 None
2025-12-03 06:03:03 [manheim.gb] INFO: Saving data for 2944079: {'created_time': 1764741783.383254, 'last_price_update_time': 1764741783.383268, 'auction_closing_time': 1764838800.0}
2025-12-03 06:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2944079') HTTP/1.1" 204 0
2025-12-03 06:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2939815-3998414-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002939815-01982696-003.pdf)
2025-12-03 06:03:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:03:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6483810>
2025-12-03 06:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:03:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ae5adda-d662-5517-bf59-4f4e341057e9/4ae5adda-d662-5517-bf59-4f4e341057e9_image_18.jpg HTTP/1.1" 201 0
2025-12-03 06:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2939815-3998414-1004.jpg') HTTP/1.1" 204 0
2025-12-03 06:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2939815-3998414-1004.jpg saved to cache
2025-12-03 06:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 4ae5adda-d662-5517-bf59-4f4e341057e9
2025-12-03 06:03:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:03:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f635e610>
2025-12-03 06:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:03:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 06:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_expert_report_file_cbe560c9-f773-4d07-a3cb-fdc233976870.pdf HTTP/1.1" 201 0
2025-12-03 06:03:04 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 44df412c-3345-521c-9331-79ebb8a6946d
2025-12-03 06:03:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 44df412c-3345-521c-9331-79ebb8a6946d, skipping ID generation
2025-12-03 06:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 44df412c-3345-521c-9331-79ebb8a6946d
2025-12-03 06:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe107c060-eae5-4fd1-9751-a6731fe1fbce_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_ext_7.jpg not downloaded yet
2025-12-03 06:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/NISSAN/LEAF?id=2896151&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232896151&indx=181> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2939815-3998414-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002939815-01982696-003.pdf)
2025-12-03 06:03:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe107c060-eae5-4fd1-9751-a6731fe1fbce_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_ext_7.jpg not downloaded yet
2025-12-03 06:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2939815-3998414-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002939815-01982696-003.pdf)
2025-12-03 06:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe107c060-eae5-4fd1-9751-a6731fe1fbce_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_ext_6.jpg not downloaded yet
2025-12-03 06:03:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:03:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f659e250>
2025-12-03 06:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:03:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ae5adda-d662-5517-bf59-4f4e341057e9/4ae5adda-d662-5517-bf59-4f4e341057e9_image_15.jpg HTTP/1.1" 201 0
2025-12-03 06:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2939815-3998414-1001.jpg') HTTP/1.1" 204 0
2025-12-03 06:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2939815-3998414-1001.jpg saved to cache
2025-12-03 06:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 4ae5adda-d662-5517-bf59-4f4e341057e9
2025-12-03 06:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe107c060-eae5-4fd1-9751-a6731fe1fbce_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_ext_1.jpg not downloaded yet
2025-12-03 06:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe107c060-eae5-4fd1-9751-a6731fe1fbce_5.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_5.jpg not downloaded yet
2025-12-03 06:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2939815-3998414-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002939815-01982696-003.pdf)
2025-12-03 06:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002936956-01974977-003.pdf)
2025-12-03 06:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7055a81f-1bb7-4d01-8318-d48b827a2bc3_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002939815-01982696-003.pdf)
2025-12-03 06:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe107c060-eae5-4fd1-9751-a6731fe1fbce_4.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_4.jpg not downloaded yet
2025-12-03 06:03:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75d5daf1-4a83-5ab2-94a8-a355c23ee501 with identifier: 2896151
2025-12-03 06:03:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75d5daf1-4a83-5ab2-94a8-a355c23ee501 with scrape type 2
2025-12-03 06:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75d5daf1-4a83-5ab2-94a8-a355c23ee501 with scrape type 2
2025-12-03 06:03:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 75d5daf1-4a83-5ab2-94a8-a355c23ee501, identifier: 2896151
2025-12-03 06:03:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:03:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6221150>
2025-12-03 06:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:03:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ae5adda-d662-5517-bf59-4f4e341057e9/4ae5adda-d662-5517-bf59-4f4e341057e9_image_17.jpg HTTP/1.1" 201 0
2025-12-03 06:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2939815-3998414-1003.jpg') HTTP/1.1" 204 0
2025-12-03 06:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2939815-3998414-1003.jpg saved to cache
2025-12-03 06:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 4ae5adda-d662-5517-bf59-4f4e341057e9
2025-12-03 06:03:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:03:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f65bd650>
2025-12-03 06:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:03:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ae5adda-d662-5517-bf59-4f4e341057e9/4ae5adda-d662-5517-bf59-4f4e341057e9_image_16.jpg HTTP/1.1" 201 0
2025-12-03 06:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2939815-3998414-1002.jpg') HTTP/1.1" 204 0
2025-12-03 06:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2939815-3998414-1002.jpg saved to cache
2025-12-03 06:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 4ae5adda-d662-5517-bf59-4f4e341057e9
2025-12-03 06:03:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 75d5daf1-4a83-5ab2-94a8-a355c23ee501 with identifier: 2896151
2025-12-03 06:03:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 75d5daf1-4a83-5ab2-94a8-a355c23ee501 with identifier: 2896151
2025-12-03 06:03:05 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': 'motonovo finance', 'price_includes_vat': False, 'title': 'nissan leaf 110kw tekna 40kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'nissan', 'model': 'leaf', 'transmission': 'automatic', 'engine': '0.0l', 'fuel_type': 'electric', 'odometer': 41660, 'odometer_reading_unit': 'mi', 'registration_date': '2019-01-31', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/nissan/leaf?id=2896151', 'location': 'shotts', 'origin_country_code': 'gb', 'trim': '110kw tekna 40kwh 5dr auto', 'license_plate': 'kf68zth', 'year': 2019, 'listing': 'auction', 'c_o_2_emission_value': 0, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002896151-01988633-004.pdf', 'expiration_date': '2025-12-09t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': '75d5daf1-4a83-5ab2-94a8-a355c23ee501', 'current_year_diff': 6, 'age_in_months': 82, 'make_model': 'nissan leaf', 'sanitized_make': 'nissan', 'odometer_in_km': 67045} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 82,
     'auction_title': '',
     'c_o_2_emission_value': 0,
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002896151-01988633-004.pdf',
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 6,
     'engine': '0.0l',
     'expiration_date': '2025-12-09t09:00:00z',
     'fuel_type': 'electric',
     'id': '75d5daf1-4a83-5ab2-94a8-a355c23ee501',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'kf68zth',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/nissan/leaf?id=2896151',
     'listing': 'auction',
     'location': 'shotts',
     'make': 'nissan',
     'make_model': 'nissan leaf',
     'model': 'leaf',
     'odometer': 41660,
     'odometer_in_km': 67045,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2019-01-31',
     'sanitized_make': 'nissan',
     'seller_name': 'motonovo finance',
     'title': 'nissan leaf 110kw tekna 40kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '110kw tekna 40kwh 5dr auto',
     'year': 2019}
2025-12-03 06:03:05 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 75d5daf1-4a83-5ab2-94a8-a355c23ee501 spider: manheim.gb
2025-12-03 06:03:05 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 75d5daf1-4a83-5ab2-94a8-a355c23ee501 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': 'motonovo finance', 'price_includes_vat': False, 'title': 'nissan leaf 110kw tekna 40kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'nissan', 'model': 'leaf', 'transmission': 'automatic', 'engine': '0.0l', 'fuel_type': 'electric', 'odometer': 41660, 'odometer_reading_unit': 'mi', 'registration_date': '2019-01-31', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/nissan/leaf?id=2896151', 'location': 'shotts', 'origin_country_code': 'gb', 'trim': '110kw tekna 40kwh 5dr auto', 'license_plate': 'kf68zth', 'year': 2019, 'listing': 'auction', 'c_o_2_emission_value': 0, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002896151-01988633-004.pdf', 'expiration_date': '2025-12-09t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': '75d5daf1-4a83-5ab2-94a8-a355c23ee501', 'current_year_diff': 6, 'age_in_months': 82, 'make_model': 'nissan leaf', 'sanitized_make': 'nissan', 'odometer_in_km': 67045} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 82,
     'auction_title': '',
     'c_o_2_emission_value': 0,
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002896151-01988633-004.pdf',
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 6,
     'engine': '0.0l',
     'expiration_date': '2025-12-09t09:00:00z',
     'fuel_type': 'electric',
     'id': '75d5daf1-4a83-5ab2-94a8-a355c23ee501',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'kf68zth',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/nissan/leaf?id=2896151',
     'listing': 'auction',
     'location': 'shotts',
     'make': 'nissan',
     'make_model': 'nissan leaf',
     'model': 'leaf',
     'odometer': 41660,
     'odometer_in_km': 67045,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2019-01-31',
     'sanitized_make': 'nissan',
     'seller_name': 'motonovo finance',
     'title': 'nissan leaf 110kw tekna 40kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '110kw tekna 40kwh 5dr auto',
     'year': 2019}
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002896151-01988633-004.pdf',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '0.0L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Electric',
 'id': '75d5daf1-4a83-5ab2-94a8-a355c23ee501',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'KF68ZTH',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/NISSAN/LEAF?id=2896151',
 'listing': 'auction',
 'location': 'Shotts',
 'make': 'NISSAN',
 'model': 'LEAF',
 'odometer': 41660,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-31',
 'seller_name': 'MotoNovo Finance',
 'title': 'NISSAN LEAF 110kW Tekna 40kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '110kW Tekna 40kWh 5dr Auto',
 'year': 2019}
2025-12-03 06:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272896151%27 HTTP/1.1" 200 None
2025-12-03 06:03:05 [manheim.gb] INFO: Saving data for 2896151: {'auction_closing_time': 1765270800.0, 'created_time': 1764583477.707989, 'last_price_update_time': 1764741785.899726}
2025-12-03 06:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2896151') HTTP/1.1" 204 0
2025-12-03 06:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe107c060-eae5-4fd1-9751-a6731fe1fbce_11.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_11.jpg not downloaded yet
2025-12-03 06:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2939815-3998414-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002939815-01982696-003.pdf)
2025-12-03 06:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe107c060-eae5-4fd1-9751-a6731fe1fbce_10.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_10.jpg not downloaded yet
2025-12-03 06:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002936956-01974977-003.pdf)
2025-12-03 06:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002936956-01974977-003.pdf)
2025-12-03 06:03:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:03:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f614d150>
2025-12-03 06:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:03:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 06:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ae5adda-d662-5517-bf59-4f4e341057e9/4ae5adda-d662-5517-bf59-4f4e341057e9_image_14.jpg HTTP/1.1" 201 0
2025-12-03 06:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2939815-3998414-1000.jpg') HTTP/1.1" 204 0
2025-12-03 06:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2939815-3998414-1000.jpg saved to cache
2025-12-03 06:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 4ae5adda-d662-5517-bf59-4f4e341057e9
2025-12-03 06:03:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:03:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f63e5e10>
2025-12-03 06:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:03:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_0.jpg HTTP/1.1" 201 0
2025-12-03 06:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe107c060-eae5-4fd1-9751-a6731fe1fbce_ext_7.jpg') HTTP/1.1" 204 0
2025-12-03 06:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_ext_7.jpg saved to cache
2025-12-03 06:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 44df412c-3345-521c-9331-79ebb8a6946d
2025-12-03 06:03:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:03:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f61600d0>
2025-12-03 06:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:03:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ae5adda-d662-5517-bf59-4f4e341057e9/4ae5adda-d662-5517-bf59-4f4e341057e9_image_12.jpg HTTP/1.1" 201 0
2025-12-03 06:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7055a81f-1bb7-4d01-8318-d48b827a2bc3_ext_4.jpg') HTTP/1.1" 204 0
2025-12-03 06:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7055a81f-1bb7-4d01-8318-d48b827a2bc3_ext_4.jpg saved to cache
2025-12-03 06:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 4ae5adda-d662-5517-bf59-4f4e341057e9
2025-12-03 06:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002936956-01974977-003.pdf)
2025-12-03 06:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe107c060-eae5-4fd1-9751-a6731fe1fbce_9.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_9.jpg not downloaded yet
2025-12-03 06:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe107c060-eae5-4fd1-9751-a6731fe1fbce_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_ext_2.jpg not downloaded yet
2025-12-03 06:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/LAND%20ROVER/DISCOVERYSPORT?id=2893691&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232893691&indx=180> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:03:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:03:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f63572d0>
2025-12-03 06:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:03:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ae5adda-d662-5517-bf59-4f4e341057e9/4ae5adda-d662-5517-bf59-4f4e341057e9_image_13.jpg HTTP/1.1" 201 0
2025-12-03 06:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2939815-3998414-13.jpg') HTTP/1.1" 204 0
2025-12-03 06:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2939815-3998414-13.jpg saved to cache
2025-12-03 06:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 4ae5adda-d662-5517-bf59-4f4e341057e9
2025-12-03 06:03:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:03:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6436ad0>
2025-12-03 06:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:03:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_3.jpg HTTP/1.1" 201 0
2025-12-03 06:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe107c060-eae5-4fd1-9751-a6731fe1fbce_ext_1.jpg') HTTP/1.1" 204 0
2025-12-03 06:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_ext_1.jpg saved to cache
2025-12-03 06:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 44df412c-3345-521c-9331-79ebb8a6946d
2025-12-03 06:03:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:03:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6493b50>
2025-12-03 06:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:03:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_4.jpg HTTP/1.1" 201 0
2025-12-03 06:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe107c060-eae5-4fd1-9751-a6731fe1fbce_5.jpg') HTTP/1.1" 204 0
2025-12-03 06:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_5.jpg saved to cache
2025-12-03 06:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 44df412c-3345-521c-9331-79ebb8a6946d
2025-12-03 06:03:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe107c060-eae5-4fd1-9751-a6731fe1fbce_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_ext_5.jpg not downloaded yet
2025-12-03 06:03:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002936956-01974977-003.pdf)
2025-12-03 06:03:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002936956-01974977-003.pdf)
2025-12-03 06:03:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002936956-01974977-003.pdf)
2025-12-03 06:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe107c060-eae5-4fd1-9751-a6731fe1fbce_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_ext_3.jpg not downloaded yet
2025-12-03 06:03:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002936956-01974977-003.pdf)
2025-12-03 06:03:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:03:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6390f90>
2025-12-03 06:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:03:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_2.jpg HTTP/1.1" 201 0
2025-12-03 06:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe107c060-eae5-4fd1-9751-a6731fe1fbce_ext_6.jpg') HTTP/1.1" 204 0
2025-12-03 06:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_ext_6.jpg saved to cache
2025-12-03 06:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 44df412c-3345-521c-9331-79ebb8a6946d
2025-12-03 06:03:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e50fcc1-7dad-50a7-a08b-d3bc8e588772 with identifier: 2893691
2025-12-03 06:03:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e50fcc1-7dad-50a7-a08b-d3bc8e588772 with scrape type 2
2025-12-03 06:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6e50fcc1-7dad-50a7-a08b-d3bc8e588772 with scrape type 2
2025-12-03 06:03:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 6e50fcc1-7dad-50a7-a08b-d3bc8e588772, identifier: 2893691
2025-12-03 06:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe107c060-eae5-4fd1-9751-a6731fe1fbce_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_ext_4.jpg not downloaded yet
2025-12-03 06:03:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 6e50fcc1-7dad-50a7-a08b-d3bc8e588772 with identifier: 2893691
2025-12-03 06:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-03 06:03:08 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Blue HTTP/1.1" 200 None
2025-12-03 06:03:08 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-03 06:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-03 06:03:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 6e50fcc1-7dad-50a7-a08b-d3bc8e588772 with identifier: 2893691
2025-12-03 06:03:08 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 134191 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    134191
2025-12-03 06:03:08 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 6e50fcc1-7dad-50a7-a08b-d3bc8e588772 spider: manheim.gb
2025-12-03 06:03:08 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 6e50fcc1-7dad-50a7-a08b-d3bc8e588772 due to rule: high_mileage_for_make.json, error: 134191 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    134191
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'car_expert_report_source_url': None,
 'color': 'Blue',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '6e50fcc1-7dad-50a7-a08b-d3bc8e588772',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'KP18YTC',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/LAND%20ROVER/DISCOVERY%20SPORT?id=2893691',
 'listing': 'auction',
 'location': 'Colchester - In Transit',
 'make': 'LAND ROVER',
 'model': 'DISCOVERY SPORT',
 'odometer': 83383,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-27',
 'seller_name': 'Big Motoring World Ltd',
 'title': 'LAND ROVER DISCOVERY SPORT 2.0 TD4 180 HSE Black 5dr Auto',
 'transmission': 'automatic',
 'trim': '2.0 TD4 180 HSE Black 5dr Auto',
 'year': 2018}
2025-12-03 06:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272893691%27 HTTP/1.1" 200 None
2025-12-03 06:03:08 [manheim.gb] INFO: Saving data for 2893691: {'auction_closing_time': 1765270800.0, 'created_time': 1764583559.280701, 'last_price_update_time': 1764741788.655965}
2025-12-03 06:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2893691') HTTP/1.1" 204 0
2025-12-03 06:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2936956-3997429-13.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2936956-3997429-13.jpg not downloaded yet
2025-12-03 06:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7055a81f-1bb7-4d01-8318-d48b827a2bc3_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002939815-01982696-003.pdf)
2025-12-03 06:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7055a81f-1bb7-4d01-8318-d48b827a2bc3_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002939815-01982696-003.pdf)
2025-12-03 06:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002936956-01974977-003.pdf)
2025-12-03 06:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2936956-3997429-1000.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2936956-3997429-1000.jpg not downloaded yet
2025-12-03 06:03:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:03:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f62555d0>
2025-12-03 06:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:03:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_5.jpg HTTP/1.1" 201 0
2025-12-03 06:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe107c060-eae5-4fd1-9751-a6731fe1fbce_4.jpg') HTTP/1.1" 204 0
2025-12-03 06:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_4.jpg saved to cache
2025-12-03 06:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 44df412c-3345-521c-9331-79ebb8a6946d
2025-12-03 06:03:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:03:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f603c3d0>
2025-12-03 06:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:03:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_6.jpg HTTP/1.1" 201 0
2025-12-03 06:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe107c060-eae5-4fd1-9751-a6731fe1fbce_11.jpg') HTTP/1.1" 204 0
2025-12-03 06:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_11.jpg saved to cache
2025-12-03 06:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 44df412c-3345-521c-9331-79ebb8a6946d
2025-12-03 06:03:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:03:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6407550>
2025-12-03 06:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:03:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_7.jpg HTTP/1.1" 201 0
2025-12-03 06:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe107c060-eae5-4fd1-9751-a6731fe1fbce_10.jpg') HTTP/1.1" 204 0
2025-12-03 06:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_10.jpg saved to cache
2025-12-03 06:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 44df412c-3345-521c-9331-79ebb8a6946d
2025-12-03 06:03:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:03:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6223310>
2025-12-03 06:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:03:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_1.jpg HTTP/1.1" 201 0
2025-12-03 06:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe107c060-eae5-4fd1-9751-a6731fe1fbce_ext_7.jpg') HTTP/1.1" 204 0
2025-12-03 06:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_ext_7.jpg saved to cache
2025-12-03 06:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 44df412c-3345-521c-9331-79ebb8a6946d
2025-12-03 06:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002936956-01974977-003.pdf)
2025-12-03 06:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002936956-01974977-003.pdf)
2025-12-03 06:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2936956-3997429-1001.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2936956-3997429-1001.jpg not downloaded yet
2025-12-03 06:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2936956-3997429-1002.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2936956-3997429-1002.jpg not downloaded yet
2025-12-03 06:03:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:03:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f62bb910>
2025-12-03 06:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:03:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ae5adda-d662-5517-bf59-4f4e341057e9/4ae5adda-d662-5517-bf59-4f4e341057e9_image_10.jpg HTTP/1.1" 201 0
2025-12-03 06:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7055a81f-1bb7-4d01-8318-d48b827a2bc3_ext_5.jpg') HTTP/1.1" 204 0
2025-12-03 06:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7055a81f-1bb7-4d01-8318-d48b827a2bc3_ext_5.jpg saved to cache
2025-12-03 06:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 4ae5adda-d662-5517-bf59-4f4e341057e9
2025-12-03 06:03:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:03:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f643cf50>
2025-12-03 06:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:03:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ae5adda-d662-5517-bf59-4f4e341057e9/4ae5adda-d662-5517-bf59-4f4e341057e9_image_11.jpg HTTP/1.1" 201 0
2025-12-03 06:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7055a81f-1bb7-4d01-8318-d48b827a2bc3_ext_3.jpg') HTTP/1.1" 204 0
2025-12-03 06:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7055a81f-1bb7-4d01-8318-d48b827a2bc3_ext_3.jpg saved to cache
2025-12-03 06:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 4ae5adda-d662-5517-bf59-4f4e341057e9
2025-12-03 06:03:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:03:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6436d90>
2025-12-03 06:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:03:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 06:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_8.jpg HTTP/1.1" 201 0
2025-12-03 06:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe107c060-eae5-4fd1-9751-a6731fe1fbce_9.jpg') HTTP/1.1" 204 0
2025-12-03 06:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_9.jpg saved to cache
2025-12-03 06:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 44df412c-3345-521c-9331-79ebb8a6946d
2025-12-03 06:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2936956-3997429-1003.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2936956-3997429-1003.jpg not downloaded yet
2025-12-03 06:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2936956-3997429-1004.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2936956-3997429-1004.jpg not downloaded yet
2025-12-03 06:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002936956-01974977-003.pdf)
2025-12-03 06:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2936956-3997429-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002936956-01974977-003.pdf)
2025-12-03 06:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2936956-3997429-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002936956-01974977-003.pdf)
2025-12-03 06:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7055a81f-1bb7-4d01-8318-d48b827a2bc3_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002939815-01982696-003.pdf)
2025-12-03 06:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2936956-3997429-1005.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2936956-3997429-1005.jpg not downloaded yet
2025-12-03 06:03:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:03:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f62a6950>
2025-12-03 06:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:03:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_9.jpg HTTP/1.1" 201 0
2025-12-03 06:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe107c060-eae5-4fd1-9751-a6731fe1fbce_ext_2.jpg') HTTP/1.1" 204 0
2025-12-03 06:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_ext_2.jpg saved to cache
2025-12-03 06:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 44df412c-3345-521c-9331-79ebb8a6946d
2025-12-03 06:03:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:03:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6221750>
2025-12-03 06:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:03:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_10.jpg HTTP/1.1" 201 0
2025-12-03 06:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe107c060-eae5-4fd1-9751-a6731fe1fbce_ext_5.jpg') HTTP/1.1" 204 0
2025-12-03 06:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_ext_5.jpg saved to cache
2025-12-03 06:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 44df412c-3345-521c-9331-79ebb8a6946d
2025-12-03 06:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002936956-01974977-003.pdf)
2025-12-03 06:03:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:03:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6435e90>
2025-12-03 06:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:03:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_11.jpg HTTP/1.1" 201 0
2025-12-03 06:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe107c060-eae5-4fd1-9751-a6731fe1fbce_ext_3.jpg') HTTP/1.1" 204 0
2025-12-03 06:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_ext_3.jpg saved to cache
2025-12-03 06:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 44df412c-3345-521c-9331-79ebb8a6946d
2025-12-03 06:03:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:03:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f64ae450>
2025-12-03 06:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:03:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_13.jpg HTTP/1.1" 201 0
2025-12-03 06:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2936956-3997429-13.jpg') HTTP/1.1" 204 0
2025-12-03 06:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2936956-3997429-13.jpg saved to cache
2025-12-03 06:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 44df412c-3345-521c-9331-79ebb8a6946d
2025-12-03 06:03:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:03:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6446510>
2025-12-03 06:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:03:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 06:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_14.jpg HTTP/1.1" 201 0
2025-12-03 06:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2936956-3997429-1000.jpg') HTTP/1.1" 204 0
2025-12-03 06:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2936956-3997429-1000.jpg saved to cache
2025-12-03 06:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 44df412c-3345-521c-9331-79ebb8a6946d
2025-12-03 06:03:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:03:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f65d6910>
2025-12-03 06:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:03:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ae5adda-d662-5517-bf59-4f4e341057e9/4ae5adda-d662-5517-bf59-4f4e341057e9_image_9.jpg HTTP/1.1" 201 0
2025-12-03 06:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7055a81f-1bb7-4d01-8318-d48b827a2bc3_ext_2.jpg') HTTP/1.1" 204 0
2025-12-03 06:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7055a81f-1bb7-4d01-8318-d48b827a2bc3_ext_2.jpg saved to cache
2025-12-03 06:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4ae5adda-d662-5517-bf59-4f4e341057e9
2025-12-03 06:03:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:03:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6015cd0>
2025-12-03 06:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:03:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_12.jpg HTTP/1.1" 201 0
2025-12-03 06:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe107c060-eae5-4fd1-9751-a6731fe1fbce_ext_4.jpg') HTTP/1.1" 204 0
2025-12-03 06:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_ext_4.jpg saved to cache
2025-12-03 06:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 44df412c-3345-521c-9331-79ebb8a6946d
2025-12-03 06:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2936956-3997429-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002936956-01974977-003.pdf)
2025-12-03 06:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2936956-3997429-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002936956-01974977-003.pdf)
2025-12-03 06:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2936956-3997429-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002936956-01974977-003.pdf)
2025-12-03 06:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2936956-3997429-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002936956-01974977-003.pdf)
2025-12-03 06:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2936956-3997429-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002936956-01974977-003.pdf)
2025-12-03 06:03:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:03:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f64ce0d0>
2025-12-03 06:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:03:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_16.jpg HTTP/1.1" 201 0
2025-12-03 06:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2936956-3997429-1002.jpg') HTTP/1.1" 204 0
2025-12-03 06:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2936956-3997429-1002.jpg saved to cache
2025-12-03 06:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 44df412c-3345-521c-9331-79ebb8a6946d
2025-12-03 06:03:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:03:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6016590>
2025-12-03 06:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:03:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_18.jpg HTTP/1.1" 201 0
2025-12-03 06:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2936956-3997429-1004.jpg') HTTP/1.1" 204 0
2025-12-03 06:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2936956-3997429-1004.jpg saved to cache
2025-12-03 06:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 44df412c-3345-521c-9331-79ebb8a6946d
2025-12-03 06:03:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:03:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f614c790>
2025-12-03 06:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:03:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_15.jpg HTTP/1.1" 201 0
2025-12-03 06:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2936956-3997429-1001.jpg') HTTP/1.1" 204 0
2025-12-03 06:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2936956-3997429-1001.jpg saved to cache
2025-12-03 06:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 44df412c-3345-521c-9331-79ebb8a6946d
2025-12-03 06:03:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:03:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6023610>
2025-12-03 06:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:03:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 06:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_19.jpg HTTP/1.1" 201 0
2025-12-03 06:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2936956-3997429-1005.jpg') HTTP/1.1" 204 0
2025-12-03 06:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2936956-3997429-1005.jpg saved to cache
2025-12-03 06:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 44df412c-3345-521c-9331-79ebb8a6946d
2025-12-03 06:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7055a81f-1bb7-4d01-8318-d48b827a2bc3_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002939815-01982696-003.pdf)
2025-12-03 06:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7055a81f-1bb7-4d01-8318-d48b827a2bc3_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002939815-01982696-003.pdf)
2025-12-03 06:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7055a81f-1bb7-4d01-8318-d48b827a2bc3_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002939815-01982696-003.pdf)
2025-12-03 06:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7055a81f-1bb7-4d01-8318-d48b827a2bc3_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002939815-01982696-003.pdf)
2025-12-03 06:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7055a81f-1bb7-4d01-8318-d48b827a2bc3_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002939815-01982696-003.pdf)
2025-12-03 06:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VAUXHALL/ADAM?id=2891297&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232891297&indx=179> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:03:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:03:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f62c3210>
2025-12-03 06:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:03:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_17.jpg HTTP/1.1" 201 0
2025-12-03 06:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2936956-3997429-1003.jpg') HTTP/1.1" 204 0
2025-12-03 06:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2936956-3997429-1003.jpg saved to cache
2025-12-03 06:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 44df412c-3345-521c-9331-79ebb8a6946d
2025-12-03 06:03:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 44df412c-3345-521c-9331-79ebb8a6946d, skipping ID generation
2025-12-03 06:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 44df412c-3345-521c-9331-79ebb8a6946d from tracking dictionaries
2025-12-03 06:03:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 44df412c-3345-521c-9331-79ebb8a6946d sending to next pipeline
2025-12-03 06:03:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 44df412c-3345-521c-9331-79ebb8a6946d, identifier: 2936956
2025-12-03 06:03:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:03:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 44df412c-3345-521c-9331-79ebb8a6946d with identifier: 2936956
2025-12-03 06:03:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 44df412c-3345-521c-9331-79ebb8a6946d with identifier: 2936956
2025-12-03 06:03:15 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'green', 'original_photo_count': 24, 'seller_name': 'pentagon group', 'price_includes_vat': False, 'title': 'vauxhall mokka 100kw launch edition 50kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'vauxhall', 'model': 'mokka', 'transmission': 'automatic', 'engine': '0.0l', 'fuel_type': 'electric', 'odometer': 20515, 'odometer_reading_unit': 'mi', 'registration_date': '2021-03-31', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/vauxhall/mokka?id=2936956', 'location': 'leeds', 'origin_country_code': 'gb', 'trim': '100kw launch edition 50kwh 5dr auto', 'license_plate': 'sw21doh', 'year': 2021, 'listing': 'auction', 'c_o_2_emission_value': 0, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002936956-01974977-003.pdf', 'expiration_date': '2025-12-03t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': '44df412c-3345-521c-9331-79ebb8a6946d', 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_expert_report_file_cbe560c9-f773-4d07-a3cb-fdc233976870.pdf', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_0.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_ext_7.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 199743}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_1.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_ext_7.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 199743}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_2.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_ext_6.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 261421}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_3.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_ext_1.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 179642}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_4.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 189664}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_5.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 184408}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_6.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_11.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 193599}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_7.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_10.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 176089}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_8.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_9.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 192164}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_9.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_ext_2.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 266527}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_10.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_ext_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 216659}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_11.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_ext_3.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 205929}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_12.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_ext_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 271080}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_13.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2936956-3997429-13.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 255100}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_14.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2936956-3997429-1000.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 205168}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_15.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2936956-3997429-1001.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 293504}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_16.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2936956-3997429-1002.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 248693}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_17.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2936956-3997429-1003.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 333581}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_18.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2936956-3997429-1004.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 261885}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_19.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2936956-3997429-1005.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 271828}], 'current_year_diff': 4, 'age_in_months': 56, 'make_model': 'vauxhall mokka', 'sanitized_make': 'vauxhall', 'odometer_in_km': 33015} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 56,
     'auction_title': '',
     'c_o_2_emission_value': 0,
     'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_expert_report_file_cbe560c9-f773-4d07-a3cb-fdc233976870.pdf',
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002936956-01974977-003.pdf',
     'color': 'green',
     'currency': 'gbp',
     'current_year_diff': 4,
     'engine': '0.0l',
     'expiration_date': '2025-12-03t09:00:00z',
     'fuel_type': 'electric',
     'id': '44df412c-3345-521c-9331-79ebb8a6946d',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'sw21doh',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/vauxhall/mokka?id=2936956',
     'listing': 'auction',
     'location': 'leeds',
     'make': 'vauxhall',
     'make_model': 'vauxhall mokka',
     'model': 'mokka',
     'odometer': 20515,
     'odometer_in_km': 33015,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 24,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 199743,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_ext_7.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 199743,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_ext_7.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 261421,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_ext_6.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 179642,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_ext_1.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 189664,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_5.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 184408,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_4.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 193599,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_11.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 176089,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_10.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 192164,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_9.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 266527,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_ext_2.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 216659,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_ext_5.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 205929,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_ext_3.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 271080,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_ext_4.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 255100,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2936956-3997429-13.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 205168,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2936956-3997429-1000.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_15.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 293504,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2936956-3997429-1001.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_16.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 248693,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2936956-3997429-1002.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_17.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 333581,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2936956-3997429-1003.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_18.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 261885,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2936956-3997429-1004.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_19.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 271828,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2936956-3997429-1005.jpg',
                 'Width': 1333}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-03-31',
     'sanitized_make': 'vauxhall',
     'seller_name': 'pentagon group',
     'title': 'vauxhall mokka 100kw launch edition 50kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '100kw launch edition 50kwh 5dr auto',
     'year': 2021}
2025-12-03 06:03:15 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 44df412c-3345-521c-9331-79ebb8a6946d spider: manheim.gb
2025-12-03 06:03:15 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 44df412c-3345-521c-9331-79ebb8a6946d due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'green', 'original_photo_count': 24, 'seller_name': 'pentagon group', 'price_includes_vat': False, 'title': 'vauxhall mokka 100kw launch edition 50kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'vauxhall', 'model': 'mokka', 'transmission': 'automatic', 'engine': '0.0l', 'fuel_type': 'electric', 'odometer': 20515, 'odometer_reading_unit': 'mi', 'registration_date': '2021-03-31', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/vauxhall/mokka?id=2936956', 'location': 'leeds', 'origin_country_code': 'gb', 'trim': '100kw launch edition 50kwh 5dr auto', 'license_plate': 'sw21doh', 'year': 2021, 'listing': 'auction', 'c_o_2_emission_value': 0, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002936956-01974977-003.pdf', 'expiration_date': '2025-12-03t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': '44df412c-3345-521c-9331-79ebb8a6946d', 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_expert_report_file_cbe560c9-f773-4d07-a3cb-fdc233976870.pdf', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_0.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_ext_7.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 199743}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_1.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_ext_7.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 199743}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_2.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_ext_6.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 261421}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_3.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_ext_1.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 179642}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_4.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 189664}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_5.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 184408}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_6.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_11.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 193599}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_7.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_10.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 176089}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_8.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_9.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 192164}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_9.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_ext_2.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 266527}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_10.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_ext_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 216659}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_11.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_ext_3.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 205929}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_12.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_ext_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 271080}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_13.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2936956-3997429-13.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 255100}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_14.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2936956-3997429-1000.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 205168}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_15.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2936956-3997429-1001.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 293504}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_16.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2936956-3997429-1002.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 248693}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_17.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2936956-3997429-1003.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 333581}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_18.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2936956-3997429-1004.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 261885}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_19.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2936956-3997429-1005.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 271828}], 'current_year_diff': 4, 'age_in_months': 56, 'make_model': 'vauxhall mokka', 'sanitized_make': 'vauxhall', 'odometer_in_km': 33015} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 56,
     'auction_title': '',
     'c_o_2_emission_value': 0,
     'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_expert_report_file_cbe560c9-f773-4d07-a3cb-fdc233976870.pdf',
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002936956-01974977-003.pdf',
     'color': 'green',
     'currency': 'gbp',
     'current_year_diff': 4,
     'engine': '0.0l',
     'expiration_date': '2025-12-03t09:00:00z',
     'fuel_type': 'electric',
     'id': '44df412c-3345-521c-9331-79ebb8a6946d',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'sw21doh',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/vauxhall/mokka?id=2936956',
     'listing': 'auction',
     'location': 'leeds',
     'make': 'vauxhall',
     'make_model': 'vauxhall mokka',
     'model': 'mokka',
     'odometer': 20515,
     'odometer_in_km': 33015,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 24,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 199743,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_ext_7.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 199743,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_ext_7.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 261421,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_ext_6.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 179642,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_ext_1.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 189664,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_5.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 184408,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_4.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 193599,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_11.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 176089,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_10.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 192164,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_9.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 266527,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_ext_2.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 216659,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_ext_5.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 205929,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_ext_3.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 271080,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_ext_4.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 255100,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2936956-3997429-13.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 205168,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2936956-3997429-1000.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_15.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 293504,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2936956-3997429-1001.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_16.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 248693,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2936956-3997429-1002.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_17.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 333581,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2936956-3997429-1003.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_18.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 261885,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2936956-3997429-1004.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_19.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 271828,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2936956-3997429-1005.jpg',
                 'Width': 1333}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-03-31',
     'sanitized_make': 'vauxhall',
     'seller_name': 'pentagon group',
     'title': 'vauxhall mokka 100kw launch edition 50kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '100kw launch edition 50kwh 5dr auto',
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_expert_report_file_cbe560c9-f773-4d07-a3cb-fdc233976870.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002936956-01974977-003.pdf',
 'color': 'GREEN',
 'currency': 'GBP',
 'engine': '0.0L',
 'expiration_date': '2025-12-03T09:00:00Z',
 'fuel_type': 'Electric',
 'id': '44df412c-3345-521c-9331-79ebb8a6946d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'SW21DOH',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VAUXHALL/MOKKA?id=2936956',
 'listing': 'auction',
 'location': 'Leeds',
 'make': 'VAUXHALL',
 'model': 'MOKKA',
 'odometer': 20515,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 24,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 199743,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 199743,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 261421,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 179642,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 189664,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 184408,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 193599,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 176089,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 192164,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 266527,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 216659,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 205929,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 271080,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e107c060-eae5-4fd1-9751-a6731fe1fbce_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 255100,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2936956-3997429-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 205168,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2936956-3997429-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 293504,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2936956-3997429-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 248693,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2936956-3997429-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 333581,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2936956-3997429-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 261885,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2936956-3997429-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44df412c-3345-521c-9331-79ebb8a6946d/44df412c-3345-521c-9331-79ebb8a6946d_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 271828,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2936956-3997429-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-31',
 'seller_name': 'Pentagon Group',
 'title': 'VAUXHALL MOKKA 100kW Launch Edition 50kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '100kW Launch Edition 50kWh 5dr Auto',
 'year': 2021}
2025-12-03 06:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272936956%27 HTTP/1.1" 200 None
2025-12-03 06:03:15 [manheim.gb] INFO: Saving data for 2936956: {'created_time': 1764741795.697098, 'last_price_update_time': 1764741795.697111, 'auction_closing_time': 1764752400.0}
2025-12-03 06:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2936956') HTTP/1.1" 204 0
2025-12-03 06:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7055a81f-1bb7-4d01-8318-d48b827a2bc3_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002939815-01982696-003.pdf)
2025-12-03 06:03:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:03:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f5b71f90>
2025-12-03 06:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:03:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ae5adda-d662-5517-bf59-4f4e341057e9/4ae5adda-d662-5517-bf59-4f4e341057e9_image_6.jpg HTTP/1.1" 201 0
2025-12-03 06:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7055a81f-1bb7-4d01-8318-d48b827a2bc3_11.jpg') HTTP/1.1" 204 0
2025-12-03 06:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7055a81f-1bb7-4d01-8318-d48b827a2bc3_11.jpg saved to cache
2025-12-03 06:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4ae5adda-d662-5517-bf59-4f4e341057e9
2025-12-03 06:03:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:03:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f5b98510>
2025-12-03 06:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:03:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 06:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ae5adda-d662-5517-bf59-4f4e341057e9/4ae5adda-d662-5517-bf59-4f4e341057e9_image_8.jpg HTTP/1.1" 201 0
2025-12-03 06:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7055a81f-1bb7-4d01-8318-d48b827a2bc3_9.jpg') HTTP/1.1" 204 0
2025-12-03 06:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7055a81f-1bb7-4d01-8318-d48b827a2bc3_9.jpg saved to cache
2025-12-03 06:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4ae5adda-d662-5517-bf59-4f4e341057e9
2025-12-03 06:03:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:03:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f5b73b50>
2025-12-03 06:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:03:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ae5adda-d662-5517-bf59-4f4e341057e9/4ae5adda-d662-5517-bf59-4f4e341057e9_image_5.jpg HTTP/1.1" 201 0
2025-12-03 06:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7055a81f-1bb7-4d01-8318-d48b827a2bc3_4.jpg') HTTP/1.1" 204 0
2025-12-03 06:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7055a81f-1bb7-4d01-8318-d48b827a2bc3_4.jpg saved to cache
2025-12-03 06:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4ae5adda-d662-5517-bf59-4f4e341057e9
2025-12-03 06:03:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:03:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f65def50>
2025-12-03 06:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:03:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ae5adda-d662-5517-bf59-4f4e341057e9/4ae5adda-d662-5517-bf59-4f4e341057e9_image_4.jpg HTTP/1.1" 201 0
2025-12-03 06:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7055a81f-1bb7-4d01-8318-d48b827a2bc3_5.jpg') HTTP/1.1" 204 0
2025-12-03 06:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7055a81f-1bb7-4d01-8318-d48b827a2bc3_5.jpg saved to cache
2025-12-03 06:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4ae5adda-d662-5517-bf59-4f4e341057e9
2025-12-03 06:03:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:03:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f5b88310>
2025-12-03 06:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:03:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 06:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ae5adda-d662-5517-bf59-4f4e341057e9/4ae5adda-d662-5517-bf59-4f4e341057e9_image_7.jpg HTTP/1.1" 201 0
2025-12-03 06:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7055a81f-1bb7-4d01-8318-d48b827a2bc3_10.jpg') HTTP/1.1" 204 0
2025-12-03 06:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7055a81f-1bb7-4d01-8318-d48b827a2bc3_10.jpg saved to cache
2025-12-03 06:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4ae5adda-d662-5517-bf59-4f4e341057e9
2025-12-03 06:03:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9d949ef-5973-5c56-a04d-fb8c1f7be0a5 with identifier: 2891297
2025-12-03 06:03:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9d949ef-5973-5c56-a04d-fb8c1f7be0a5 with scrape type 2
2025-12-03 06:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9d949ef-5973-5c56-a04d-fb8c1f7be0a5 with scrape type 2
2025-12-03 06:03:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: c9d949ef-5973-5c56-a04d-fb8c1f7be0a5, identifier: 2891297
2025-12-03 06:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7055a81f-1bb7-4d01-8318-d48b827a2bc3_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002939815-01982696-003.pdf)
2025-12-03 06:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7055a81f-1bb7-4d01-8318-d48b827a2bc3_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002939815-01982696-003.pdf)
2025-12-03 06:03:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: c9d949ef-5973-5c56-a04d-fb8c1f7be0a5 with identifier: 2891297
2025-12-03 06:03:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: c9d949ef-5973-5c56-a04d-fb8c1f7be0a5 with identifier: 2891297
2025-12-03 06:03:17 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 184842 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    184842
2025-12-03 06:03:17 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: c9d949ef-5973-5c56-a04d-fb8c1f7be0a5 spider: manheim.gb
2025-12-03 06:03:17 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: c9d949ef-5973-5c56-a04d-fb8c1f7be0a5 due to rule: high_mileage_for_country.json, error: 184842 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    184842
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002891297-01950891-002.pdf',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'c9d949ef-5973-5c56-a04d-fb8c1f7be0a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'SM63JJZ',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VAUXHALL/ADAM?id=2891297',
 'listing': 'directbuy',
 'location': 'Leeds',
 'make': 'VAUXHALL',
 'model': 'ADAM',
 'odometer': 114856,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-21',
 'seller_name': 'Lloyd Motor Group',
 'title': 'VAUXHALL ADAM 1.2i Glam 3dr',
 'transmission': 'manual',
 'trim': '1.2i Glam 3dr',
 'year': 2014}
2025-12-03 06:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272891297%27 HTTP/1.1" 200 None
2025-12-03 06:03:17 [manheim.gb] INFO: Saving data for 2891297: {'auction_closing_time': 1765184400.0, 'created_time': 1764583517.019943, 'last_price_update_time': 1764741797.571896}
2025-12-03 06:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2891297') HTTP/1.1" 204 0
2025-12-03 06:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/7055a81f-1bb7-4d01-8318-d48b827a2bc3_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002939815-01982696-003.pdf)
2025-12-03 06:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/FIAT/500?id=2803879&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232803879&indx=172> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/NISSAN/LEAF?id=2778685&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232778685&indx=170> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:03:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:03:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:03:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:03:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6447750>
2025-12-03 06:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:03:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 06:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ae5adda-d662-5517-bf59-4f4e341057e9/4ae5adda-d662-5517-bf59-4f4e341057e9_image_1.jpg HTTP/1.1" 201 0
2025-12-03 06:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7055a81f-1bb7-4d01-8318-d48b827a2bc3_ext_7.jpg') HTTP/1.1" 204 0
2025-12-03 06:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7055a81f-1bb7-4d01-8318-d48b827a2bc3_ext_7.jpg saved to cache
2025-12-03 06:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4ae5adda-d662-5517-bf59-4f4e341057e9
2025-12-03 06:03:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:03:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f639ced0>
2025-12-03 06:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:03:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ae5adda-d662-5517-bf59-4f4e341057e9/4ae5adda-d662-5517-bf59-4f4e341057e9_image_3.jpg HTTP/1.1" 201 0
2025-12-03 06:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7055a81f-1bb7-4d01-8318-d48b827a2bc3_ext_1.jpg') HTTP/1.1" 204 0
2025-12-03 06:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7055a81f-1bb7-4d01-8318-d48b827a2bc3_ext_1.jpg saved to cache
2025-12-03 06:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4ae5adda-d662-5517-bf59-4f4e341057e9
2025-12-03 06:03:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:03:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f63215d0>
2025-12-03 06:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:03:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ae5adda-d662-5517-bf59-4f4e341057e9/4ae5adda-d662-5517-bf59-4f4e341057e9_image_2.jpg HTTP/1.1" 201 0
2025-12-03 06:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7055a81f-1bb7-4d01-8318-d48b827a2bc3_ext_6.jpg') HTTP/1.1" 204 0
2025-12-03 06:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7055a81f-1bb7-4d01-8318-d48b827a2bc3_ext_6.jpg saved to cache
2025-12-03 06:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4ae5adda-d662-5517-bf59-4f4e341057e9
2025-12-03 06:03:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:03:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6445750>
2025-12-03 06:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:03:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ae5adda-d662-5517-bf59-4f4e341057e9/4ae5adda-d662-5517-bf59-4f4e341057e9_image_0.jpg HTTP/1.1" 201 0
2025-12-03 06:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7055a81f-1bb7-4d01-8318-d48b827a2bc3_ext_7.jpg') HTTP/1.1" 204 0
2025-12-03 06:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7055a81f-1bb7-4d01-8318-d48b827a2bc3_ext_7.jpg saved to cache
2025-12-03 06:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4ae5adda-d662-5517-bf59-4f4e341057e9
2025-12-03 06:03:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4ae5adda-d662-5517-bf59-4f4e341057e9, skipping ID generation
2025-12-03 06:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 4ae5adda-d662-5517-bf59-4f4e341057e9 from tracking dictionaries
2025-12-03 06:03:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4ae5adda-d662-5517-bf59-4f4e341057e9 sending to next pipeline
2025-12-03 06:03:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 4ae5adda-d662-5517-bf59-4f4e341057e9, identifier: 2939815
2025-12-03 06:03:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e11d8524-9e90-50da-948e-d28e22a483a0 with identifier: 2803879
2025-12-03 06:03:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e11d8524-9e90-50da-948e-d28e22a483a0 with scrape type 2
2025-12-03 06:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e11d8524-9e90-50da-948e-d28e22a483a0 with scrape type 2
2025-12-03 06:03:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: e11d8524-9e90-50da-948e-d28e22a483a0, identifier: 2803879
2025-12-03 06:03:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6793067-61c7-5b78-a020-56b7086c899f with identifier: 2778685
2025-12-03 06:03:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6793067-61c7-5b78-a020-56b7086c899f with scrape type 2
2025-12-03 06:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d6793067-61c7-5b78-a020-56b7086c899f with scrape type 2
2025-12-03 06:03:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: d6793067-61c7-5b78-a020-56b7086c899f, identifier: 2778685
2025-12-03 06:03:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 4ae5adda-d662-5517-bf59-4f4e341057e9 with identifier: 2939815
2025-12-03 06:03:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 4ae5adda-d662-5517-bf59-4f4e341057e9 with identifier: 2939815
2025-12-03 06:03:19 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 4ae5adda-d662-5517-bf59-4f4e341057e9 with identifier: 2939815 to the API
2025-12-03 06:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 06:03:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 06:03:19 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/7055a81f-1bb7-4d01-8318-d48b827a2bc3_ext_7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 168,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ae5adda-d662-5517-bf59-4f4e341057e9/4ae5adda-d662-5517-bf59-4f4e341057e9_expert_report_file_4f8c1a7e-2d29-4428-83a3-d87025247099.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002939815-01982696-003.pdf',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '1.4L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '4ae5adda-d662-5517-bf59-4f4e341057e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'FE70ZVG',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/ALFA%20ROMEO/GIULIETTA?id=2939815',
 'listing': 'auction',
 'location': 'Manchester',
 'make': 'ALFA ROMEO',
 'model': 'GIULIETTA',
 'odometer': 16786,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 24,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ae5adda-d662-5517-bf59-4f4e341057e9/4ae5adda-d662-5517-bf59-4f4e341057e9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 184849,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7055a81f-1bb7-4d01-8318-d48b827a2bc3_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ae5adda-d662-5517-bf59-4f4e341057e9/4ae5adda-d662-5517-bf59-4f4e341057e9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 184849,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7055a81f-1bb7-4d01-8318-d48b827a2bc3_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ae5adda-d662-5517-bf59-4f4e341057e9/4ae5adda-d662-5517-bf59-4f4e341057e9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 220922,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7055a81f-1bb7-4d01-8318-d48b827a2bc3_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ae5adda-d662-5517-bf59-4f4e341057e9/4ae5adda-d662-5517-bf59-4f4e341057e9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 213868,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7055a81f-1bb7-4d01-8318-d48b827a2bc3_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ae5adda-d662-5517-bf59-4f4e341057e9/4ae5adda-d662-5517-bf59-4f4e341057e9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 188017,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7055a81f-1bb7-4d01-8318-d48b827a2bc3_5.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ae5adda-d662-5517-bf59-4f4e341057e9/4ae5adda-d662-5517-bf59-4f4e341057e9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 184512,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7055a81f-1bb7-4d01-8318-d48b827a2bc3_4.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ae5adda-d662-5517-bf59-4f4e341057e9/4ae5adda-d662-5517-bf59-4f4e341057e9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 189709,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7055a81f-1bb7-4d01-8318-d48b827a2bc3_11.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ae5adda-d662-5517-bf59-4f4e341057e9/4ae5adda-d662-5517-bf59-4f4e341057e9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 184086,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7055a81f-1bb7-4d01-8318-d48b827a2bc3_10.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ae5adda-d662-5517-bf59-4f4e341057e9/4ae5adda-d662-5517-bf59-4f4e341057e9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 184245,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7055a81f-1bb7-4d01-8318-d48b827a2bc3_9.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ae5adda-d662-5517-bf59-4f4e341057e9/4ae5adda-d662-5517-bf59-4f4e341057e9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 235695,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7055a81f-1bb7-4d01-8318-d48b827a2bc3_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ae5adda-d662-5517-bf59-4f4e341057e9/4ae5adda-d662-5517-bf59-4f4e341057e9_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 176922,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7055a81f-1bb7-4d01-8318-d48b827a2bc3_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ae5adda-d662-5517-bf59-4f4e341057e9/4ae5adda-d662-5517-bf59-4f4e341057e9_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 183825,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7055a81f-1bb7-4d01-8318-d48b827a2bc3_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ae5adda-d662-5517-bf59-4f4e341057e9/4ae5adda-d662-5517-bf59-4f4e341057e9_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 150457,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7055a81f-1bb7-4d01-8318-d48b827a2bc3_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ae5adda-d662-5517-bf59-4f4e341057e9/4ae5adda-d662-5517-bf59-4f4e341057e9_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 356067,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2939815-3998414-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ae5adda-d662-5517-bf59-4f4e341057e9/4ae5adda-d662-5517-bf59-4f4e341057e9_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 151456,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2939815-3998414-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ae5adda-d662-5517-bf59-4f4e341057e9/4ae5adda-d662-5517-bf59-4f4e341057e9_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108617,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2939815-3998414-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ae5adda-d662-5517-bf59-4f4e341057e9/4ae5adda-d662-5517-bf59-4f4e341057e9_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 266926,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2939815-3998414-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ae5adda-d662-5517-bf59-4f4e341057e9/4ae5adda-d662-5517-bf59-4f4e341057e9_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 196552,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2939815-3998414-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ae5adda-d662-5517-bf59-4f4e341057e9/4ae5adda-d662-5517-bf59-4f4e341057e9_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 239538,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2939815-3998414-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ae5adda-d662-5517-bf59-4f4e341057e9/4ae5adda-d662-5517-bf59-4f4e341057e9_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 311250,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2939815-3998414-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-05',
 'seller_name': 'LSH Auto Group',
 'title': 'ALFA ROMEO GIULIETTA 1.4 TB Sprint 5dr',
 'transmission': 'manual',
 'trim': '1.4 TB Sprint 5dr',
 'year': 2020}
2025-12-03 06:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272939815%27 HTTP/1.1" 200 None
2025-12-03 06:03:19 [manheim.gb] INFO: Saving data for 2939815: {'created_time': 1764741799.633474, 'last_price_update_time': 1764741799.633483, 'auction_closing_time': 1764838800.0}
2025-12-03 06:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2939815') HTTP/1.1" 204 0
2025-12-03 06:03:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: e11d8524-9e90-50da-948e-d28e22a483a0 with identifier: 2803879
2025-12-03 06:03:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: e11d8524-9e90-50da-948e-d28e22a483a0 with identifier: 2803879
2025-12-03 06:03:19 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: e11d8524-9e90-50da-948e-d28e22a483a0 with identifier: 2803879 to the API
2025-12-03 06:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 06:03:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 06:03:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/FIAT/500?id=2803879&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232803879&indx=172>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002803879-01984728-003.pdf',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': '2025-12-03T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'e11d8524-9e90-50da-948e-d28e22a483a0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'BN67KHF',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FIAT/500?id=2803879',
 'listing': 'auction',
 'location': 'Plymouth',
 'make': 'FIAT',
 'model': '500',
 'odometer': 41888,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-21',
 'seller_name': 'Vospers Group',
 'title': 'FIAT 500 1.2 Pop 3dr',
 'transmission': 'manual',
 'trim': '1.2 Pop 3dr',
 'year': 2017}
2025-12-03 06:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272803879%27 HTTP/1.1" 200 None
2025-12-03 06:03:19 [manheim.gb] INFO: Saving data for 2803879: {'auction_closing_time': 1764752400.0, 'created_time': 1764583556.566677, 'last_price_update_time': 1764741799.974501}
2025-12-03 06:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2803879') HTTP/1.1" 204 0
2025-12-03 06:03:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: d6793067-61c7-5b78-a020-56b7086c899f with identifier: 2778685
2025-12-03 06:03:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: d6793067-61c7-5b78-a020-56b7086c899f with identifier: 2778685
2025-12-03 06:03:20 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': 'mobilize financial services', 'price_includes_vat': False, 'title': 'nissan leaf 80kw acenta 24kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'nissan', 'model': 'leaf', 'transmission': 'automatic', 'engine': '0.0l', 'fuel_type': 'electric', 'odometer': 59124, 'odometer_reading_unit': 'mi', 'registration_date': '2014-07-24', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/nissan/leaf?id=2778685', 'location': 'leeds - in transit', 'origin_country_code': 'gb', 'trim': '80kw acenta 24kwh 5dr auto', 'license_plate': 'lo14svz', 'year': 2014, 'listing': 'auction', 'c_o_2_emission_value': 0, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002778685-01988702-001.pdf', 'expiration_date': '2025-12-08t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': 'd6793067-61c7-5b78-a020-56b7086c899f', 'current_year_diff': 11, 'age_in_months': 136, 'make_model': 'nissan leaf', 'sanitized_make': 'nissan', 'odometer_in_km': 95150} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 136,
     'auction_title': '',
     'c_o_2_emission_value': 0,
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002778685-01988702-001.pdf',
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 11,
     'engine': '0.0l',
     'expiration_date': '2025-12-08t09:00:00z',
     'fuel_type': 'electric',
     'id': 'd6793067-61c7-5b78-a020-56b7086c899f',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'lo14svz',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/nissan/leaf?id=2778685',
     'listing': 'auction',
     'location': 'leeds - in transit',
     'make': 'nissan',
     'make_model': 'nissan leaf',
     'model': 'leaf',
     'odometer': 59124,
     'odometer_in_km': 95150,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2014-07-24',
     'sanitized_make': 'nissan',
     'seller_name': 'mobilize financial services',
     'title': 'nissan leaf 80kw acenta 24kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '80kw acenta 24kwh 5dr auto',
     'year': 2014}
2025-12-03 06:03:20 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: d6793067-61c7-5b78-a020-56b7086c899f spider: manheim.gb
2025-12-03 06:03:20 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: d6793067-61c7-5b78-a020-56b7086c899f due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': 'mobilize financial services', 'price_includes_vat': False, 'title': 'nissan leaf 80kw acenta 24kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'nissan', 'model': 'leaf', 'transmission': 'automatic', 'engine': '0.0l', 'fuel_type': 'electric', 'odometer': 59124, 'odometer_reading_unit': 'mi', 'registration_date': '2014-07-24', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/nissan/leaf?id=2778685', 'location': 'leeds - in transit', 'origin_country_code': 'gb', 'trim': '80kw acenta 24kwh 5dr auto', 'license_plate': 'lo14svz', 'year': 2014, 'listing': 'auction', 'c_o_2_emission_value': 0, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002778685-01988702-001.pdf', 'expiration_date': '2025-12-08t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': 'd6793067-61c7-5b78-a020-56b7086c899f', 'current_year_diff': 11, 'age_in_months': 136, 'make_model': 'nissan leaf', 'sanitized_make': 'nissan', 'odometer_in_km': 95150} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 136,
     'auction_title': '',
     'c_o_2_emission_value': 0,
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002778685-01988702-001.pdf',
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 11,
     'engine': '0.0l',
     'expiration_date': '2025-12-08t09:00:00z',
     'fuel_type': 'electric',
     'id': 'd6793067-61c7-5b78-a020-56b7086c899f',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'lo14svz',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/nissan/leaf?id=2778685',
     'listing': 'auction',
     'location': 'leeds - in transit',
     'make': 'nissan',
     'make_model': 'nissan leaf',
     'model': 'leaf',
     'odometer': 59124,
     'odometer_in_km': 95150,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2014-07-24',
     'sanitized_make': 'nissan',
     'seller_name': 'mobilize financial services',
     'title': 'nissan leaf 80kw acenta 24kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '80kw acenta 24kwh 5dr auto',
     'year': 2014}
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002778685-01988702-001.pdf',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '0.0L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Electric',
 'id': 'd6793067-61c7-5b78-a020-56b7086c899f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'LO14SVZ',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/NISSAN/LEAF?id=2778685',
 'listing': 'auction',
 'location': 'Leeds - In Transit',
 'make': 'NISSAN',
 'model': 'LEAF',
 'odometer': 59124,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-24',
 'seller_name': 'Mobilize Financial Services',
 'title': 'NISSAN LEAF 80kW Acenta 24kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '80kW Acenta 24kWh 5dr Auto',
 'year': 2014}
2025-12-03 06:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272778685%27 HTTP/1.1" 200 None
2025-12-03 06:03:20 [manheim.gb] INFO: Saving data for 2778685: {'auction_closing_time': 1765184400.0, 'created_time': 1764583669.394007, 'last_price_update_time': 1764741800.214845}
2025-12-03 06:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2778685') HTTP/1.1" 204 0
2025-12-03 06:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/BMW/3SERIES?id=2757523&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232757523&indx=169> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:03:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:03:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04ea100a-c488-5795-9d65-494cf7151afc with identifier: 2757523
2025-12-03 06:03:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04ea100a-c488-5795-9d65-494cf7151afc with scrape type 2
2025-12-03 06:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 04ea100a-c488-5795-9d65-494cf7151afc with scrape type 2
2025-12-03 06:03:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 04ea100a-c488-5795-9d65-494cf7151afc, identifier: 2757523
2025-12-03 06:03:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 04ea100a-c488-5795-9d65-494cf7151afc with identifier: 2757523
2025-12-03 06:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-03 06:03:20 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Petrol%2FHybrid HTTP/1.1" 200 None
2025-12-03 06:03:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-03 06:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-03 06:03:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 04ea100a-c488-5795-9d65-494cf7151afc with identifier: 2757523
2025-12-03 06:03:20 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 185703 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    185703
2025-12-03 06:03:20 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 04ea100a-c488-5795-9d65-494cf7151afc spider: manheim.gb
2025-12-03 06:03:20 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 04ea100a-c488-5795-9d65-494cf7151afc due to rule: high_mileage_for_country.json, error: 185703 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    185703
{'auction_title': '',
 'c_o_2_emission_value': 49,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002757523-01985010-004.pdf',
 'color': 'Blue',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': '2025-12-03T09:00:00Z',
 'fuel_type': 'Petrol/Hybrid',
 'id': '04ea100a-c488-5795-9d65-494cf7151afc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'BP17GZN',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/BMW/3%20SERIES?id=2757523',
 'listing': 'auction',
 'location': 'Birmingham',
 'make': 'BMW',
 'model': '3 SERIES',
 'odometer': 115391,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-22',
 'seller_name': 'Hilton Garage Ltd',
 'title': 'BMW 3 SERIES 330e M Sport 4dr Step Auto',
 'transmission': 'automatic',
 'trim': '330e M Sport 4dr Step Auto',
 'year': 2017}
2025-12-03 06:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272757523%27 HTTP/1.1" 200 None
2025-12-03 06:03:20 [manheim.gb] INFO: Saving data for 2757523: {'auction_closing_time': 1764752400.0, 'created_time': 1764583668.670984, 'last_price_update_time': 1764741800.973681}
2025-12-03 06:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2757523') HTTP/1.1" 204 0
2025-12-03 06:03:20 [scrapy.extensions.logstats] INFO: Crawled 47 pages (at 25 pages/min), scraped 10 items (at 7 items/min)
2025-12-03 06:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/SKODA/FABIA?id=2871207&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232871207&indx=176> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:03:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:03:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10e99c2d-5dad-55d1-a2c8-378f73cd6cec with identifier: 2871207
2025-12-03 06:03:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10e99c2d-5dad-55d1-a2c8-378f73cd6cec with scrape type 2
2025-12-03 06:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 10e99c2d-5dad-55d1-a2c8-378f73cd6cec with scrape type 2
2025-12-03 06:03:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 10e99c2d-5dad-55d1-a2c8-378f73cd6cec, identifier: 2871207
2025-12-03 06:03:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 10e99c2d-5dad-55d1-a2c8-378f73cd6cec with identifier: 2871207
2025-12-03 06:03:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 10e99c2d-5dad-55d1-a2c8-378f73cd6cec with identifier: 2871207
2025-12-03 06:03:26 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 10e99c2d-5dad-55d1-a2c8-378f73cd6cec with identifier: 2871207 to the API
2025-12-03 06:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 06:03:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 06:03:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/SKODA/FABIA?id=2871207&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232871207&indx=176>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002871207-01981946-003.pdf',
 'color': 'BLUE',
 'currency': 'GBP',
 'engine': '1.0L',
 'expiration_date': '2025-12-03T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '10e99c2d-5dad-55d1-a2c8-378f73cd6cec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'YV68KSY',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/SKODA/FABIA?id=2871207',
 'listing': 'auction',
 'location': 'Plymouth',
 'make': 'SKODA',
 'model': 'FABIA',
 'odometer': 43567,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-15',
 'seller_name': 'Murray',
 'title': 'SKODA FABIA 1.0 MPI 75 S 5dr',
 'transmission': 'manual',
 'trim': '1.0 MPI 75 S 5dr',
 'year': 2019}
2025-12-03 06:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272871207%27 HTTP/1.1" 200 None
2025-12-03 06:03:27 [manheim.gb] INFO: Saving data for 2871207: {'auction_closing_time': 1764752400.0, 'created_time': 1764583536.58636, 'last_price_update_time': 1764741807.03831}
2025-12-03 06:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2871207') HTTP/1.1" 204 0
2025-12-03 06:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/CITROEN/C4CACTUS?id=2702439&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232702439&indx=165> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:03:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:03:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0bb3e344-7e13-501a-942f-36ecc761e2ea with identifier: 2702439
2025-12-03 06:03:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0bb3e344-7e13-501a-942f-36ecc761e2ea with scrape type 2
2025-12-03 06:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0bb3e344-7e13-501a-942f-36ecc761e2ea with scrape type 2
2025-12-03 06:03:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 0bb3e344-7e13-501a-942f-36ecc761e2ea, identifier: 2702439
2025-12-03 06:03:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 0bb3e344-7e13-501a-942f-36ecc761e2ea with identifier: 2702439
2025-12-03 06:03:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 0bb3e344-7e13-501a-942f-36ecc761e2ea with identifier: 2702439
2025-12-03 06:03:34 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 0bb3e344-7e13-501a-942f-36ecc761e2ea with identifier: 2702439 to the API
2025-12-03 06:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 06:03:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 06:03:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/CITROEN/C4CACTUS?id=2702439&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232702439&indx=165>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002702439-01977371-004.pdf',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': '2025-12-03T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '0bb3e344-7e13-501a-942f-36ecc761e2ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'KP70ORT',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/CITROEN/C4%20CACTUS?id=2702439',
 'listing': 'auction',
 'location': 'Leeds',
 'make': 'CITROEN',
 'model': 'C4 CACTUS',
 'odometer': 24280,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-26',
 'seller_name': 'Motor Dough',
 'title': 'CITROEN C4 CACTUS 1.2 PureTech Flair 5dr [6 Speed]',
 'transmission': 'manual',
 'trim': '1.2 PureTech Flair 5dr [6 Speed]',
 'year': 2021}
2025-12-03 06:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272702439%27 HTTP/1.1" 200 None
2025-12-03 06:03:36 [manheim.gb] INFO: Saving data for 2702439: {'auction_closing_time': 1764752400.0, 'created_time': 1764583731.565929, 'last_price_update_time': 1764741816.104719}
2025-12-03 06:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2702439') HTTP/1.1" 204 0
2025-12-03 06:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/MINI/HATCHBACK?id=2727315&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232727315&indx=166> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:03:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:03:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf5fdb7c-c144-54c8-9dd2-7478f85e3ced with identifier: 2727315
2025-12-03 06:03:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf5fdb7c-c144-54c8-9dd2-7478f85e3ced with scrape type 2
2025-12-03 06:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf5fdb7c-c144-54c8-9dd2-7478f85e3ced with scrape type 2
2025-12-03 06:03:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: cf5fdb7c-c144-54c8-9dd2-7478f85e3ced, identifier: 2727315
2025-12-03 06:03:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: cf5fdb7c-c144-54c8-9dd2-7478f85e3ced with identifier: 2727315
2025-12-03 06:03:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: cf5fdb7c-c144-54c8-9dd2-7478f85e3ced with identifier: 2727315
2025-12-03 06:03:36 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: cf5fdb7c-c144-54c8-9dd2-7478f85e3ced with identifier: 2727315 to the API
2025-12-03 06:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 06:03:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 06:03:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/MINI/HATCHBACK?id=2727315&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232727315&indx=166>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002727315-01976941-002.pdf',
 'color': 'GREEN',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'cf5fdb7c-c144-54c8-9dd2-7478f85e3ced',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'RJ17UVR',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MINI/HATCHBACK?id=2727315',
 'listing': 'auction',
 'location': 'Bristol',
 'make': 'MINI',
 'model': 'HATCHBACK',
 'odometer': 45980,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-16',
 'seller_name': None,
 'title': 'MINI HATCHBACK 1.2 One 5dr',
 'transmission': 'manual',
 'trim': '1.2 One 5dr',
 'year': 2017}
2025-12-03 06:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272727315%27 HTTP/1.1" 200 None
2025-12-03 06:03:36 [manheim.gb] INFO: Saving data for 2727315: {'auction_closing_time': 1764838800.0, 'created_time': 1764583776.027964, 'last_price_update_time': 1764741816.675328}
2025-12-03 06:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2727315') HTTP/1.1" 204 0
2025-12-03 06:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/LAND%20ROVER/RANGEROVERSPORT?id=2729252&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232729252&indx=167> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:03:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:03:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07970a7f-9120-5363-8f76-cbd98e00675e with identifier: 2729252
2025-12-03 06:03:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07970a7f-9120-5363-8f76-cbd98e00675e with scrape type 2
2025-12-03 06:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 07970a7f-9120-5363-8f76-cbd98e00675e with scrape type 2
2025-12-03 06:03:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 07970a7f-9120-5363-8f76-cbd98e00675e, identifier: 2729252
2025-12-03 06:03:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 07970a7f-9120-5363-8f76-cbd98e00675e with identifier: 2729252
2025-12-03 06:03:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 07970a7f-9120-5363-8f76-cbd98e00675e with identifier: 2729252
2025-12-03 06:03:37 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 07970a7f-9120-5363-8f76-cbd98e00675e with identifier: 2729252 to the API
2025-12-03 06:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 06:03:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 06:03:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/LAND%20ROVER/RANGEROVERSPORT?id=2729252&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232729252&indx=167>
{'auction_title': '',
 'c_o_2_emission_value': 164,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002729252-01964615-010.pdf',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': '2025-12-03T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '07970a7f-9120-5363-8f76-cbd98e00675e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'LC18WUM',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/LAND%20ROVER/RANGE%20ROVER%20SPORT?id=2729252',
 'listing': 'auction',
 'location': 'Washington',
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER SPORT',
 'odometer': 51232,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-28',
 'seller_name': 'Santander Consumer',
 'title': 'LAND ROVER RANGE ROVER SPORT 2.0 SD4 HSE 5dr Auto',
 'transmission': 'automatic',
 'trim': '2.0 SD4 HSE 5dr Auto',
 'year': 2018}
2025-12-03 06:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272729252%27 HTTP/1.1" 200 None
2025-12-03 06:03:38 [manheim.gb] INFO: Saving data for 2729252: {'auction_closing_time': 1764752400.0, 'created_time': 1764583666.519242, 'last_price_update_time': 1764741818.124758}
2025-12-03 06:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2729252') HTTP/1.1" 204 0
2025-12-03 06:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=2683371&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232683371&indx=160> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:03:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:03:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78b72932-c22b-5868-8008-2ee824273713 with identifier: 2683371
2025-12-03 06:03:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78b72932-c22b-5868-8008-2ee824273713 with scrape type 2
2025-12-03 06:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78b72932-c22b-5868-8008-2ee824273713 with scrape type 2
2025-12-03 06:03:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 78b72932-c22b-5868-8008-2ee824273713, identifier: 2683371
2025-12-03 06:03:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 78b72932-c22b-5868-8008-2ee824273713 with identifier: 2683371
2025-12-03 06:03:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 78b72932-c22b-5868-8008-2ee824273713 with identifier: 2683371
2025-12-03 06:03:47 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 78b72932-c22b-5868-8008-2ee824273713 with identifier: 2683371 to the API
2025-12-03 06:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 06:03:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 06:03:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=2683371&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232683371&indx=160>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002683371-01987227-002.pdf',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': '2025-12-03T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '78b72932-c22b-5868-8008-2ee824273713',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'DN18EHP',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=2683371',
 'listing': 'auction',
 'location': 'Leeds',
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 75400,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-31',
 'seller_name': 'Startline Motor Finance',
 'title': 'NISSAN QASHQAI 1.2 DiG-T N-Connecta 5dr',
 'transmission': 'manual',
 'trim': '1.2 DiG-T N-Connecta 5dr',
 'year': 2018}
2025-12-03 06:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272683371%27 HTTP/1.1" 200 None
2025-12-03 06:03:47 [manheim.gb] INFO: Saving data for 2683371: {'auction_closing_time': 1764752400.0, 'created_time': 1764583726.791792, 'last_price_update_time': 1764741827.895442}
2025-12-03 06:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2683371') HTTP/1.1" 204 0
2025-12-03 06:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/CITROEN/C4CACTUS?id=2667513&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232667513&indx=159> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:03:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:03:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e272d637-4ccf-5a3c-a8c2-64c996cd5690 with identifier: 2667513
2025-12-03 06:03:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e272d637-4ccf-5a3c-a8c2-64c996cd5690 with scrape type 2
2025-12-03 06:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e272d637-4ccf-5a3c-a8c2-64c996cd5690 with scrape type 2
2025-12-03 06:03:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: e272d637-4ccf-5a3c-a8c2-64c996cd5690, identifier: 2667513
2025-12-03 06:03:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: e272d637-4ccf-5a3c-a8c2-64c996cd5690 with identifier: 2667513
2025-12-03 06:03:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: e272d637-4ccf-5a3c-a8c2-64c996cd5690 with identifier: 2667513
2025-12-03 06:03:48 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: e272d637-4ccf-5a3c-a8c2-64c996cd5690 with identifier: 2667513 to the API
2025-12-03 06:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 06:03:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 06:03:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/CITROEN/C4CACTUS?id=2667513&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232667513&indx=159>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002667513-01942186-003.pdf',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'e272d637-4ccf-5a3c-a8c2-64c996cd5690',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'YD66PCU',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/CITROEN/C4%20CACTUS?id=2667513',
 'listing': 'auction',
 'location': 'Northampton',
 'make': 'CITROEN',
 'model': 'C4 CACTUS',
 'odometer': 65251,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-13',
 'seller_name': 'Donalds Group',
 'title': 'CITROEN C4 CACTUS 1.2 PureTech Touch 5dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech Touch 5dr',
 'year': 2016}
2025-12-03 06:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272667513%27 HTTP/1.1" 200 None
2025-12-03 06:03:48 [manheim.gb] INFO: Saving data for 2667513: {'auction_closing_time': 1764838800.0, 'created_time': 1764583779.318728, 'last_price_update_time': 1764741828.47825}
2025-12-03 06:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2667513') HTTP/1.1" 204 0
2025-12-03 06:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/FIAT/500?id=2688065&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232688065&indx=161> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:03:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:03:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba680a31-8554-5b07-8e77-10102820d632 with identifier: 2688065
2025-12-03 06:03:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba680a31-8554-5b07-8e77-10102820d632 with scrape type 2
2025-12-03 06:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ba680a31-8554-5b07-8e77-10102820d632 with scrape type 2
2025-12-03 06:03:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: ba680a31-8554-5b07-8e77-10102820d632, identifier: 2688065
2025-12-03 06:03:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: ba680a31-8554-5b07-8e77-10102820d632 with identifier: 2688065
2025-12-03 06:03:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: ba680a31-8554-5b07-8e77-10102820d632 with identifier: 2688065
2025-12-03 06:03:52 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: ba680a31-8554-5b07-8e77-10102820d632 with identifier: 2688065 to the API
2025-12-03 06:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 06:03:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 06:03:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/FIAT/500?id=2688065&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232688065&indx=161>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002688065-01959046-003.pdf',
 'color': 'GREEN',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'ba680a31-8554-5b07-8e77-10102820d632',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'SG16MMF',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FIAT/500?id=2688065',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'FIAT',
 'model': '500',
 'odometer': 49737,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-20',
 'seller_name': 'Motor Dough',
 'title': 'FIAT 500 1.2 Pop Star 3dr',
 'transmission': 'manual',
 'trim': '1.2 Pop Star 3dr',
 'year': 2016}
2025-12-03 06:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272688065%27 HTTP/1.1" 200 None
2025-12-03 06:03:52 [manheim.gb] INFO: Saving data for 2688065: {'auction_closing_time': 1764838800.0, 'created_time': 1764583714.208909, 'last_price_update_time': 1764741832.234965}
2025-12-03 06:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2688065') HTTP/1.1" 204 0
2025-12-03 06:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/SKODA/FABIA?id=2664010&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232664010&indx=158> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:03:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:03:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d02f576-2dd2-563d-9db3-0692a2501bcd with identifier: 2664010
2025-12-03 06:03:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d02f576-2dd2-563d-9db3-0692a2501bcd with scrape type 2
2025-12-03 06:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d02f576-2dd2-563d-9db3-0692a2501bcd with scrape type 2
2025-12-03 06:03:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 3d02f576-2dd2-563d-9db3-0692a2501bcd, identifier: 2664010
2025-12-03 06:03:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 3d02f576-2dd2-563d-9db3-0692a2501bcd with identifier: 2664010
2025-12-03 06:03:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 3d02f576-2dd2-563d-9db3-0692a2501bcd with identifier: 2664010
2025-12-03 06:03:56 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 0, 'seller_name': 'available car', 'price_includes_vat': False, 'title': 'skoda fabia 1.2 tsi 105 elegance 5dr', 'price': 0, 'currency': 'gbp', 'make': 'skoda', 'model': 'fabia', 'transmission': 'manual', 'engine': '1.2l', 'fuel_type': 'petrol', 'odometer': 132783, 'odometer_reading_unit': 'mi', 'registration_date': '2012-05-31', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/skoda/fabia?id=2664010', 'location': 'washington', 'origin_country_code': 'gb', 'trim': '1.2 tsi 105 elegance 5dr', 'license_plate': 'ef12krz', 'year': 2012, 'listing': 'directbuy', 'c_o_2_emission_value': 124, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002664010-01984058-004.pdf', 'expiration_date': '2025-12-05t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': '3d02f576-2dd2-563d-9db3-0692a2501bcd', 'current_year_diff': 13, 'age_in_months': 162, 'make_model': 'skoda fabia', 'sanitized_make': 'skoda', 'odometer_in_km': 213692}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 162,
     'auction_title': '',
     'c_o_2_emission_value': 124,
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002664010-01984058-004.pdf',
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 13,
     'engine': '1.2l',
     'expiration_date': '2025-12-05t09:00:00z',
     'fuel_type': 'petrol',
     'id': '3d02f576-2dd2-563d-9db3-0692a2501bcd',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'ef12krz',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/skoda/fabia?id=2664010',
     'listing': 'directbuy',
     'location': 'washington',
     'make': 'skoda',
     'make_model': 'skoda fabia',
     'model': 'fabia',
     'odometer': 132783,
     'odometer_in_km': 213692,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2012-05-31',
     'sanitized_make': 'skoda',
     'seller_name': 'available car',
     'title': 'skoda fabia 1.2 tsi 105 elegance 5dr',
     'transmission': 'manual',
     'trim': '1.2 tsi 105 elegance 5dr',
     'year': 2012}
2025-12-03 06:03:56 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 3d02f576-2dd2-563d-9db3-0692a2501bcd spider: manheim.gb
2025-12-03 06:03:56 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 3d02f576-2dd2-563d-9db3-0692a2501bcd due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 0, 'seller_name': 'available car', 'price_includes_vat': False, 'title': 'skoda fabia 1.2 tsi 105 elegance 5dr', 'price': 0, 'currency': 'gbp', 'make': 'skoda', 'model': 'fabia', 'transmission': 'manual', 'engine': '1.2l', 'fuel_type': 'petrol', 'odometer': 132783, 'odometer_reading_unit': 'mi', 'registration_date': '2012-05-31', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/skoda/fabia?id=2664010', 'location': 'washington', 'origin_country_code': 'gb', 'trim': '1.2 tsi 105 elegance 5dr', 'license_plate': 'ef12krz', 'year': 2012, 'listing': 'directbuy', 'c_o_2_emission_value': 124, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002664010-01984058-004.pdf', 'expiration_date': '2025-12-05t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': '3d02f576-2dd2-563d-9db3-0692a2501bcd', 'current_year_diff': 13, 'age_in_months': 162, 'make_model': 'skoda fabia', 'sanitized_make': 'skoda', 'odometer_in_km': 213692}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 162,
     'auction_title': '',
     'c_o_2_emission_value': 124,
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002664010-01984058-004.pdf',
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 13,
     'engine': '1.2l',
     'expiration_date': '2025-12-05t09:00:00z',
     'fuel_type': 'petrol',
     'id': '3d02f576-2dd2-563d-9db3-0692a2501bcd',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'ef12krz',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/skoda/fabia?id=2664010',
     'listing': 'directbuy',
     'location': 'washington',
     'make': 'skoda',
     'make_model': 'skoda fabia',
     'model': 'fabia',
     'odometer': 132783,
     'odometer_in_km': 213692,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2012-05-31',
     'sanitized_make': 'skoda',
     'seller_name': 'available car',
     'title': 'skoda fabia 1.2 tsi 105 elegance 5dr',
     'transmission': 'manual',
     'trim': '1.2 tsi 105 elegance 5dr',
     'year': 2012}
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002664010-01984058-004.pdf',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': '2025-12-05T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '3d02f576-2dd2-563d-9db3-0692a2501bcd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'EF12KRZ',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/SKODA/FABIA?id=2664010',
 'listing': 'directbuy',
 'location': 'Washington',
 'make': 'SKODA',
 'model': 'FABIA',
 'odometer': 132783,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-31',
 'seller_name': 'Available Car',
 'title': 'SKODA FABIA 1.2 TSI 105 Elegance 5dr',
 'transmission': 'manual',
 'trim': '1.2 TSI 105 Elegance 5dr',
 'year': 2012}
2025-12-03 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272664010%27 HTTP/1.1" 200 None
2025-12-03 06:03:56 [manheim.gb] INFO: Saving data for 2664010: {'auction_closing_time': 1764925200.0, 'created_time': 1764583769.473579, 'last_price_update_time': 1764741836.470974}
2025-12-03 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2664010') HTTP/1.1" 204 0
2025-12-03 06:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/AUDI/A1?id=2565829&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232565829&indx=151> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:04:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/FORD/FIESTA?id=2562472&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232562472&indx=150> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:04:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:04:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: baee4a91-96ad-5df9-b3a4-0a6583fe24de with identifier: 2565829
2025-12-03 06:04:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item baee4a91-96ad-5df9-b3a4-0a6583fe24de with scrape type 2
2025-12-03 06:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item baee4a91-96ad-5df9-b3a4-0a6583fe24de with scrape type 2
2025-12-03 06:04:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: baee4a91-96ad-5df9-b3a4-0a6583fe24de, identifier: 2565829
2025-12-03 06:04:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: baee4a91-96ad-5df9-b3a4-0a6583fe24de with identifier: 2565829
2025-12-03 06:04:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: baee4a91-96ad-5df9-b3a4-0a6583fe24de with identifier: 2565829
2025-12-03 06:04:02 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: baee4a91-96ad-5df9-b3a4-0a6583fe24de with identifier: 2565829 to the API
2025-12-03 06:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 06:04:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 06:04:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/AUDI/A1?id=2565829&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232565829&indx=151>
{'auction_title': '',
 'c_o_2_emission_value': 93,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002565829-01982876-002.pdf',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': '2025-12-03T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'baee4a91-96ad-5df9-b3a4-0a6583fe24de',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'DK16UMX',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/AUDI/A1?id=2565829',
 'listing': 'auction',
 'location': 'Washington',
 'make': 'AUDI',
 'model': 'A1',
 'odometer': 81754,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-01',
 'seller_name': 'Lookers',
 'title': 'AUDI A1 1.6 TDI S Line 5dr',
 'transmission': 'manual',
 'trim': '1.6 TDI S Line 5dr',
 'year': 2016}
2025-12-03 06:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272565829%27 HTTP/1.1" 200 None
2025-12-03 06:04:02 [manheim.gb] INFO: Saving data for 2565829: {'auction_closing_time': 1764752400.0, 'created_time': 1764583793.032645, 'last_price_update_time': 1764741842.217182}
2025-12-03 06:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2565829') HTTP/1.1" 204 0
2025-12-03 06:04:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40576e60-7714-51a3-b421-204c9ca6466d with identifier: 2562472
2025-12-03 06:04:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40576e60-7714-51a3-b421-204c9ca6466d with scrape type 1
2025-12-03 06:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 40576e60-7714-51a3-b421-204c9ca6466d
2025-12-03 06:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fawaiting-image-002.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/awaiting-image-002.jpg already downloaded
2025-12-03 06:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fawaiting-image-002.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/awaiting-image-002.jpg already downloaded
2025-12-03 06:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2562472-4005622-3.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2562472-4005622-3.jpg not downloaded yet
2025-12-03 06:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2562472-4005622-13.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2562472-4005622-13.jpg not downloaded yet
2025-12-03 06:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2562472-4005622-1000.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2562472-4005622-1000.jpg not downloaded yet
2025-12-03 06:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2562472-4005622-1001.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2562472-4005622-1001.jpg not downloaded yet
2025-12-03 06:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2562472-4005622-1002.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2562472-4005622-1002.jpg not downloaded yet
2025-12-03 06:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2562472-4005622-1003.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2562472-4005622-1003.jpg not downloaded yet
2025-12-03 06:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2562472-4005622-1004.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2562472-4005622-1004.jpg not downloaded yet
2025-12-03 06:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2562472-4005622-1005.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2562472-4005622-1005.jpg not downloaded yet
2025-12-03 06:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2562472-4005622-1006.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2562472-4005622-1006.jpg not downloaded yet
2025-12-03 06:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2562472-4005622-1007.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2562472-4005622-1007.jpg not downloaded yet
2025-12-03 06:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2562472-4005622-1008.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2562472-4005622-1008.jpg not downloaded yet
2025-12-03 06:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2562472-4005622-1009.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2562472-4005622-1009.jpg not downloaded yet
2025-12-03 06:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2562472-4005622-1010.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2562472-4005622-1010.jpg not downloaded yet
2025-12-03 06:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2562472-4005622-1011.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2562472-4005622-1011.jpg not downloaded yet
2025-12-03 06:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/ALFA%20ROMEO/GIULIETTA?id=2542025&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232542025&indx=145> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:04:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:04:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0df5f05-813f-55bb-8394-48a9b83bddd6 with identifier: 2542025
2025-12-03 06:04:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0df5f05-813f-55bb-8394-48a9b83bddd6 with scrape type 2
2025-12-03 06:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d0df5f05-813f-55bb-8394-48a9b83bddd6 with scrape type 2
2025-12-03 06:04:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: d0df5f05-813f-55bb-8394-48a9b83bddd6, identifier: 2542025
2025-12-03 06:04:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: d0df5f05-813f-55bb-8394-48a9b83bddd6 with identifier: 2542025
2025-12-03 06:04:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: d0df5f05-813f-55bb-8394-48a9b83bddd6 with identifier: 2542025
2025-12-03 06:04:09 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 148149 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    148149
2025-12-03 06:04:09 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: d0df5f05-813f-55bb-8394-48a9b83bddd6 spider: manheim.gb
2025-12-03 06:04:09 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: d0df5f05-813f-55bb-8394-48a9b83bddd6 due to rule: high_mileage_for_make.json, error: 148149 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    148149
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002542025-01984219-002.pdf',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.4L',
 'expiration_date': '2025-12-03T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'd0df5f05-813f-55bb-8394-48a9b83bddd6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'ND65WHE',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/ALFA%20ROMEO/GIULIETTA?id=2542025',
 'listing': 'auction',
 'location': 'Leeds',
 'make': 'ALFA ROMEO',
 'model': 'GIULIETTA',
 'odometer': 92056,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-29',
 'seller_name': 'Available Car',
 'title': 'ALFA ROMEO GIULIETTA 1.4 TB MultiAir Exclusive 5dr',
 'transmission': 'manual',
 'trim': '1.4 TB MultiAir Exclusive 5dr',
 'year': 2016}
2025-12-03 06:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272542025%27 HTTP/1.1" 200 None
2025-12-03 06:04:09 [manheim.gb] INFO: Saving data for 2542025: {'auction_closing_time': 1764752400.0, 'created_time': 1764583852.616928, 'last_price_update_time': 1764741849.740373}
2025-12-03 06:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2542025') HTTP/1.1" 204 0
2025-12-03 06:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2562472-4005622-1011.jpg> (referer: None)
2025-12-03 06:04:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:04:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f61752d0>
2025-12-03 06:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:04:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40576e60-7714-51a3-b421-204c9ca6466d/40576e60-7714-51a3-b421-204c9ca6466d_image_15.jpg HTTP/1.1" 201 0
2025-12-03 06:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2562472-4005622-1011.jpg') HTTP/1.1" 204 0
2025-12-03 06:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2562472-4005622-1011.jpg saved to cache
2025-12-03 06:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 40576e60-7714-51a3-b421-204c9ca6466d
2025-12-03 06:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2562472-4005622-1010.jpg> (referer: None)
2025-12-03 06:04:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:04:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f630fc90>
2025-12-03 06:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:04:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40576e60-7714-51a3-b421-204c9ca6466d/40576e60-7714-51a3-b421-204c9ca6466d_image_14.jpg HTTP/1.1" 201 0
2025-12-03 06:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2562472-4005622-1010.jpg') HTTP/1.1" 204 0
2025-12-03 06:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2562472-4005622-1010.jpg saved to cache
2025-12-03 06:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 40576e60-7714-51a3-b421-204c9ca6466d
2025-12-03 06:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2562472-4005622-1009.jpg> (referer: None)
2025-12-03 06:04:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:04:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f613eb90>
2025-12-03 06:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:04:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40576e60-7714-51a3-b421-204c9ca6466d/40576e60-7714-51a3-b421-204c9ca6466d_image_13.jpg HTTP/1.1" 201 0
2025-12-03 06:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2562472-4005622-1009.jpg') HTTP/1.1" 204 0
2025-12-03 06:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2562472-4005622-1009.jpg saved to cache
2025-12-03 06:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 40576e60-7714-51a3-b421-204c9ca6466d
2025-12-03 06:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2562472-4005622-1008.jpg> (referer: None)
2025-12-03 06:04:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:04:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:04:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:04:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6563c90>
2025-12-03 06:04:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:04:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:04:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40576e60-7714-51a3-b421-204c9ca6466d/40576e60-7714-51a3-b421-204c9ca6466d_image_12.jpg HTTP/1.1" 201 0
2025-12-03 06:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2562472-4005622-1008.jpg') HTTP/1.1" 204 0
2025-12-03 06:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2562472-4005622-1008.jpg saved to cache
2025-12-03 06:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 40576e60-7714-51a3-b421-204c9ca6466d
2025-12-03 06:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2562472-4005622-1007.jpg> (referer: None)
2025-12-03 06:04:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:04:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:04:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:04:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f5b7cf10>
2025-12-03 06:04:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:04:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 06:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:04:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40576e60-7714-51a3-b421-204c9ca6466d/40576e60-7714-51a3-b421-204c9ca6466d_image_11.jpg HTTP/1.1" 201 0
2025-12-03 06:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2562472-4005622-1007.jpg') HTTP/1.1" 204 0
2025-12-03 06:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2562472-4005622-1007.jpg saved to cache
2025-12-03 06:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 40576e60-7714-51a3-b421-204c9ca6466d
2025-12-03 06:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2562472-4005622-1006.jpg> (referer: None)
2025-12-03 06:04:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:04:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:04:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:04:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f63ab6d0>
2025-12-03 06:04:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:04:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:04:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40576e60-7714-51a3-b421-204c9ca6466d/40576e60-7714-51a3-b421-204c9ca6466d_image_10.jpg HTTP/1.1" 201 0
2025-12-03 06:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2562472-4005622-1006.jpg') HTTP/1.1" 204 0
2025-12-03 06:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2562472-4005622-1006.jpg saved to cache
2025-12-03 06:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 40576e60-7714-51a3-b421-204c9ca6466d
2025-12-03 06:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2562472-4005622-1005.jpg> (referer: None)
2025-12-03 06:04:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:04:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:04:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:04:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f52dd6d0>
2025-12-03 06:04:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:04:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:04:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40576e60-7714-51a3-b421-204c9ca6466d/40576e60-7714-51a3-b421-204c9ca6466d_image_9.jpg HTTP/1.1" 201 0
2025-12-03 06:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2562472-4005622-1005.jpg') HTTP/1.1" 204 0
2025-12-03 06:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2562472-4005622-1005.jpg saved to cache
2025-12-03 06:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 40576e60-7714-51a3-b421-204c9ca6466d
2025-12-03 06:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2562472-4005622-1004.jpg> (referer: None)
2025-12-03 06:04:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:04:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:04:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:04:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6367110>
2025-12-03 06:04:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:04:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 06:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:04:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40576e60-7714-51a3-b421-204c9ca6466d/40576e60-7714-51a3-b421-204c9ca6466d_image_8.jpg HTTP/1.1" 201 0
2025-12-03 06:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2562472-4005622-1004.jpg') HTTP/1.1" 204 0
2025-12-03 06:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2562472-4005622-1004.jpg saved to cache
2025-12-03 06:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 40576e60-7714-51a3-b421-204c9ca6466d
2025-12-03 06:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2562472-4005622-1003.jpg> (referer: None)
2025-12-03 06:04:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:04:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:04:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:04:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6367d10>
2025-12-03 06:04:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:04:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:04:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40576e60-7714-51a3-b421-204c9ca6466d/40576e60-7714-51a3-b421-204c9ca6466d_image_7.jpg HTTP/1.1" 201 0
2025-12-03 06:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2562472-4005622-1003.jpg') HTTP/1.1" 204 0
2025-12-03 06:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2562472-4005622-1003.jpg saved to cache
2025-12-03 06:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 40576e60-7714-51a3-b421-204c9ca6466d
2025-12-03 06:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/AUDI/A4?id=2536974&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232536974&indx=144> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:04:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2562472-4005622-1002.jpg> (referer: None)
2025-12-03 06:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/BMW/4SERIES?id=2589156&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232589156&indx=153> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:04:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:04:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d39d1ba-01de-582d-a1a3-376f3ca011a7 with identifier: 2536974
2025-12-03 06:04:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d39d1ba-01de-582d-a1a3-376f3ca011a7 with scrape type 2
2025-12-03 06:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d39d1ba-01de-582d-a1a3-376f3ca011a7 with scrape type 2
2025-12-03 06:04:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 1d39d1ba-01de-582d-a1a3-376f3ca011a7, identifier: 2536974
2025-12-03 06:04:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 1d39d1ba-01de-582d-a1a3-376f3ca011a7 with identifier: 2536974
2025-12-03 06:04:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 1d39d1ba-01de-582d-a1a3-376f3ca011a7 with identifier: 2536974
2025-12-03 06:04:13 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': 'riverside motors', 'price_includes_vat': False, 'title': 'audi a4 2.0 tdi ultra 163 se technik 4dr', 'price': 0, 'currency': 'gbp', 'make': 'audi', 'model': 'a4', 'transmission': 'manual', 'engine': '2.0l', 'fuel_type': 'diesel', 'odometer': 133381, 'odometer_reading_unit': 'mi', 'registration_date': '2015-09-30', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/audi/a4?id=2536974', 'location': 'leeds', 'origin_country_code': 'gb', 'trim': '2.0 tdi ultra 163 se technik 4dr', 'license_plate': 'sg65pjx', 'year': 2015, 'listing': 'auction', 'c_o_2_emission_value': 109, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002536974-01981453-003.pdf', 'expiration_date': '2025-12-03t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': '1d39d1ba-01de-582d-a1a3-376f3ca011a7', 'current_year_diff': 10, 'age_in_months': 122, 'make_model': 'audi a4', 'sanitized_make': 'audi', 'odometer_in_km': 214655}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 122,
     'auction_title': '',
     'c_o_2_emission_value': 109,
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002536974-01981453-003.pdf',
     'color': 'red',
     'currency': 'gbp',
     'current_year_diff': 10,
     'engine': '2.0l',
     'expiration_date': '2025-12-03t09:00:00z',
     'fuel_type': 'diesel',
     'id': '1d39d1ba-01de-582d-a1a3-376f3ca011a7',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'sg65pjx',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/audi/a4?id=2536974',
     'listing': 'auction',
     'location': 'leeds',
     'make': 'audi',
     'make_model': 'audi a4',
     'model': 'a4',
     'odometer': 133381,
     'odometer_in_km': 214655,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2015-09-30',
     'sanitized_make': 'audi',
     'seller_name': 'riverside motors',
     'title': 'audi a4 2.0 tdi ultra 163 se technik 4dr',
     'transmission': 'manual',
     'trim': '2.0 tdi ultra 163 se technik 4dr',
     'year': 2015}
2025-12-03 06:04:13 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 1d39d1ba-01de-582d-a1a3-376f3ca011a7 spider: manheim.gb
2025-12-03 06:04:13 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 1d39d1ba-01de-582d-a1a3-376f3ca011a7 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': 'riverside motors', 'price_includes_vat': False, 'title': 'audi a4 2.0 tdi ultra 163 se technik 4dr', 'price': 0, 'currency': 'gbp', 'make': 'audi', 'model': 'a4', 'transmission': 'manual', 'engine': '2.0l', 'fuel_type': 'diesel', 'odometer': 133381, 'odometer_reading_unit': 'mi', 'registration_date': '2015-09-30', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/audi/a4?id=2536974', 'location': 'leeds', 'origin_country_code': 'gb', 'trim': '2.0 tdi ultra 163 se technik 4dr', 'license_plate': 'sg65pjx', 'year': 2015, 'listing': 'auction', 'c_o_2_emission_value': 109, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002536974-01981453-003.pdf', 'expiration_date': '2025-12-03t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': '1d39d1ba-01de-582d-a1a3-376f3ca011a7', 'current_year_diff': 10, 'age_in_months': 122, 'make_model': 'audi a4', 'sanitized_make': 'audi', 'odometer_in_km': 214655}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 122,
     'auction_title': '',
     'c_o_2_emission_value': 109,
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002536974-01981453-003.pdf',
     'color': 'red',
     'currency': 'gbp',
     'current_year_diff': 10,
     'engine': '2.0l',
     'expiration_date': '2025-12-03t09:00:00z',
     'fuel_type': 'diesel',
     'id': '1d39d1ba-01de-582d-a1a3-376f3ca011a7',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'sg65pjx',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/audi/a4?id=2536974',
     'listing': 'auction',
     'location': 'leeds',
     'make': 'audi',
     'make_model': 'audi a4',
     'model': 'a4',
     'odometer': 133381,
     'odometer_in_km': 214655,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2015-09-30',
     'sanitized_make': 'audi',
     'seller_name': 'riverside motors',
     'title': 'audi a4 2.0 tdi ultra 163 se technik 4dr',
     'transmission': 'manual',
     'trim': '2.0 tdi ultra 163 se technik 4dr',
     'year': 2015}
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002536974-01981453-003.pdf',
 'color': 'RED',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': '2025-12-03T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '1d39d1ba-01de-582d-a1a3-376f3ca011a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'SG65PJX',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/AUDI/A4?id=2536974',
 'listing': 'auction',
 'location': 'Leeds',
 'make': 'AUDI',
 'model': 'A4',
 'odometer': 133381,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-30',
 'seller_name': 'Riverside Motors',
 'title': 'AUDI A4 2.0 TDI Ultra 163 SE Technik 4dr',
 'transmission': 'manual',
 'trim': '2.0 TDI Ultra 163 SE Technik 4dr',
 'year': 2015}
2025-12-03 06:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272536974%27 HTTP/1.1" 200 None
2025-12-03 06:04:13 [manheim.gb] INFO: Saving data for 2536974: {'auction_closing_time': 1764752400.0, 'created_time': 1764583823.794103, 'last_price_update_time': 1764741853.878078}
2025-12-03 06:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2536974') HTTP/1.1" 204 0
2025-12-03 06:04:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:04:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:04:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:04:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f5b57490>
2025-12-03 06:04:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:04:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:04:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40576e60-7714-51a3-b421-204c9ca6466d/40576e60-7714-51a3-b421-204c9ca6466d_image_6.jpg HTTP/1.1" 201 0
2025-12-03 06:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2562472-4005622-1002.jpg') HTTP/1.1" 204 0
2025-12-03 06:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2562472-4005622-1002.jpg saved to cache
2025-12-03 06:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 40576e60-7714-51a3-b421-204c9ca6466d
2025-12-03 06:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2562472-4005622-1001.jpg> (referer: None)
2025-12-03 06:04:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a02fa0fa-8faa-5884-b276-54e4303dc975 with identifier: 2589156
2025-12-03 06:04:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a02fa0fa-8faa-5884-b276-54e4303dc975 with scrape type 2
2025-12-03 06:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a02fa0fa-8faa-5884-b276-54e4303dc975 with scrape type 2
2025-12-03 06:04:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: a02fa0fa-8faa-5884-b276-54e4303dc975, identifier: 2589156
2025-12-03 06:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2562472-4005622-1000.jpg> (referer: None)
2025-12-03 06:04:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: a02fa0fa-8faa-5884-b276-54e4303dc975 with identifier: 2589156
2025-12-03 06:04:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: a02fa0fa-8faa-5884-b276-54e4303dc975 with identifier: 2589156
2025-12-03 06:04:14 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: a02fa0fa-8faa-5884-b276-54e4303dc975 with identifier: 2589156 to the API
2025-12-03 06:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 06:04:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-03 06:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27a02fa0fa-8faa-5884-b276-54e4303dc975%27 HTTP/1.1" 200 None
2025-12-03 06:04:14 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id a02fa0fa-8faa-5884-b276-54e4303dc975: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 03 Dec 2025 06:04:13 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-03 06:04:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/BMW/4SERIES?id=2589156&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232589156&indx=153>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002589156-01972225-005.pdf',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': '2025-12-03T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'a02fa0fa-8faa-5884-b276-54e4303dc975',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'RF18YZO',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/BMW/4%20SERIES?id=2589156',
 'listing': 'auction',
 'location': 'Birmingham',
 'make': 'BMW',
 'model': '4 SERIES',
 'odometer': 74246,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-29',
 'seller_name': 'Big Motoring World Ltd',
 'title': 'BMW 4 SERIES 420i M Sport 2dr Auto [Professional Media]',
 'transmission': 'automatic',
 'trim': '420i M Sport 2dr Auto [Professional Media]',
 'year': 2018}
2025-12-03 06:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272589156%27 HTTP/1.1" 200 None
2025-12-03 06:04:14 [manheim.gb] INFO: Saving data for 2589156: {'auction_closing_time': 1764752400.0, 'created_time': 1764583790.501585, 'last_price_update_time': 1764741854.691866}
2025-12-03 06:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2589156') HTTP/1.1" 204 0
2025-12-03 06:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2562472-4005622-13.jpg> (referer: None)
2025-12-03 06:04:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:04:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:04:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:04:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6323050>
2025-12-03 06:04:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:04:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40576e60-7714-51a3-b421-204c9ca6466d/40576e60-7714-51a3-b421-204c9ca6466d_image_5.jpg HTTP/1.1" 201 0
2025-12-03 06:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2562472-4005622-1001.jpg') HTTP/1.1" 204 0
2025-12-03 06:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2562472-4005622-1001.jpg saved to cache
2025-12-03 06:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 40576e60-7714-51a3-b421-204c9ca6466d
2025-12-03 06:04:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:04:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6374810>
2025-12-03 06:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:04:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40576e60-7714-51a3-b421-204c9ca6466d/40576e60-7714-51a3-b421-204c9ca6466d_image_4.jpg HTTP/1.1" 201 0
2025-12-03 06:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2562472-4005622-1000.jpg') HTTP/1.1" 204 0
2025-12-03 06:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2562472-4005622-1000.jpg saved to cache
2025-12-03 06:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 40576e60-7714-51a3-b421-204c9ca6466d
2025-12-03 06:04:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2562472-4005622-3.jpg> (referer: None)
2025-12-03 06:04:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:04:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6322690>
2025-12-03 06:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:04:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40576e60-7714-51a3-b421-204c9ca6466d/40576e60-7714-51a3-b421-204c9ca6466d_image_3.jpg HTTP/1.1" 201 0
2025-12-03 06:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2562472-4005622-13.jpg') HTTP/1.1" 204 0
2025-12-03 06:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2562472-4005622-13.jpg saved to cache
2025-12-03 06:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 40576e60-7714-51a3-b421-204c9ca6466d
2025-12-03 06:04:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:04:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6329a90>
2025-12-03 06:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:04:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 06:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40576e60-7714-51a3-b421-204c9ca6466d/40576e60-7714-51a3-b421-204c9ca6466d_image_2.jpg HTTP/1.1" 201 0
2025-12-03 06:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2562472-4005622-3.jpg') HTTP/1.1" 204 0
2025-12-03 06:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2562472-4005622-3.jpg saved to cache
2025-12-03 06:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 40576e60-7714-51a3-b421-204c9ca6466d
2025-12-03 06:04:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 40576e60-7714-51a3-b421-204c9ca6466d, skipping ID generation
2025-12-03 06:04:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40576e60-7714-51a3-b421-204c9ca6466d with scrape type 1
2025-12-03 06:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 40576e60-7714-51a3-b421-204c9ca6466d from tracking dictionaries
2025-12-03 06:04:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 40576e60-7714-51a3-b421-204c9ca6466d sending to next pipeline
2025-12-03 06:04:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 40576e60-7714-51a3-b421-204c9ca6466d, identifier: 2562472
2025-12-03 06:04:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 40576e60-7714-51a3-b421-204c9ca6466d with identifier: 2562472
2025-12-03 06:04:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 40576e60-7714-51a3-b421-204c9ca6466d with identifier: 2562472
2025-12-03 06:04:16 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 40576e60-7714-51a3-b421-204c9ca6466d with identifier: 2562472 to the API
2025-12-03 06:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 06:04:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 06:04:16 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/insp-0001-2562472-4005622-3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'car_expert_report_source_url': None,
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.0L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '40576e60-7714-51a3-b421-204c9ca6466d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'FP19YXT',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FORD/FIESTA?id=2562472',
 'listing': 'auction',
 'location': 'Northampton',
 'make': 'FORD',
 'model': 'FIESTA',
 'odometer': 42472,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4622c3ba-5515-5758-814e-2f49e4247fa1/4622c3ba-5515-5758-814e-2f49e4247fa1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72484,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/awaiting-image-002.jpg',
             'Width': 1322},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4622c3ba-5515-5758-814e-2f49e4247fa1/4622c3ba-5515-5758-814e-2f49e4247fa1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72484,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/awaiting-image-002.jpg',
             'Width': 1322},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40576e60-7714-51a3-b421-204c9ca6466d/40576e60-7714-51a3-b421-204c9ca6466d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 197317,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2562472-4005622-3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40576e60-7714-51a3-b421-204c9ca6466d/40576e60-7714-51a3-b421-204c9ca6466d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 243692,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2562472-4005622-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40576e60-7714-51a3-b421-204c9ca6466d/40576e60-7714-51a3-b421-204c9ca6466d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 276412,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2562472-4005622-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40576e60-7714-51a3-b421-204c9ca6466d/40576e60-7714-51a3-b421-204c9ca6466d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 150941,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2562472-4005622-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40576e60-7714-51a3-b421-204c9ca6466d/40576e60-7714-51a3-b421-204c9ca6466d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 223296,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2562472-4005622-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40576e60-7714-51a3-b421-204c9ca6466d/40576e60-7714-51a3-b421-204c9ca6466d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 148294,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2562472-4005622-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40576e60-7714-51a3-b421-204c9ca6466d/40576e60-7714-51a3-b421-204c9ca6466d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 221305,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2562472-4005622-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40576e60-7714-51a3-b421-204c9ca6466d/40576e60-7714-51a3-b421-204c9ca6466d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 199031,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2562472-4005622-1005.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40576e60-7714-51a3-b421-204c9ca6466d/40576e60-7714-51a3-b421-204c9ca6466d_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 156204,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2562472-4005622-1006.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40576e60-7714-51a3-b421-204c9ca6466d/40576e60-7714-51a3-b421-204c9ca6466d_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 144772,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2562472-4005622-1007.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40576e60-7714-51a3-b421-204c9ca6466d/40576e60-7714-51a3-b421-204c9ca6466d_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 196973,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2562472-4005622-1008.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40576e60-7714-51a3-b421-204c9ca6466d/40576e60-7714-51a3-b421-204c9ca6466d_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 188476,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2562472-4005622-1009.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40576e60-7714-51a3-b421-204c9ca6466d/40576e60-7714-51a3-b421-204c9ca6466d_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 202715,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2562472-4005622-1010.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40576e60-7714-51a3-b421-204c9ca6466d/40576e60-7714-51a3-b421-204c9ca6466d_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 161095,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2562472-4005622-1011.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-01',
 'seller_name': 'Sytner',
 'title': 'FORD FIESTA 1.0 EcoBoost Zetec 5dr',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost Zetec 5dr',
 'year': 2019}
2025-12-03 06:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272562472%27 HTTP/1.1" 200 None
2025-12-03 06:04:16 [manheim.gb] INFO: Saving data for 2562472: {'created_time': 1764741856.488217, 'last_price_update_time': 1764741856.488231, 'auction_closing_time': 1765270800.0}
2025-12-03 06:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2562472') HTTP/1.1" 204 0
2025-12-03 06:04:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/NISSAN/JUKE?id=2531448&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232531448&indx=143> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:04:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:04:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55c1ee79-9715-5cf8-8989-8dbd140dddc8 with identifier: 2531448
2025-12-03 06:04:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55c1ee79-9715-5cf8-8989-8dbd140dddc8 with scrape type 2
2025-12-03 06:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 55c1ee79-9715-5cf8-8989-8dbd140dddc8 with scrape type 2
2025-12-03 06:04:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 55c1ee79-9715-5cf8-8989-8dbd140dddc8, identifier: 2531448
2025-12-03 06:04:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 55c1ee79-9715-5cf8-8989-8dbd140dddc8 with identifier: 2531448
2025-12-03 06:04:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 55c1ee79-9715-5cf8-8989-8dbd140dddc8 with identifier: 2531448
2025-12-03 06:04:16 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 55c1ee79-9715-5cf8-8989-8dbd140dddc8 with identifier: 2531448 to the API
2025-12-03 06:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 06:04:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 06:04:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/NISSAN/JUKE?id=2531448&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232531448&indx=143>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002531448-01987122-003.pdf',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': '2025-12-03T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '55c1ee79-9715-5cf8-8989-8dbd140dddc8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'PK17LDE',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/NISSAN/JUKE?id=2531448',
 'listing': 'auction',
 'location': 'Plymouth',
 'make': 'NISSAN',
 'model': 'JUKE',
 'odometer': 69705,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-29',
 'seller_name': 'Startline Motor Finance',
 'title': 'NISSAN JUKE 1.2 DiG-T N-Connecta 5dr',
 'transmission': 'manual',
 'trim': '1.2 DiG-T N-Connecta 5dr',
 'year': 2017}
2025-12-03 06:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272531448%27 HTTP/1.1" 200 None
2025-12-03 06:04:17 [manheim.gb] INFO: Saving data for 2531448: {'auction_closing_time': 1764752400.0, 'created_time': 1764583429.669596, 'last_price_update_time': 1764741857.128768}
2025-12-03 06:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2531448') HTTP/1.1" 204 0
2025-12-03 06:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/POLO?id=2528107&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232528107&indx=141> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:04:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:04:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e302b2a1-cc53-52af-ac82-65ce87c63923 with identifier: 2528107
2025-12-03 06:04:17 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item e302b2a1-cc53-52af-ac82-65ce87c63923
2025-12-03 06:04:20 [scrapy.extensions.logstats] INFO: Crawled 62 pages (at 15 pages/min), scraped 21 items (at 11 items/min)
2025-12-03 06:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/CITROEN/C3AIRCROSS?id=2461241&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232461241&indx=138> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:04:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:04:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5522c61e-93a4-5fcf-941c-c1c0a1e2e7e0 with identifier: 2461241
2025-12-03 06:04:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5522c61e-93a4-5fcf-941c-c1c0a1e2e7e0 with scrape type 2
2025-12-03 06:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5522c61e-93a4-5fcf-941c-c1c0a1e2e7e0 with scrape type 2
2025-12-03 06:04:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 5522c61e-93a4-5fcf-941c-c1c0a1e2e7e0, identifier: 2461241
2025-12-03 06:04:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 5522c61e-93a4-5fcf-941c-c1c0a1e2e7e0 with identifier: 2461241
2025-12-03 06:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-03 06:04:21 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=ORANGE HTTP/1.1" 200 None
2025-12-03 06:04:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-03 06:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-03 06:04:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 5522c61e-93a4-5fcf-941c-c1c0a1e2e7e0 with identifier: 2461241
2025-12-03 06:04:21 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 151530 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    151530
2025-12-03 06:04:21 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 5522c61e-93a4-5fcf-941c-c1c0a1e2e7e0 spider: manheim.gb
2025-12-03 06:04:21 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 5522c61e-93a4-5fcf-941c-c1c0a1e2e7e0 due to rule: high_mileage_for_country.json, error: 151530 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    151530
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002461241-01970176-007.pdf',
 'color': 'ORANGE',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '5522c61e-93a4-5fcf-941c-c1c0a1e2e7e0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'NGZ9074',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/CITROEN/C3%20AIRCROSS?id=2461241',
 'listing': 'directbuy',
 'location': 'Leeds',
 'make': 'CITROEN',
 'model': 'C3 AIRCROSS',
 'odometer': 94157,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-19',
 'seller_name': 'Direct Company',
 'title': 'CITROEN C3 AIRCROSS 1.2 PureTech Flair 5dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech Flair 5dr',
 'year': 2019}
2025-12-03 06:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272461241%27 HTTP/1.1" 200 None
2025-12-03 06:04:21 [manheim.gb] INFO: Saving data for 2461241: {'auction_closing_time': 1764838800.0, 'created_time': 1764583885.740944, 'last_price_update_time': 1764741861.45497}
2025-12-03 06:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2461241') HTTP/1.1" 204 0
2025-12-03 06:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0002528107-01990507-001.pdf> (referer: None)
2025-12-03 06:04:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:04:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:04:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:04:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f65f36d0>
2025-12-03 06:04:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:04:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:04:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e302b2a1-cc53-52af-ac82-65ce87c63923/e302b2a1-cc53-52af-ac82-65ce87c63923_expert_report_file_572bf41f-d079-4ff1-8d96-bc04db0d4ff0.pdf HTTP/1.1" 201 0
2025-12-03 06:04:21 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item e302b2a1-cc53-52af-ac82-65ce87c63923
2025-12-03 06:04:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e302b2a1-cc53-52af-ac82-65ce87c63923, skipping ID generation
2025-12-03 06:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item e302b2a1-cc53-52af-ac82-65ce87c63923
2025-12-03 06:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F75e3ecc8-bab8-4394-b07b-d494106564cb_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/75e3ecc8-bab8-4394-b07b-d494106564cb_ext_7.jpg not downloaded yet
2025-12-03 06:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F75e3ecc8-bab8-4394-b07b-d494106564cb_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/75e3ecc8-bab8-4394-b07b-d494106564cb_ext_7.jpg not downloaded yet
2025-12-03 06:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F75e3ecc8-bab8-4394-b07b-d494106564cb_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/75e3ecc8-bab8-4394-b07b-d494106564cb_ext_6.jpg not downloaded yet
2025-12-03 06:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F75e3ecc8-bab8-4394-b07b-d494106564cb_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/75e3ecc8-bab8-4394-b07b-d494106564cb_ext_1.jpg not downloaded yet
2025-12-03 06:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F75e3ecc8-bab8-4394-b07b-d494106564cb_5.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/75e3ecc8-bab8-4394-b07b-d494106564cb_5.jpg not downloaded yet
2025-12-03 06:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F75e3ecc8-bab8-4394-b07b-d494106564cb_4.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/75e3ecc8-bab8-4394-b07b-d494106564cb_4.jpg not downloaded yet
2025-12-03 06:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F75e3ecc8-bab8-4394-b07b-d494106564cb_11.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/75e3ecc8-bab8-4394-b07b-d494106564cb_11.jpg not downloaded yet
2025-12-03 06:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F75e3ecc8-bab8-4394-b07b-d494106564cb_10.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/75e3ecc8-bab8-4394-b07b-d494106564cb_10.jpg not downloaded yet
2025-12-03 06:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F75e3ecc8-bab8-4394-b07b-d494106564cb_9.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/75e3ecc8-bab8-4394-b07b-d494106564cb_9.jpg not downloaded yet
2025-12-03 06:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F75e3ecc8-bab8-4394-b07b-d494106564cb_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/75e3ecc8-bab8-4394-b07b-d494106564cb_ext_2.jpg not downloaded yet
2025-12-03 06:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F75e3ecc8-bab8-4394-b07b-d494106564cb_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/75e3ecc8-bab8-4394-b07b-d494106564cb_ext_5.jpg not downloaded yet
2025-12-03 06:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F75e3ecc8-bab8-4394-b07b-d494106564cb_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/75e3ecc8-bab8-4394-b07b-d494106564cb_ext_3.jpg not downloaded yet
2025-12-03 06:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F75e3ecc8-bab8-4394-b07b-d494106564cb_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/75e3ecc8-bab8-4394-b07b-d494106564cb_ext_4.jpg not downloaded yet
2025-12-03 06:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2528107-4005304-13.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2528107-4005304-13.jpg not downloaded yet
2025-12-03 06:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2528107-4005304-1000.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2528107-4005304-1000.jpg not downloaded yet
2025-12-03 06:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2528107-4005304-1001.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2528107-4005304-1001.jpg not downloaded yet
2025-12-03 06:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2528107-4005304-1002.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2528107-4005304-1002.jpg not downloaded yet
2025-12-03 06:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2528107-4005304-1003.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2528107-4005304-1003.jpg not downloaded yet
2025-12-03 06:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2528107-4005304-1004.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2528107-4005304-1004.jpg not downloaded yet
2025-12-03 06:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2528107-4005304-1005.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2528107-4005304-1005.jpg not downloaded yet
2025-12-03 06:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/PEUGEOT/2008?id=2443996&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232443996&indx=134> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:04:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:04:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3750b417-7b9c-51e9-87ea-df95ec29d7ad with identifier: 2443996
2025-12-03 06:04:29 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 3750b417-7b9c-51e9-87ea-df95ec29d7ad
2025-12-03 06:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2528107-4005304-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002528107-01990507-001.pdf)
2025-12-03 06:04:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:04:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f63b3810>
2025-12-03 06:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:04:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e302b2a1-cc53-52af-ac82-65ce87c63923/e302b2a1-cc53-52af-ac82-65ce87c63923_image_19.jpg HTTP/1.1" 201 0
2025-12-03 06:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2528107-4005304-1005.jpg') HTTP/1.1" 204 0
2025-12-03 06:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2528107-4005304-1005.jpg saved to cache
2025-12-03 06:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item e302b2a1-cc53-52af-ac82-65ce87c63923
2025-12-03 06:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0002443996-01989868-001.pdf> (referer: None)
2025-12-03 06:04:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:04:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:04:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:04:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6563fd0>
2025-12-03 06:04:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:04:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 06:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:04:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3750b417-7b9c-51e9-87ea-df95ec29d7ad/3750b417-7b9c-51e9-87ea-df95ec29d7ad_expert_report_file_1eaf7a90-7eea-49fb-8b76-5799e624daa5.pdf HTTP/1.1" 201 0
2025-12-03 06:04:30 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 3750b417-7b9c-51e9-87ea-df95ec29d7ad
2025-12-03 06:04:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3750b417-7b9c-51e9-87ea-df95ec29d7ad, skipping ID generation
2025-12-03 06:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 3750b417-7b9c-51e9-87ea-df95ec29d7ad
2025-12-03 06:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F97becf20-be6c-4dfa-9d87-0fc62e564808_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/97becf20-be6c-4dfa-9d87-0fc62e564808_ext_7.jpg not downloaded yet
2025-12-03 06:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F97becf20-be6c-4dfa-9d87-0fc62e564808_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/97becf20-be6c-4dfa-9d87-0fc62e564808_ext_7.jpg not downloaded yet
2025-12-03 06:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2528107-4005304-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002528107-01990507-001.pdf)
2025-12-03 06:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F97becf20-be6c-4dfa-9d87-0fc62e564808_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/97becf20-be6c-4dfa-9d87-0fc62e564808_ext_6.jpg not downloaded yet
2025-12-03 06:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F97becf20-be6c-4dfa-9d87-0fc62e564808_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/97becf20-be6c-4dfa-9d87-0fc62e564808_ext_1.jpg not downloaded yet
2025-12-03 06:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F97becf20-be6c-4dfa-9d87-0fc62e564808_5.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/97becf20-be6c-4dfa-9d87-0fc62e564808_5.jpg not downloaded yet
2025-12-03 06:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F97becf20-be6c-4dfa-9d87-0fc62e564808_4.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/97becf20-be6c-4dfa-9d87-0fc62e564808_4.jpg not downloaded yet
2025-12-03 06:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F97becf20-be6c-4dfa-9d87-0fc62e564808_11.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/97becf20-be6c-4dfa-9d87-0fc62e564808_11.jpg not downloaded yet
2025-12-03 06:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F97becf20-be6c-4dfa-9d87-0fc62e564808_10.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/97becf20-be6c-4dfa-9d87-0fc62e564808_10.jpg not downloaded yet
2025-12-03 06:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F97becf20-be6c-4dfa-9d87-0fc62e564808_9.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/97becf20-be6c-4dfa-9d87-0fc62e564808_9.jpg not downloaded yet
2025-12-03 06:04:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:04:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:04:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:04:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f62a4d10>
2025-12-03 06:04:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:04:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e302b2a1-cc53-52af-ac82-65ce87c63923/e302b2a1-cc53-52af-ac82-65ce87c63923_image_18.jpg HTTP/1.1" 201 0
2025-12-03 06:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2528107-4005304-1004.jpg') HTTP/1.1" 204 0
2025-12-03 06:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2528107-4005304-1004.jpg saved to cache
2025-12-03 06:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item e302b2a1-cc53-52af-ac82-65ce87c63923
2025-12-03 06:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F97becf20-be6c-4dfa-9d87-0fc62e564808_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/97becf20-be6c-4dfa-9d87-0fc62e564808_ext_2.jpg not downloaded yet
2025-12-03 06:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F97becf20-be6c-4dfa-9d87-0fc62e564808_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/97becf20-be6c-4dfa-9d87-0fc62e564808_ext_5.jpg not downloaded yet
2025-12-03 06:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/97becf20-be6c-4dfa-9d87-0fc62e564808_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002443996-01989868-001.pdf)
2025-12-03 06:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F97becf20-be6c-4dfa-9d87-0fc62e564808_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/97becf20-be6c-4dfa-9d87-0fc62e564808_ext_3.jpg not downloaded yet
2025-12-03 06:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F97becf20-be6c-4dfa-9d87-0fc62e564808_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/97becf20-be6c-4dfa-9d87-0fc62e564808_ext_4.jpg not downloaded yet
2025-12-03 06:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2443996-4005360-13.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2443996-4005360-13.jpg not downloaded yet
2025-12-03 06:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2443996-4005360-1000.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2443996-4005360-1000.jpg not downloaded yet
2025-12-03 06:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2443996-4005360-1001.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2443996-4005360-1001.jpg not downloaded yet
2025-12-03 06:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2443996-4005360-1002.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2443996-4005360-1002.jpg not downloaded yet
2025-12-03 06:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2443996-4005360-1003.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2443996-4005360-1003.jpg not downloaded yet
2025-12-03 06:04:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:04:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f63214d0>
2025-12-03 06:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:04:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3750b417-7b9c-51e9-87ea-df95ec29d7ad/3750b417-7b9c-51e9-87ea-df95ec29d7ad_image_1.jpg HTTP/1.1" 201 0
2025-12-03 06:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F97becf20-be6c-4dfa-9d87-0fc62e564808_ext_7.jpg') HTTP/1.1" 204 0
2025-12-03 06:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/97becf20-be6c-4dfa-9d87-0fc62e564808_ext_7.jpg saved to cache
2025-12-03 06:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3750b417-7b9c-51e9-87ea-df95ec29d7ad
2025-12-03 06:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2443996-4005360-1004.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2443996-4005360-1004.jpg not downloaded yet
2025-12-03 06:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2443996-4005360-1005.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2443996-4005360-1005.jpg not downloaded yet
2025-12-03 06:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/97becf20-be6c-4dfa-9d87-0fc62e564808_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002443996-01989868-001.pdf)
2025-12-03 06:04:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:04:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f61b4710>
2025-12-03 06:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:04:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3750b417-7b9c-51e9-87ea-df95ec29d7ad/3750b417-7b9c-51e9-87ea-df95ec29d7ad_image_10.jpg HTTP/1.1" 201 0
2025-12-03 06:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F97becf20-be6c-4dfa-9d87-0fc62e564808_ext_5.jpg') HTTP/1.1" 204 0
2025-12-03 06:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/97becf20-be6c-4dfa-9d87-0fc62e564808_ext_5.jpg saved to cache
2025-12-03 06:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 3750b417-7b9c-51e9-87ea-df95ec29d7ad
2025-12-03 06:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2443996-4005360-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002443996-01989868-001.pdf)
2025-12-03 06:04:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:04:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f659ce10>
2025-12-03 06:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:04:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 06:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3750b417-7b9c-51e9-87ea-df95ec29d7ad/3750b417-7b9c-51e9-87ea-df95ec29d7ad_image_19.jpg HTTP/1.1" 201 0
2025-12-03 06:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2443996-4005360-1005.jpg') HTTP/1.1" 204 0
2025-12-03 06:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2443996-4005360-1005.jpg saved to cache
2025-12-03 06:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 3750b417-7b9c-51e9-87ea-df95ec29d7ad
2025-12-03 06:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2443996-4005360-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002443996-01989868-001.pdf)
2025-12-03 06:04:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:04:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f600ff90>
2025-12-03 06:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:04:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 06:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3750b417-7b9c-51e9-87ea-df95ec29d7ad/3750b417-7b9c-51e9-87ea-df95ec29d7ad_image_18.jpg HTTP/1.1" 201 0
2025-12-03 06:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2443996-4005360-1004.jpg') HTTP/1.1" 204 0
2025-12-03 06:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2443996-4005360-1004.jpg saved to cache
2025-12-03 06:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 3750b417-7b9c-51e9-87ea-df95ec29d7ad
2025-12-03 06:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2443996-4005360-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002443996-01989868-001.pdf)
2025-12-03 06:04:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:04:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f5bc23d0>
2025-12-03 06:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:04:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3750b417-7b9c-51e9-87ea-df95ec29d7ad/3750b417-7b9c-51e9-87ea-df95ec29d7ad_image_17.jpg HTTP/1.1" 201 0
2025-12-03 06:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2443996-4005360-1003.jpg') HTTP/1.1" 204 0
2025-12-03 06:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2443996-4005360-1003.jpg saved to cache
2025-12-03 06:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 3750b417-7b9c-51e9-87ea-df95ec29d7ad
2025-12-03 06:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2443996-4005360-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002443996-01989868-001.pdf)
2025-12-03 06:04:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:04:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f600c1d0>
2025-12-03 06:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:04:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3750b417-7b9c-51e9-87ea-df95ec29d7ad/3750b417-7b9c-51e9-87ea-df95ec29d7ad_image_16.jpg HTTP/1.1" 201 0
2025-12-03 06:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2443996-4005360-1002.jpg') HTTP/1.1" 204 0
2025-12-03 06:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2443996-4005360-1002.jpg saved to cache
2025-12-03 06:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 3750b417-7b9c-51e9-87ea-df95ec29d7ad
2025-12-03 06:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2443996-4005360-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002443996-01989868-001.pdf)
2025-12-03 06:04:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:04:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f630f390>
2025-12-03 06:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:04:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3750b417-7b9c-51e9-87ea-df95ec29d7ad/3750b417-7b9c-51e9-87ea-df95ec29d7ad_image_15.jpg HTTP/1.1" 201 0
2025-12-03 06:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2443996-4005360-1001.jpg') HTTP/1.1" 204 0
2025-12-03 06:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2443996-4005360-1001.jpg saved to cache
2025-12-03 06:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 3750b417-7b9c-51e9-87ea-df95ec29d7ad
2025-12-03 06:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2443996-4005360-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002443996-01989868-001.pdf)
2025-12-03 06:04:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:04:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f5bc2990>
2025-12-03 06:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:04:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3750b417-7b9c-51e9-87ea-df95ec29d7ad/3750b417-7b9c-51e9-87ea-df95ec29d7ad_image_14.jpg HTTP/1.1" 201 0
2025-12-03 06:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2443996-4005360-1000.jpg') HTTP/1.1" 204 0
2025-12-03 06:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2443996-4005360-1000.jpg saved to cache
2025-12-03 06:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 3750b417-7b9c-51e9-87ea-df95ec29d7ad
2025-12-03 06:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2443996-4005360-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002443996-01989868-001.pdf)
2025-12-03 06:04:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:04:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f64d38d0>
2025-12-03 06:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:04:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3750b417-7b9c-51e9-87ea-df95ec29d7ad/3750b417-7b9c-51e9-87ea-df95ec29d7ad_image_13.jpg HTTP/1.1" 201 0
2025-12-03 06:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2443996-4005360-13.jpg') HTTP/1.1" 204 0
2025-12-03 06:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2443996-4005360-13.jpg saved to cache
2025-12-03 06:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 3750b417-7b9c-51e9-87ea-df95ec29d7ad
2025-12-03 06:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/97becf20-be6c-4dfa-9d87-0fc62e564808_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002443996-01989868-001.pdf)
2025-12-03 06:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/BMW/5SERIES?id=2458076&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232458076&indx=137> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:04:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:04:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:04:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f64ce310>
2025-12-03 06:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:04:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 06:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3750b417-7b9c-51e9-87ea-df95ec29d7ad/3750b417-7b9c-51e9-87ea-df95ec29d7ad_image_12.jpg HTTP/1.1" 201 0
2025-12-03 06:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F97becf20-be6c-4dfa-9d87-0fc62e564808_ext_4.jpg') HTTP/1.1" 204 0
2025-12-03 06:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/97becf20-be6c-4dfa-9d87-0fc62e564808_ext_4.jpg saved to cache
2025-12-03 06:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 3750b417-7b9c-51e9-87ea-df95ec29d7ad
2025-12-03 06:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/NISSAN/JUKE?id=2441700&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232441700&indx=132> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:04:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/97becf20-be6c-4dfa-9d87-0fc62e564808_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002443996-01989868-001.pdf)
2025-12-03 06:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/97becf20-be6c-4dfa-9d87-0fc62e564808_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002443996-01989868-001.pdf)
2025-12-03 06:04:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 853ebe17-c341-5988-b967-28d3a04dc876 with identifier: 2458076
2025-12-03 06:04:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 853ebe17-c341-5988-b967-28d3a04dc876 with scrape type 2
2025-12-03 06:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 853ebe17-c341-5988-b967-28d3a04dc876 with scrape type 2
2025-12-03 06:04:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 853ebe17-c341-5988-b967-28d3a04dc876, identifier: 2458076
2025-12-03 06:04:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 853ebe17-c341-5988-b967-28d3a04dc876 with identifier: 2458076
2025-12-03 06:04:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 853ebe17-c341-5988-b967-28d3a04dc876 with identifier: 2458076
2025-12-03 06:04:35 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 853ebe17-c341-5988-b967-28d3a04dc876 with identifier: 2458076 to the API
2025-12-03 06:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 06:04:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-03 06:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27853ebe17-c341-5988-b967-28d3a04dc876%27 HTTP/1.1" 200 None
2025-12-03 06:04:36 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id 853ebe17-c341-5988-b967-28d3a04dc876: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 03 Dec 2025 06:04:34 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-03 06:04:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/BMW/5SERIES?id=2458076&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232458076&indx=137>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002458076-01982934-002.pdf',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': '2025-12-03T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '853ebe17-c341-5988-b967-28d3a04dc876',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'GY18TYS',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/BMW/5%20SERIES?id=2458076',
 'listing': 'auction',
 'location': 'Leeds',
 'make': 'BMW',
 'model': '5 SERIES',
 'odometer': 48514,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-10',
 'seller_name': 'Lookers',
 'title': 'BMW 5 SERIES 520i M Sport 4dr Auto',
 'transmission': 'automatic',
 'trim': '520i M Sport 4dr Auto',
 'year': 2018}
2025-12-03 06:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272458076%27 HTTP/1.1" 200 None
2025-12-03 06:04:36 [manheim.gb] INFO: Saving data for 2458076: {'auction_closing_time': 1764752400.0, 'created_time': 1764583416.795653, 'last_price_update_time': 1764741876.07563}
2025-12-03 06:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2458076') HTTP/1.1" 204 0
2025-12-03 06:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/97becf20-be6c-4dfa-9d87-0fc62e564808_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002443996-01989868-001.pdf)
2025-12-03 06:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/97becf20-be6c-4dfa-9d87-0fc62e564808_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002443996-01989868-001.pdf)
2025-12-03 06:04:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3855310-bf31-537a-bc31-2354c37ef89a with identifier: 2441700
2025-12-03 06:04:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3855310-bf31-537a-bc31-2354c37ef89a with scrape type 2
2025-12-03 06:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3855310-bf31-537a-bc31-2354c37ef89a with scrape type 2
2025-12-03 06:04:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: e3855310-bf31-537a-bc31-2354c37ef89a, identifier: 2441700
2025-12-03 06:04:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:04:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:04:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:04:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f62a7e50>
2025-12-03 06:04:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:04:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 06:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:04:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3750b417-7b9c-51e9-87ea-df95ec29d7ad/3750b417-7b9c-51e9-87ea-df95ec29d7ad_image_11.jpg HTTP/1.1" 201 0
2025-12-03 06:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F97becf20-be6c-4dfa-9d87-0fc62e564808_ext_3.jpg') HTTP/1.1" 204 0
2025-12-03 06:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/97becf20-be6c-4dfa-9d87-0fc62e564808_ext_3.jpg saved to cache
2025-12-03 06:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 3750b417-7b9c-51e9-87ea-df95ec29d7ad
2025-12-03 06:04:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:04:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:04:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:04:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6329f90>
2025-12-03 06:04:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:04:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:04:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3750b417-7b9c-51e9-87ea-df95ec29d7ad/3750b417-7b9c-51e9-87ea-df95ec29d7ad_image_9.jpg HTTP/1.1" 201 0
2025-12-03 06:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F97becf20-be6c-4dfa-9d87-0fc62e564808_ext_2.jpg') HTTP/1.1" 204 0
2025-12-03 06:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/97becf20-be6c-4dfa-9d87-0fc62e564808_ext_2.jpg saved to cache
2025-12-03 06:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3750b417-7b9c-51e9-87ea-df95ec29d7ad
2025-12-03 06:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/97becf20-be6c-4dfa-9d87-0fc62e564808_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002443996-01989868-001.pdf)
2025-12-03 06:04:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: e3855310-bf31-537a-bc31-2354c37ef89a with identifier: 2441700
2025-12-03 06:04:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: e3855310-bf31-537a-bc31-2354c37ef89a with identifier: 2441700
2025-12-03 06:04:36 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: e3855310-bf31-537a-bc31-2354c37ef89a with identifier: 2441700 to the API
2025-12-03 06:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 06:04:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 06:04:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/NISSAN/JUKE?id=2441700&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232441700&indx=132>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002441700-01986898-003.pdf',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.5L',
 'expiration_date': '2025-12-03T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'e3855310-bf31-537a-bc31-2354c37ef89a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'ML67ZPU',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/NISSAN/JUKE?id=2441700',
 'listing': 'auction',
 'location': 'Birmingham',
 'make': 'NISSAN',
 'model': 'JUKE',
 'odometer': 69391,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-23',
 'seller_name': 'Available Car',
 'title': 'NISSAN JUKE 1.5 dCi Tekna 5dr',
 'transmission': 'manual',
 'trim': '1.5 dCi Tekna 5dr',
 'year': 2017}
2025-12-03 06:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272441700%27 HTTP/1.1" 200 None
2025-12-03 06:04:37 [manheim.gb] INFO: Saving data for 2441700: {'auction_closing_time': 1764752400.0, 'created_time': 1764583890.025051, 'last_price_update_time': 1764741877.194007}
2025-12-03 06:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2441700') HTTP/1.1" 204 0
2025-12-03 06:04:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:04:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:04:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:04:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f64d0490>
2025-12-03 06:04:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:04:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:04:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3750b417-7b9c-51e9-87ea-df95ec29d7ad/3750b417-7b9c-51e9-87ea-df95ec29d7ad_image_6.jpg HTTP/1.1" 201 0
2025-12-03 06:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F97becf20-be6c-4dfa-9d87-0fc62e564808_11.jpg') HTTP/1.1" 204 0
2025-12-03 06:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/97becf20-be6c-4dfa-9d87-0fc62e564808_11.jpg saved to cache
2025-12-03 06:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3750b417-7b9c-51e9-87ea-df95ec29d7ad
2025-12-03 06:04:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:04:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:04:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:04:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f605e490>
2025-12-03 06:04:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:04:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:04:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3750b417-7b9c-51e9-87ea-df95ec29d7ad/3750b417-7b9c-51e9-87ea-df95ec29d7ad_image_7.jpg HTTP/1.1" 201 0
2025-12-03 06:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F97becf20-be6c-4dfa-9d87-0fc62e564808_10.jpg') HTTP/1.1" 204 0
2025-12-03 06:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/97becf20-be6c-4dfa-9d87-0fc62e564808_10.jpg saved to cache
2025-12-03 06:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3750b417-7b9c-51e9-87ea-df95ec29d7ad
2025-12-03 06:04:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:04:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:04:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:04:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f605c390>
2025-12-03 06:04:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:04:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:04:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3750b417-7b9c-51e9-87ea-df95ec29d7ad/3750b417-7b9c-51e9-87ea-df95ec29d7ad_image_8.jpg HTTP/1.1" 201 0
2025-12-03 06:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F97becf20-be6c-4dfa-9d87-0fc62e564808_9.jpg') HTTP/1.1" 204 0
2025-12-03 06:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/97becf20-be6c-4dfa-9d87-0fc62e564808_9.jpg saved to cache
2025-12-03 06:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3750b417-7b9c-51e9-87ea-df95ec29d7ad
2025-12-03 06:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/97becf20-be6c-4dfa-9d87-0fc62e564808_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002443996-01989868-001.pdf)
2025-12-03 06:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/97becf20-be6c-4dfa-9d87-0fc62e564808_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002443996-01989868-001.pdf)
2025-12-03 06:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/97becf20-be6c-4dfa-9d87-0fc62e564808_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002443996-01989868-001.pdf)
2025-12-03 06:04:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:04:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:04:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:04:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f62a6350>
2025-12-03 06:04:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:04:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:04:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3750b417-7b9c-51e9-87ea-df95ec29d7ad/3750b417-7b9c-51e9-87ea-df95ec29d7ad_image_5.jpg HTTP/1.1" 201 0
2025-12-03 06:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F97becf20-be6c-4dfa-9d87-0fc62e564808_4.jpg') HTTP/1.1" 204 0
2025-12-03 06:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/97becf20-be6c-4dfa-9d87-0fc62e564808_4.jpg saved to cache
2025-12-03 06:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3750b417-7b9c-51e9-87ea-df95ec29d7ad
2025-12-03 06:04:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:04:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:04:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:04:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f62d14d0>
2025-12-03 06:04:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:04:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3750b417-7b9c-51e9-87ea-df95ec29d7ad/3750b417-7b9c-51e9-87ea-df95ec29d7ad_image_4.jpg HTTP/1.1" 201 0
2025-12-03 06:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F97becf20-be6c-4dfa-9d87-0fc62e564808_5.jpg') HTTP/1.1" 204 0
2025-12-03 06:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/97becf20-be6c-4dfa-9d87-0fc62e564808_5.jpg saved to cache
2025-12-03 06:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3750b417-7b9c-51e9-87ea-df95ec29d7ad
2025-12-03 06:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/97becf20-be6c-4dfa-9d87-0fc62e564808_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002443996-01989868-001.pdf)
2025-12-03 06:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/97becf20-be6c-4dfa-9d87-0fc62e564808_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002443996-01989868-001.pdf)
2025-12-03 06:04:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:04:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6482910>
2025-12-03 06:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:04:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 06:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3750b417-7b9c-51e9-87ea-df95ec29d7ad/3750b417-7b9c-51e9-87ea-df95ec29d7ad_image_3.jpg HTTP/1.1" 201 0
2025-12-03 06:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F97becf20-be6c-4dfa-9d87-0fc62e564808_ext_1.jpg') HTTP/1.1" 204 0
2025-12-03 06:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/97becf20-be6c-4dfa-9d87-0fc62e564808_ext_1.jpg saved to cache
2025-12-03 06:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3750b417-7b9c-51e9-87ea-df95ec29d7ad
2025-12-03 06:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2528107-4005304-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002528107-01990507-001.pdf)
2025-12-03 06:04:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:04:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6425350>
2025-12-03 06:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:04:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 06:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3750b417-7b9c-51e9-87ea-df95ec29d7ad/3750b417-7b9c-51e9-87ea-df95ec29d7ad_image_0.jpg HTTP/1.1" 201 0
2025-12-03 06:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F97becf20-be6c-4dfa-9d87-0fc62e564808_ext_7.jpg') HTTP/1.1" 204 0
2025-12-03 06:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/97becf20-be6c-4dfa-9d87-0fc62e564808_ext_7.jpg saved to cache
2025-12-03 06:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3750b417-7b9c-51e9-87ea-df95ec29d7ad
2025-12-03 06:04:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:04:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f61e9f50>
2025-12-03 06:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:04:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3750b417-7b9c-51e9-87ea-df95ec29d7ad/3750b417-7b9c-51e9-87ea-df95ec29d7ad_image_2.jpg HTTP/1.1" 201 0
2025-12-03 06:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F97becf20-be6c-4dfa-9d87-0fc62e564808_ext_6.jpg') HTTP/1.1" 204 0
2025-12-03 06:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/97becf20-be6c-4dfa-9d87-0fc62e564808_ext_6.jpg saved to cache
2025-12-03 06:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3750b417-7b9c-51e9-87ea-df95ec29d7ad
2025-12-03 06:04:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3750b417-7b9c-51e9-87ea-df95ec29d7ad, skipping ID generation
2025-12-03 06:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 3750b417-7b9c-51e9-87ea-df95ec29d7ad from tracking dictionaries
2025-12-03 06:04:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3750b417-7b9c-51e9-87ea-df95ec29d7ad sending to next pipeline
2025-12-03 06:04:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 3750b417-7b9c-51e9-87ea-df95ec29d7ad, identifier: 2443996
2025-12-03 06:04:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 3750b417-7b9c-51e9-87ea-df95ec29d7ad with identifier: 2443996
2025-12-03 06:04:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 3750b417-7b9c-51e9-87ea-df95ec29d7ad with identifier: 2443996
2025-12-03 06:04:41 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 11 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    11
2025-12-03 06:04:41 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: 3750b417-7b9c-51e9-87ea-df95ec29d7ad spider: manheim.gb
2025-12-03 06:04:41 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 3750b417-7b9c-51e9-87ea-df95ec29d7ad due to rule: registration_date_old.json, error: 11 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    11
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3750b417-7b9c-51e9-87ea-df95ec29d7ad/3750b417-7b9c-51e9-87ea-df95ec29d7ad_expert_report_file_1eaf7a90-7eea-49fb-8b76-5799e624daa5.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002443996-01989868-001.pdf',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': '2025-12-10T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '3750b417-7b9c-51e9-87ea-df95ec29d7ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'SL14FMU',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/PEUGEOT/2008?id=2443996',
 'listing': 'auction',
 'location': 'Birmingham',
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 81623,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 29,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3750b417-7b9c-51e9-87ea-df95ec29d7ad/3750b417-7b9c-51e9-87ea-df95ec29d7ad_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 202628,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/97becf20-be6c-4dfa-9d87-0fc62e564808_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3750b417-7b9c-51e9-87ea-df95ec29d7ad/3750b417-7b9c-51e9-87ea-df95ec29d7ad_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 202628,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/97becf20-be6c-4dfa-9d87-0fc62e564808_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3750b417-7b9c-51e9-87ea-df95ec29d7ad/3750b417-7b9c-51e9-87ea-df95ec29d7ad_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 244739,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/97becf20-be6c-4dfa-9d87-0fc62e564808_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3750b417-7b9c-51e9-87ea-df95ec29d7ad/3750b417-7b9c-51e9-87ea-df95ec29d7ad_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 235487,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/97becf20-be6c-4dfa-9d87-0fc62e564808_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3750b417-7b9c-51e9-87ea-df95ec29d7ad/3750b417-7b9c-51e9-87ea-df95ec29d7ad_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 189970,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/97becf20-be6c-4dfa-9d87-0fc62e564808_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3750b417-7b9c-51e9-87ea-df95ec29d7ad/3750b417-7b9c-51e9-87ea-df95ec29d7ad_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 197725,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/97becf20-be6c-4dfa-9d87-0fc62e564808_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3750b417-7b9c-51e9-87ea-df95ec29d7ad/3750b417-7b9c-51e9-87ea-df95ec29d7ad_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 181556,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/97becf20-be6c-4dfa-9d87-0fc62e564808_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3750b417-7b9c-51e9-87ea-df95ec29d7ad/3750b417-7b9c-51e9-87ea-df95ec29d7ad_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 194816,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/97becf20-be6c-4dfa-9d87-0fc62e564808_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3750b417-7b9c-51e9-87ea-df95ec29d7ad/3750b417-7b9c-51e9-87ea-df95ec29d7ad_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 198173,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/97becf20-be6c-4dfa-9d87-0fc62e564808_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3750b417-7b9c-51e9-87ea-df95ec29d7ad/3750b417-7b9c-51e9-87ea-df95ec29d7ad_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 215480,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/97becf20-be6c-4dfa-9d87-0fc62e564808_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3750b417-7b9c-51e9-87ea-df95ec29d7ad/3750b417-7b9c-51e9-87ea-df95ec29d7ad_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 187612,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/97becf20-be6c-4dfa-9d87-0fc62e564808_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3750b417-7b9c-51e9-87ea-df95ec29d7ad/3750b417-7b9c-51e9-87ea-df95ec29d7ad_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 228813,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/97becf20-be6c-4dfa-9d87-0fc62e564808_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3750b417-7b9c-51e9-87ea-df95ec29d7ad/3750b417-7b9c-51e9-87ea-df95ec29d7ad_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 244596,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/97becf20-be6c-4dfa-9d87-0fc62e564808_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3750b417-7b9c-51e9-87ea-df95ec29d7ad/3750b417-7b9c-51e9-87ea-df95ec29d7ad_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 398460,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2443996-4005360-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3750b417-7b9c-51e9-87ea-df95ec29d7ad/3750b417-7b9c-51e9-87ea-df95ec29d7ad_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 210450,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2443996-4005360-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3750b417-7b9c-51e9-87ea-df95ec29d7ad/3750b417-7b9c-51e9-87ea-df95ec29d7ad_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 402190,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2443996-4005360-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3750b417-7b9c-51e9-87ea-df95ec29d7ad/3750b417-7b9c-51e9-87ea-df95ec29d7ad_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 191704,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2443996-4005360-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3750b417-7b9c-51e9-87ea-df95ec29d7ad/3750b417-7b9c-51e9-87ea-df95ec29d7ad_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 176446,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2443996-4005360-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3750b417-7b9c-51e9-87ea-df95ec29d7ad/3750b417-7b9c-51e9-87ea-df95ec29d7ad_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 253913,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2443996-4005360-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3750b417-7b9c-51e9-87ea-df95ec29d7ad/3750b417-7b9c-51e9-87ea-df95ec29d7ad_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 152512,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2443996-4005360-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-20',
 'seller_name': 'Hilton Garage Ltd',
 'title': 'PEUGEOT 2008 1.6 e-HDi Allure 5dr',
 'transmission': 'manual',
 'trim': '1.6 e-HDi Allure 5dr',
 'year': 2014}
2025-12-03 06:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272443996%27 HTTP/1.1" 200 None
2025-12-03 06:04:41 [manheim.gb] INFO: Saving data for 2443996: {'created_time': 1764741881.329237, 'last_price_update_time': 1764741881.329249, 'auction_closing_time': 1765357200.0}
2025-12-03 06:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2443996') HTTP/1.1" 204 0
2025-12-03 06:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/CITROEN/C3AIRCROSS?id=2378382&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232378382&indx=125> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2528107-4005304-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002528107-01990507-001.pdf)
2025-12-03 06:04:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2528107-4005304-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002528107-01990507-001.pdf)
2025-12-03 06:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2528107-4005304-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002528107-01990507-001.pdf)
2025-12-03 06:04:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:04:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:04:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:04:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f63ab6d0>
2025-12-03 06:04:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:04:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:04:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e302b2a1-cc53-52af-ac82-65ce87c63923/e302b2a1-cc53-52af-ac82-65ce87c63923_image_17.jpg HTTP/1.1" 201 0
2025-12-03 06:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2528107-4005304-1003.jpg') HTTP/1.1" 204 0
2025-12-03 06:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2528107-4005304-1003.jpg saved to cache
2025-12-03 06:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item e302b2a1-cc53-52af-ac82-65ce87c63923
2025-12-03 06:04:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c3c6dd7-8008-58be-baff-c3ad07223ad0 with identifier: 2378382
2025-12-03 06:04:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c3c6dd7-8008-58be-baff-c3ad07223ad0 with scrape type 2
2025-12-03 06:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c3c6dd7-8008-58be-baff-c3ad07223ad0 with scrape type 2
2025-12-03 06:04:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 2c3c6dd7-8008-58be-baff-c3ad07223ad0, identifier: 2378382
2025-12-03 06:04:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:04:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:04:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:04:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f65bc790>
2025-12-03 06:04:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:04:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 06:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:04:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e302b2a1-cc53-52af-ac82-65ce87c63923/e302b2a1-cc53-52af-ac82-65ce87c63923_image_15.jpg HTTP/1.1" 201 0
2025-12-03 06:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2528107-4005304-1001.jpg') HTTP/1.1" 204 0
2025-12-03 06:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2528107-4005304-1001.jpg saved to cache
2025-12-03 06:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item e302b2a1-cc53-52af-ac82-65ce87c63923
2025-12-03 06:04:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:04:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:04:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:04:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f62dfcd0>
2025-12-03 06:04:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:04:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 06:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:04:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e302b2a1-cc53-52af-ac82-65ce87c63923/e302b2a1-cc53-52af-ac82-65ce87c63923_image_16.jpg HTTP/1.1" 201 0
2025-12-03 06:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2528107-4005304-1002.jpg') HTTP/1.1" 204 0
2025-12-03 06:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2528107-4005304-1002.jpg saved to cache
2025-12-03 06:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item e302b2a1-cc53-52af-ac82-65ce87c63923
2025-12-03 06:04:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:04:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:04:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:04:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6464610>
2025-12-03 06:04:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:04:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 06:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:04:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e302b2a1-cc53-52af-ac82-65ce87c63923/e302b2a1-cc53-52af-ac82-65ce87c63923_image_14.jpg HTTP/1.1" 201 0
2025-12-03 06:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2528107-4005304-1000.jpg') HTTP/1.1" 204 0
2025-12-03 06:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2528107-4005304-1000.jpg saved to cache
2025-12-03 06:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item e302b2a1-cc53-52af-ac82-65ce87c63923
2025-12-03 06:04:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 2c3c6dd7-8008-58be-baff-c3ad07223ad0 with identifier: 2378382
2025-12-03 06:04:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 2c3c6dd7-8008-58be-baff-c3ad07223ad0 with identifier: 2378382
2025-12-03 06:04:42 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 2c3c6dd7-8008-58be-baff-c3ad07223ad0 with identifier: 2378382 to the API
2025-12-03 06:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 06:04:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 06:04:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/CITROEN/C3AIRCROSS?id=2378382&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232378382&indx=125>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002378382-01981089-004.pdf',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': '2025-12-03T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '2c3c6dd7-8008-58be-baff-c3ad07223ad0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'LB19ZWR',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/CITROEN/C3%20AIRCROSS?id=2378382',
 'listing': 'auction',
 'location': 'Washington',
 'make': 'CITROEN',
 'model': 'C3 AIRCROSS',
 'odometer': 38749,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-30',
 'seller_name': 'Lookers',
 'title': 'CITROEN C3 AIRCROSS 1.2 PureTech Flair 5dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech Flair 5dr',
 'year': 2019}
2025-12-03 06:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272378382%27 HTTP/1.1" 200 None
2025-12-03 06:04:43 [manheim.gb] INFO: Saving data for 2378382: {'auction_closing_time': 1764752400.0, 'created_time': 1764583443.741168, 'last_price_update_time': 1764741883.00443}
2025-12-03 06:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2378382') HTTP/1.1" 204 0
2025-12-03 06:04:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2528107-4005304-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002528107-01990507-001.pdf)
2025-12-03 06:04:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/75e3ecc8-bab8-4394-b07b-d494106564cb_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002528107-01990507-001.pdf)
2025-12-03 06:04:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/75e3ecc8-bab8-4394-b07b-d494106564cb_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002528107-01990507-001.pdf)
2025-12-03 06:04:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:04:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:04:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:04:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f630df90>
2025-12-03 06:04:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:04:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:04:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e302b2a1-cc53-52af-ac82-65ce87c63923/e302b2a1-cc53-52af-ac82-65ce87c63923_image_13.jpg HTTP/1.1" 201 0
2025-12-03 06:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2528107-4005304-13.jpg') HTTP/1.1" 204 0
2025-12-03 06:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2528107-4005304-13.jpg saved to cache
2025-12-03 06:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item e302b2a1-cc53-52af-ac82-65ce87c63923
2025-12-03 06:04:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:04:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:04:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:04:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f65ad650>
2025-12-03 06:04:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:04:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:04:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e302b2a1-cc53-52af-ac82-65ce87c63923/e302b2a1-cc53-52af-ac82-65ce87c63923_image_11.jpg HTTP/1.1" 201 0
2025-12-03 06:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F75e3ecc8-bab8-4394-b07b-d494106564cb_ext_3.jpg') HTTP/1.1" 204 0
2025-12-03 06:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/75e3ecc8-bab8-4394-b07b-d494106564cb_ext_3.jpg saved to cache
2025-12-03 06:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item e302b2a1-cc53-52af-ac82-65ce87c63923
2025-12-03 06:04:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:04:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:04:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:04:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6321a10>
2025-12-03 06:04:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:04:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 06:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:04:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e302b2a1-cc53-52af-ac82-65ce87c63923/e302b2a1-cc53-52af-ac82-65ce87c63923_image_12.jpg HTTP/1.1" 201 0
2025-12-03 06:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F75e3ecc8-bab8-4394-b07b-d494106564cb_ext_4.jpg') HTTP/1.1" 204 0
2025-12-03 06:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/75e3ecc8-bab8-4394-b07b-d494106564cb_ext_4.jpg saved to cache
2025-12-03 06:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item e302b2a1-cc53-52af-ac82-65ce87c63923
2025-12-03 06:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/75e3ecc8-bab8-4394-b07b-d494106564cb_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002528107-01990507-001.pdf)
2025-12-03 06:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/75e3ecc8-bab8-4394-b07b-d494106564cb_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002528107-01990507-001.pdf)
2025-12-03 06:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/75e3ecc8-bab8-4394-b07b-d494106564cb_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002528107-01990507-001.pdf)
2025-12-03 06:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/75e3ecc8-bab8-4394-b07b-d494106564cb_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002528107-01990507-001.pdf)
2025-12-03 06:04:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:04:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6466510>
2025-12-03 06:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:04:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e302b2a1-cc53-52af-ac82-65ce87c63923/e302b2a1-cc53-52af-ac82-65ce87c63923_image_8.jpg HTTP/1.1" 201 0
2025-12-03 06:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F75e3ecc8-bab8-4394-b07b-d494106564cb_9.jpg') HTTP/1.1" 204 0
2025-12-03 06:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/75e3ecc8-bab8-4394-b07b-d494106564cb_9.jpg saved to cache
2025-12-03 06:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e302b2a1-cc53-52af-ac82-65ce87c63923
2025-12-03 06:04:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:04:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6374a10>
2025-12-03 06:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:04:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e302b2a1-cc53-52af-ac82-65ce87c63923/e302b2a1-cc53-52af-ac82-65ce87c63923_image_7.jpg HTTP/1.1" 201 0
2025-12-03 06:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F75e3ecc8-bab8-4394-b07b-d494106564cb_10.jpg') HTTP/1.1" 204 0
2025-12-03 06:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/75e3ecc8-bab8-4394-b07b-d494106564cb_10.jpg saved to cache
2025-12-03 06:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e302b2a1-cc53-52af-ac82-65ce87c63923
2025-12-03 06:04:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:04:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f628bdd0>
2025-12-03 06:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:04:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e302b2a1-cc53-52af-ac82-65ce87c63923/e302b2a1-cc53-52af-ac82-65ce87c63923_image_9.jpg HTTP/1.1" 201 0
2025-12-03 06:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F75e3ecc8-bab8-4394-b07b-d494106564cb_ext_2.jpg') HTTP/1.1" 204 0
2025-12-03 06:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/75e3ecc8-bab8-4394-b07b-d494106564cb_ext_2.jpg saved to cache
2025-12-03 06:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e302b2a1-cc53-52af-ac82-65ce87c63923
2025-12-03 06:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/75e3ecc8-bab8-4394-b07b-d494106564cb_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002528107-01990507-001.pdf)
2025-12-03 06:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/75e3ecc8-bab8-4394-b07b-d494106564cb_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002528107-01990507-001.pdf)
2025-12-03 06:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/75e3ecc8-bab8-4394-b07b-d494106564cb_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002528107-01990507-001.pdf)
2025-12-03 06:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/FORD/FIESTA?id=2383831&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232383831&indx=126> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:04:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:04:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6364f50>
2025-12-03 06:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:04:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e302b2a1-cc53-52af-ac82-65ce87c63923/e302b2a1-cc53-52af-ac82-65ce87c63923_image_10.jpg HTTP/1.1" 201 0
2025-12-03 06:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F75e3ecc8-bab8-4394-b07b-d494106564cb_ext_5.jpg') HTTP/1.1" 204 0
2025-12-03 06:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/75e3ecc8-bab8-4394-b07b-d494106564cb_ext_5.jpg saved to cache
2025-12-03 06:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item e302b2a1-cc53-52af-ac82-65ce87c63923
2025-12-03 06:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/75e3ecc8-bab8-4394-b07b-d494106564cb_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002528107-01990507-001.pdf)
2025-12-03 06:04:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:04:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:04:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f645d010>
2025-12-03 06:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:04:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e302b2a1-cc53-52af-ac82-65ce87c63923/e302b2a1-cc53-52af-ac82-65ce87c63923_image_5.jpg HTTP/1.1" 201 0
2025-12-03 06:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F75e3ecc8-bab8-4394-b07b-d494106564cb_4.jpg') HTTP/1.1" 204 0
2025-12-03 06:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/75e3ecc8-bab8-4394-b07b-d494106564cb_4.jpg saved to cache
2025-12-03 06:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e302b2a1-cc53-52af-ac82-65ce87c63923
2025-12-03 06:04:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:04:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6072cd0>
2025-12-03 06:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:04:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e302b2a1-cc53-52af-ac82-65ce87c63923/e302b2a1-cc53-52af-ac82-65ce87c63923_image_6.jpg HTTP/1.1" 201 0
2025-12-03 06:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F75e3ecc8-bab8-4394-b07b-d494106564cb_11.jpg') HTTP/1.1" 204 0
2025-12-03 06:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/75e3ecc8-bab8-4394-b07b-d494106564cb_11.jpg saved to cache
2025-12-03 06:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e302b2a1-cc53-52af-ac82-65ce87c63923
2025-12-03 06:04:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:04:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6229090>
2025-12-03 06:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:04:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e302b2a1-cc53-52af-ac82-65ce87c63923/e302b2a1-cc53-52af-ac82-65ce87c63923_image_4.jpg HTTP/1.1" 201 0
2025-12-03 06:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F75e3ecc8-bab8-4394-b07b-d494106564cb_5.jpg') HTTP/1.1" 204 0
2025-12-03 06:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/75e3ecc8-bab8-4394-b07b-d494106564cb_5.jpg saved to cache
2025-12-03 06:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e302b2a1-cc53-52af-ac82-65ce87c63923
2025-12-03 06:04:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d03c6b00-faf3-55e8-baa0-a5ea066e6b18 with identifier: 2383831
2025-12-03 06:04:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d03c6b00-faf3-55e8-baa0-a5ea066e6b18 with scrape type 2
2025-12-03 06:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d03c6b00-faf3-55e8-baa0-a5ea066e6b18 with scrape type 2
2025-12-03 06:04:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: d03c6b00-faf3-55e8-baa0-a5ea066e6b18, identifier: 2383831
2025-12-03 06:04:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: d03c6b00-faf3-55e8-baa0-a5ea066e6b18 with identifier: 2383831
2025-12-03 06:04:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: d03c6b00-faf3-55e8-baa0-a5ea066e6b18 with identifier: 2383831
2025-12-03 06:04:46 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: d03c6b00-faf3-55e8-baa0-a5ea066e6b18 with identifier: 2383831 to the API
2025-12-03 06:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 06:04:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 06:04:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/FORD/FIESTA?id=2383831&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232383831&indx=126>
{'auction_title': '',
 'c_o_2_emission_value': 97,
 'car_expert_report_source_url': None,
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.0L',
 'expiration_date': '2025-12-03T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'd03c6b00-faf3-55e8-baa0-a5ea066e6b18',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'VN67PYF',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FORD/FIESTA?id=2383831',
 'listing': 'auction',
 'location': 'Plymouth',
 'make': 'FORD',
 'model': 'FIESTA',
 'odometer': 92705,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-09',
 'seller_name': 'Vospers Group',
 'title': 'FORD FIESTA 1.0 EcoBoost Titanium 5dr',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost Titanium 5dr',
 'year': 2018}
2025-12-03 06:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272383831%27 HTTP/1.1" 200 None
2025-12-03 06:04:46 [manheim.gb] INFO: Saving data for 2383831: {'auction_closing_time': 1764752400.0, 'created_time': 1764583891.38004, 'last_price_update_time': 1764741886.721754}
2025-12-03 06:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2383831') HTTP/1.1" 204 0
2025-12-03 06:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/GOLF?id=2359941&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232359941&indx=122> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:04:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/75e3ecc8-bab8-4394-b07b-d494106564cb_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002528107-01990507-001.pdf)
2025-12-03 06:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/75e3ecc8-bab8-4394-b07b-d494106564cb_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002528107-01990507-001.pdf)
2025-12-03 06:04:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:04:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f5bc36d0>
2025-12-03 06:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:04:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 06:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e302b2a1-cc53-52af-ac82-65ce87c63923/e302b2a1-cc53-52af-ac82-65ce87c63923_image_3.jpg HTTP/1.1" 201 0
2025-12-03 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F75e3ecc8-bab8-4394-b07b-d494106564cb_ext_1.jpg') HTTP/1.1" 204 0
2025-12-03 06:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/75e3ecc8-bab8-4394-b07b-d494106564cb_ext_1.jpg saved to cache
2025-12-03 06:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e302b2a1-cc53-52af-ac82-65ce87c63923
2025-12-03 06:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/75e3ecc8-bab8-4394-b07b-d494106564cb_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002528107-01990507-001.pdf)
2025-12-03 06:04:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: efcb4fd5-559b-53e5-9553-625cad8ca741 with identifier: 2359941
2025-12-03 06:04:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efcb4fd5-559b-53e5-9553-625cad8ca741 with scrape type 2
2025-12-03 06:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item efcb4fd5-559b-53e5-9553-625cad8ca741 with scrape type 2
2025-12-03 06:04:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: efcb4fd5-559b-53e5-9553-625cad8ca741, identifier: 2359941
2025-12-03 06:04:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:04:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f600d550>
2025-12-03 06:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:04:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e302b2a1-cc53-52af-ac82-65ce87c63923/e302b2a1-cc53-52af-ac82-65ce87c63923_image_0.jpg HTTP/1.1" 201 0
2025-12-03 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F75e3ecc8-bab8-4394-b07b-d494106564cb_ext_7.jpg') HTTP/1.1" 204 0
2025-12-03 06:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/75e3ecc8-bab8-4394-b07b-d494106564cb_ext_7.jpg saved to cache
2025-12-03 06:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e302b2a1-cc53-52af-ac82-65ce87c63923
2025-12-03 06:04:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:04:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f52d5550>
2025-12-03 06:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:04:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 06:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e302b2a1-cc53-52af-ac82-65ce87c63923/e302b2a1-cc53-52af-ac82-65ce87c63923_image_1.jpg HTTP/1.1" 201 0
2025-12-03 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F75e3ecc8-bab8-4394-b07b-d494106564cb_ext_7.jpg') HTTP/1.1" 204 0
2025-12-03 06:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/75e3ecc8-bab8-4394-b07b-d494106564cb_ext_7.jpg saved to cache
2025-12-03 06:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e302b2a1-cc53-52af-ac82-65ce87c63923
2025-12-03 06:04:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: efcb4fd5-559b-53e5-9553-625cad8ca741 with identifier: 2359941
2025-12-03 06:04:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: efcb4fd5-559b-53e5-9553-625cad8ca741 with identifier: 2359941
2025-12-03 06:04:47 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': False, 'title': 'volkswagen golf 1.6 tdi 105 match 5dr', 'price': 0, 'currency': 'gbp', 'make': 'volkswagen', 'model': 'golf', 'transmission': 'manual', 'engine': '1.6l', 'fuel_type': 'diesel', 'odometer': 171692, 'odometer_reading_unit': 'mi', 'registration_date': '2010-12-30', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/volkswagen/golf?id=2359941', 'location': 'bristol', 'origin_country_code': 'gb', 'trim': '1.6 tdi 105 match 5dr', 'license_plate': 'cy60gcu', 'year': 2010, 'listing': 'auction', 'c_o_2_emission_value': 119, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002359941-01984697-002.pdf', 'expiration_date': '2025-12-04t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': 'efcb4fd5-559b-53e5-9553-625cad8ca741', 'current_year_diff': 15, 'age_in_months': 179, 'make_model': 'volkswagen golf', 'sanitized_make': 'volkswagen', 'odometer_in_km': 276310}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 179,
     'auction_title': '',
     'c_o_2_emission_value': 119,
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002359941-01984697-002.pdf',
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 15,
     'engine': '1.6l',
     'expiration_date': '2025-12-04t09:00:00z',
     'fuel_type': 'diesel',
     'id': 'efcb4fd5-559b-53e5-9553-625cad8ca741',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'cy60gcu',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/volkswagen/golf?id=2359941',
     'listing': 'auction',
     'location': 'bristol',
     'make': 'volkswagen',
     'make_model': 'volkswagen golf',
     'model': 'golf',
     'odometer': 171692,
     'odometer_in_km': 276310,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2010-12-30',
     'sanitized_make': 'volkswagen',
     'seller_name': None,
     'title': 'volkswagen golf 1.6 tdi 105 match 5dr',
     'transmission': 'manual',
     'trim': '1.6 tdi 105 match 5dr',
     'year': 2010}
2025-12-03 06:04:47 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: efcb4fd5-559b-53e5-9553-625cad8ca741 spider: manheim.gb
2025-12-03 06:04:47 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: efcb4fd5-559b-53e5-9553-625cad8ca741 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': False, 'title': 'volkswagen golf 1.6 tdi 105 match 5dr', 'price': 0, 'currency': 'gbp', 'make': 'volkswagen', 'model': 'golf', 'transmission': 'manual', 'engine': '1.6l', 'fuel_type': 'diesel', 'odometer': 171692, 'odometer_reading_unit': 'mi', 'registration_date': '2010-12-30', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/volkswagen/golf?id=2359941', 'location': 'bristol', 'origin_country_code': 'gb', 'trim': '1.6 tdi 105 match 5dr', 'license_plate': 'cy60gcu', 'year': 2010, 'listing': 'auction', 'c_o_2_emission_value': 119, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002359941-01984697-002.pdf', 'expiration_date': '2025-12-04t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': 'efcb4fd5-559b-53e5-9553-625cad8ca741', 'current_year_diff': 15, 'age_in_months': 179, 'make_model': 'volkswagen golf', 'sanitized_make': 'volkswagen', 'odometer_in_km': 276310}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 179,
     'auction_title': '',
     'c_o_2_emission_value': 119,
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002359941-01984697-002.pdf',
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 15,
     'engine': '1.6l',
     'expiration_date': '2025-12-04t09:00:00z',
     'fuel_type': 'diesel',
     'id': 'efcb4fd5-559b-53e5-9553-625cad8ca741',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'cy60gcu',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/volkswagen/golf?id=2359941',
     'listing': 'auction',
     'location': 'bristol',
     'make': 'volkswagen',
     'make_model': 'volkswagen golf',
     'model': 'golf',
     'odometer': 171692,
     'odometer_in_km': 276310,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2010-12-30',
     'sanitized_make': 'volkswagen',
     'seller_name': None,
     'title': 'volkswagen golf 1.6 tdi 105 match 5dr',
     'transmission': 'manual',
     'trim': '1.6 tdi 105 match 5dr',
     'year': 2010}
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002359941-01984697-002.pdf',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'efcb4fd5-559b-53e5-9553-625cad8ca741',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'CY60GCU',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/GOLF?id=2359941',
 'listing': 'auction',
 'location': 'Bristol',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF',
 'odometer': 171692,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-12-30',
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF 1.6 TDi 105 Match 5dr',
 'transmission': 'manual',
 'trim': '1.6 TDi 105 Match 5dr',
 'year': 2010}
2025-12-03 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272359941%27 HTTP/1.1" 200 None
2025-12-03 06:04:47 [manheim.gb] INFO: Saving data for 2359941: {'auction_closing_time': 1764838800.0, 'created_time': 1764583915.833332, 'last_price_update_time': 1764741887.887534}
2025-12-03 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2359941') HTTP/1.1" 204 0
2025-12-03 06:04:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:04:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f63b3350>
2025-12-03 06:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:04:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e302b2a1-cc53-52af-ac82-65ce87c63923/e302b2a1-cc53-52af-ac82-65ce87c63923_image_2.jpg HTTP/1.1" 201 0
2025-12-03 06:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F75e3ecc8-bab8-4394-b07b-d494106564cb_ext_6.jpg') HTTP/1.1" 204 0
2025-12-03 06:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/75e3ecc8-bab8-4394-b07b-d494106564cb_ext_6.jpg saved to cache
2025-12-03 06:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e302b2a1-cc53-52af-ac82-65ce87c63923
2025-12-03 06:04:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e302b2a1-cc53-52af-ac82-65ce87c63923, skipping ID generation
2025-12-03 06:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e302b2a1-cc53-52af-ac82-65ce87c63923 from tracking dictionaries
2025-12-03 06:04:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e302b2a1-cc53-52af-ac82-65ce87c63923 sending to next pipeline
2025-12-03 06:04:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: e302b2a1-cc53-52af-ac82-65ce87c63923, identifier: 2528107
2025-12-03 06:04:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: e302b2a1-cc53-52af-ac82-65ce87c63923 with identifier: 2528107
2025-12-03 06:04:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: e302b2a1-cc53-52af-ac82-65ce87c63923 with identifier: 2528107
2025-12-03 06:04:48 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: e302b2a1-cc53-52af-ac82-65ce87c63923 with identifier: 2528107 to the API
2025-12-03 06:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 06:04:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 06:04:48 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/75e3ecc8-bab8-4394-b07b-d494106564cb_ext_6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e302b2a1-cc53-52af-ac82-65ce87c63923/e302b2a1-cc53-52af-ac82-65ce87c63923_expert_report_file_572bf41f-d079-4ff1-8d96-bc04db0d4ff0.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002528107-01990507-001.pdf',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'e302b2a1-cc53-52af-ac82-65ce87c63923',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'LR67ZRE',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/POLO?id=2528107',
 'listing': 'auction',
 'location': 'Northampton',
 'make': 'VOLKSWAGEN',
 'model': 'POLO',
 'odometer': 50631,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e302b2a1-cc53-52af-ac82-65ce87c63923/e302b2a1-cc53-52af-ac82-65ce87c63923_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 202220,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/75e3ecc8-bab8-4394-b07b-d494106564cb_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e302b2a1-cc53-52af-ac82-65ce87c63923/e302b2a1-cc53-52af-ac82-65ce87c63923_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 202220,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/75e3ecc8-bab8-4394-b07b-d494106564cb_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e302b2a1-cc53-52af-ac82-65ce87c63923/e302b2a1-cc53-52af-ac82-65ce87c63923_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 289160,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/75e3ecc8-bab8-4394-b07b-d494106564cb_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e302b2a1-cc53-52af-ac82-65ce87c63923/e302b2a1-cc53-52af-ac82-65ce87c63923_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 272440,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/75e3ecc8-bab8-4394-b07b-d494106564cb_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e302b2a1-cc53-52af-ac82-65ce87c63923/e302b2a1-cc53-52af-ac82-65ce87c63923_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 201601,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/75e3ecc8-bab8-4394-b07b-d494106564cb_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e302b2a1-cc53-52af-ac82-65ce87c63923/e302b2a1-cc53-52af-ac82-65ce87c63923_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 195291,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/75e3ecc8-bab8-4394-b07b-d494106564cb_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e302b2a1-cc53-52af-ac82-65ce87c63923/e302b2a1-cc53-52af-ac82-65ce87c63923_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 186416,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/75e3ecc8-bab8-4394-b07b-d494106564cb_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e302b2a1-cc53-52af-ac82-65ce87c63923/e302b2a1-cc53-52af-ac82-65ce87c63923_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 202229,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/75e3ecc8-bab8-4394-b07b-d494106564cb_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e302b2a1-cc53-52af-ac82-65ce87c63923/e302b2a1-cc53-52af-ac82-65ce87c63923_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 199929,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/75e3ecc8-bab8-4394-b07b-d494106564cb_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e302b2a1-cc53-52af-ac82-65ce87c63923/e302b2a1-cc53-52af-ac82-65ce87c63923_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 265123,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/75e3ecc8-bab8-4394-b07b-d494106564cb_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e302b2a1-cc53-52af-ac82-65ce87c63923/e302b2a1-cc53-52af-ac82-65ce87c63923_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 201772,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/75e3ecc8-bab8-4394-b07b-d494106564cb_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e302b2a1-cc53-52af-ac82-65ce87c63923/e302b2a1-cc53-52af-ac82-65ce87c63923_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 246578,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/75e3ecc8-bab8-4394-b07b-d494106564cb_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e302b2a1-cc53-52af-ac82-65ce87c63923/e302b2a1-cc53-52af-ac82-65ce87c63923_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 222019,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/75e3ecc8-bab8-4394-b07b-d494106564cb_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e302b2a1-cc53-52af-ac82-65ce87c63923/e302b2a1-cc53-52af-ac82-65ce87c63923_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 218658,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2528107-4005304-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e302b2a1-cc53-52af-ac82-65ce87c63923/e302b2a1-cc53-52af-ac82-65ce87c63923_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 238273,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2528107-4005304-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e302b2a1-cc53-52af-ac82-65ce87c63923/e302b2a1-cc53-52af-ac82-65ce87c63923_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 139727,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2528107-4005304-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e302b2a1-cc53-52af-ac82-65ce87c63923/e302b2a1-cc53-52af-ac82-65ce87c63923_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 223984,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2528107-4005304-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e302b2a1-cc53-52af-ac82-65ce87c63923/e302b2a1-cc53-52af-ac82-65ce87c63923_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 266096,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2528107-4005304-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e302b2a1-cc53-52af-ac82-65ce87c63923/e302b2a1-cc53-52af-ac82-65ce87c63923_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 134857,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2528107-4005304-1004.jpg',
             'Width': 749},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e302b2a1-cc53-52af-ac82-65ce87c63923/e302b2a1-cc53-52af-ac82-65ce87c63923_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 191719,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2528107-4005304-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-29',
 'seller_name': 'Sytner',
 'title': 'VOLKSWAGEN POLO 1.2 TSI Match Edition 5dr',
 'transmission': 'manual',
 'trim': '1.2 TSI Match Edition 5dr',
 'year': 2017}
2025-12-03 06:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272528107%27 HTTP/1.1" 200 None
2025-12-03 06:04:48 [manheim.gb] INFO: Saving data for 2528107: {'created_time': 1764741888.723336, 'last_price_update_time': 1764741888.72335, 'auction_closing_time': 1765270800.0}
2025-12-03 06:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2528107') HTTP/1.1" 204 0
2025-12-03 06:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/RENAULT/CLIO?id=2374569&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232374569&indx=124> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:04:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:04:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d855954-126f-5aff-95e9-38f24feb23e8 with identifier: 2374569
2025-12-03 06:04:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d855954-126f-5aff-95e9-38f24feb23e8 with scrape type 2
2025-12-03 06:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d855954-126f-5aff-95e9-38f24feb23e8 with scrape type 2
2025-12-03 06:04:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 0d855954-126f-5aff-95e9-38f24feb23e8, identifier: 2374569
2025-12-03 06:04:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 0d855954-126f-5aff-95e9-38f24feb23e8 with identifier: 2374569
2025-12-03 06:04:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 0d855954-126f-5aff-95e9-38f24feb23e8 with identifier: 2374569
2025-12-03 06:04:49 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 0d855954-126f-5aff-95e9-38f24feb23e8 with identifier: 2374569 to the API
2025-12-03 06:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 06:04:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-03 06:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%270d855954-126f-5aff-95e9-38f24feb23e8%27 HTTP/1.1" 200 None
2025-12-03 06:04:49 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id 0d855954-126f-5aff-95e9-38f24feb23e8: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 03 Dec 2025 06:04:48 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-03 06:04:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/RENAULT/CLIO?id=2374569&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232374569&indx=124>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002374569-01987131-003.pdf',
 'color': 'RED',
 'currency': 'GBP',
 'engine': '0.9L',
 'expiration_date': '2025-12-05T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '0d855954-126f-5aff-95e9-38f24feb23e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'HT19AUF',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/RENAULT/CLIO?id=2374569',
 'listing': 'directbuy',
 'location': 'Washington',
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 69936,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-28',
 'seller_name': 'S G Petch',
 'title': 'RENAULT CLIO 0.9 TCE 90 GT Line 5dr',
 'transmission': 'manual',
 'trim': '0.9 TCE 90 GT Line 5dr',
 'year': 2019}
2025-12-03 06:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272374569%27 HTTP/1.1" 200 None
2025-12-03 06:04:49 [manheim.gb] INFO: Saving data for 2374569: {'auction_closing_time': 1764925200.0, 'created_time': 1764583442.707808, 'last_price_update_time': 1764741889.407849}
2025-12-03 06:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2374569') HTTP/1.1" 204 0
2025-12-03 06:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/NISSAN/LEAF?id=2354571&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232354571&indx=120> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:04:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:04:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5afc30df-5017-5f5a-ac07-6e742dbdcbdd with identifier: 2354571
2025-12-03 06:04:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5afc30df-5017-5f5a-ac07-6e742dbdcbdd with scrape type 2
2025-12-03 06:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5afc30df-5017-5f5a-ac07-6e742dbdcbdd with scrape type 2
2025-12-03 06:04:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 5afc30df-5017-5f5a-ac07-6e742dbdcbdd, identifier: 2354571
2025-12-03 06:04:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 5afc30df-5017-5f5a-ac07-6e742dbdcbdd with identifier: 2354571
2025-12-03 06:04:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 5afc30df-5017-5f5a-ac07-6e742dbdcbdd with identifier: 2354571
2025-12-03 06:04:49 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 0, 'seller_name': 'mobilize financial services', 'price_includes_vat': False, 'title': 'nissan leaf 80kw tekna 30kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'nissan', 'model': 'leaf', 'transmission': 'automatic', 'engine': '0.0l', 'fuel_type': 'electric', 'odometer': 45317, 'odometer_reading_unit': 'mi', 'registration_date': '2017-03-25', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/nissan/leaf?id=2354571', 'location': 'leeds - in transit', 'origin_country_code': 'gb', 'trim': '80kw tekna 30kwh 5dr auto', 'license_plate': 'gu17vjo', 'year': 2017, 'listing': 'auction', 'c_o_2_emission_value': 0, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002354571-01988705-001.pdf', 'expiration_date': '2025-12-08t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': '5afc30df-5017-5f5a-ac07-6e742dbdcbdd', 'current_year_diff': 8, 'age_in_months': 104, 'make_model': 'nissan leaf', 'sanitized_make': 'nissan', 'odometer_in_km': 72930} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 104,
     'auction_title': '',
     'c_o_2_emission_value': 0,
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002354571-01988705-001.pdf',
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 8,
     'engine': '0.0l',
     'expiration_date': '2025-12-08t09:00:00z',
     'fuel_type': 'electric',
     'id': '5afc30df-5017-5f5a-ac07-6e742dbdcbdd',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'gu17vjo',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/nissan/leaf?id=2354571',
     'listing': 'auction',
     'location': 'leeds - in transit',
     'make': 'nissan',
     'make_model': 'nissan leaf',
     'model': 'leaf',
     'odometer': 45317,
     'odometer_in_km': 72930,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2017-03-25',
     'sanitized_make': 'nissan',
     'seller_name': 'mobilize financial services',
     'title': 'nissan leaf 80kw tekna 30kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '80kw tekna 30kwh 5dr auto',
     'year': 2017}
2025-12-03 06:04:49 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 5afc30df-5017-5f5a-ac07-6e742dbdcbdd spider: manheim.gb
2025-12-03 06:04:49 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 5afc30df-5017-5f5a-ac07-6e742dbdcbdd due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 0, 'seller_name': 'mobilize financial services', 'price_includes_vat': False, 'title': 'nissan leaf 80kw tekna 30kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'nissan', 'model': 'leaf', 'transmission': 'automatic', 'engine': '0.0l', 'fuel_type': 'electric', 'odometer': 45317, 'odometer_reading_unit': 'mi', 'registration_date': '2017-03-25', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/nissan/leaf?id=2354571', 'location': 'leeds - in transit', 'origin_country_code': 'gb', 'trim': '80kw tekna 30kwh 5dr auto', 'license_plate': 'gu17vjo', 'year': 2017, 'listing': 'auction', 'c_o_2_emission_value': 0, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002354571-01988705-001.pdf', 'expiration_date': '2025-12-08t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': '5afc30df-5017-5f5a-ac07-6e742dbdcbdd', 'current_year_diff': 8, 'age_in_months': 104, 'make_model': 'nissan leaf', 'sanitized_make': 'nissan', 'odometer_in_km': 72930} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 104,
     'auction_title': '',
     'c_o_2_emission_value': 0,
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002354571-01988705-001.pdf',
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 8,
     'engine': '0.0l',
     'expiration_date': '2025-12-08t09:00:00z',
     'fuel_type': 'electric',
     'id': '5afc30df-5017-5f5a-ac07-6e742dbdcbdd',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'gu17vjo',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/nissan/leaf?id=2354571',
     'listing': 'auction',
     'location': 'leeds - in transit',
     'make': 'nissan',
     'make_model': 'nissan leaf',
     'model': 'leaf',
     'odometer': 45317,
     'odometer_in_km': 72930,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2017-03-25',
     'sanitized_make': 'nissan',
     'seller_name': 'mobilize financial services',
     'title': 'nissan leaf 80kw tekna 30kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '80kw tekna 30kwh 5dr auto',
     'year': 2017}
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002354571-01988705-001.pdf',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '0.0L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Electric',
 'id': '5afc30df-5017-5f5a-ac07-6e742dbdcbdd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'GU17VJO',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/NISSAN/LEAF?id=2354571',
 'listing': 'auction',
 'location': 'Leeds - In Transit',
 'make': 'NISSAN',
 'model': 'LEAF',
 'odometer': 45317,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-25',
 'seller_name': 'Mobilize Financial Services',
 'title': 'NISSAN LEAF 80kW Tekna 30kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '80kW Tekna 30kWh 5dr Auto',
 'year': 2017}
2025-12-03 06:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272354571%27 HTTP/1.1" 200 None
2025-12-03 06:04:49 [manheim.gb] INFO: Saving data for 2354571: {'auction_closing_time': 1765184400.0, 'created_time': 1764583482.599866, 'last_price_update_time': 1764741889.958677}
2025-12-03 06:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2354571') HTTP/1.1" 204 0
2025-12-03 06:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/KIA/CEED?id=2330511&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232330511&indx=117> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:04:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:04:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5 with identifier: 2330511
2025-12-03 06:04:56 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5
2025-12-03 06:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/LAND%20ROVER/DISCOVERYSPORT?id=2326281&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232326281&indx=116> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:05:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:05:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0b7b334-dc59-5030-a2b3-8abc203b93af with identifier: 2326281
2025-12-03 06:05:01 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item b0b7b334-dc59-5030-a2b3-8abc203b93af
2025-12-03 06:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0002330511-01982847-005.pdf> (referer: None)
2025-12-03 06:05:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6490210>
2025-12-03 06:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_expert_report_file_7afb5f05-133f-4228-85a5-d57d46e0d03e.pdf HTTP/1.1" 201 0
2025-12-03 06:05:02 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5
2025-12-03 06:05:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5, skipping ID generation
2025-12-03 06:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5
2025-12-03 06:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F27832954-5645-45e4-91f5-730f1f06814f_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_ext_7.jpg not downloaded yet
2025-12-03 06:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F27832954-5645-45e4-91f5-730f1f06814f_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_ext_7.jpg not downloaded yet
2025-12-03 06:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F27832954-5645-45e4-91f5-730f1f06814f_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_ext_6.jpg not downloaded yet
2025-12-03 06:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F27832954-5645-45e4-91f5-730f1f06814f_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_ext_1.jpg not downloaded yet
2025-12-03 06:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F27832954-5645-45e4-91f5-730f1f06814f_5.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_5.jpg not downloaded yet
2025-12-03 06:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F27832954-5645-45e4-91f5-730f1f06814f_4.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_4.jpg not downloaded yet
2025-12-03 06:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F27832954-5645-45e4-91f5-730f1f06814f_11.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_11.jpg not downloaded yet
2025-12-03 06:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F27832954-5645-45e4-91f5-730f1f06814f_10.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_10.jpg not downloaded yet
2025-12-03 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F27832954-5645-45e4-91f5-730f1f06814f_9.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_9.jpg not downloaded yet
2025-12-03 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F27832954-5645-45e4-91f5-730f1f06814f_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_ext_2.jpg not downloaded yet
2025-12-03 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F27832954-5645-45e4-91f5-730f1f06814f_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_ext_5.jpg not downloaded yet
2025-12-03 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F27832954-5645-45e4-91f5-730f1f06814f_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_ext_3.jpg not downloaded yet
2025-12-03 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F27832954-5645-45e4-91f5-730f1f06814f_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_ext_4.jpg not downloaded yet
2025-12-03 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2330511-4003932-13.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2330511-4003932-13.jpg not downloaded yet
2025-12-03 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2330511-4003932-1000.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2330511-4003932-1000.jpg not downloaded yet
2025-12-03 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2330511-4003932-1001.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2330511-4003932-1001.jpg not downloaded yet
2025-12-03 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2330511-4003932-1002.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2330511-4003932-1002.jpg not downloaded yet
2025-12-03 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2330511-4003932-1003.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2330511-4003932-1003.jpg not downloaded yet
2025-12-03 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2330511-4003932-1004.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2330511-4003932-1004.jpg not downloaded yet
2025-12-03 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2330511-4003932-1005.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2330511-4003932-1005.jpg not downloaded yet
2025-12-03 06:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0002326281-01987261-001.pdf> (referer: None)
2025-12-03 06:05:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f5b72610>
2025-12-03 06:05:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0b7b334-dc59-5030-a2b3-8abc203b93af/b0b7b334-dc59-5030-a2b3-8abc203b93af_expert_report_file_520036db-25ed-40e1-bd15-c058f5c32d6a.pdf HTTP/1.1" 201 0
2025-12-03 06:05:03 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item b0b7b334-dc59-5030-a2b3-8abc203b93af
2025-12-03 06:05:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b0b7b334-dc59-5030-a2b3-8abc203b93af, skipping ID generation
2025-12-03 06:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item b0b7b334-dc59-5030-a2b3-8abc203b93af
2025-12-03 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd35f6f58-4e22-4df6-870b-bcebf5cdff43_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d35f6f58-4e22-4df6-870b-bcebf5cdff43_ext_7.jpg not downloaded yet
2025-12-03 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd35f6f58-4e22-4df6-870b-bcebf5cdff43_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d35f6f58-4e22-4df6-870b-bcebf5cdff43_ext_7.jpg not downloaded yet
2025-12-03 06:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/SEAT/LEON?id=2286249&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232286249&indx=110> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd35f6f58-4e22-4df6-870b-bcebf5cdff43_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d35f6f58-4e22-4df6-870b-bcebf5cdff43_ext_6.jpg not downloaded yet
2025-12-03 06:05:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2330511-4003932-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002330511-01982847-005.pdf)
2025-12-03 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd35f6f58-4e22-4df6-870b-bcebf5cdff43_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d35f6f58-4e22-4df6-870b-bcebf5cdff43_ext_1.jpg not downloaded yet
2025-12-03 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd35f6f58-4e22-4df6-870b-bcebf5cdff43_5.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d35f6f58-4e22-4df6-870b-bcebf5cdff43_5.jpg not downloaded yet
2025-12-03 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd35f6f58-4e22-4df6-870b-bcebf5cdff43_4.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d35f6f58-4e22-4df6-870b-bcebf5cdff43_4.jpg not downloaded yet
2025-12-03 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd35f6f58-4e22-4df6-870b-bcebf5cdff43_11.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d35f6f58-4e22-4df6-870b-bcebf5cdff43_11.jpg not downloaded yet
2025-12-03 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd35f6f58-4e22-4df6-870b-bcebf5cdff43_10.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d35f6f58-4e22-4df6-870b-bcebf5cdff43_10.jpg not downloaded yet
2025-12-03 06:05:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf783f48-bd5e-5f09-82ee-022051d55284 with identifier: 2286249
2025-12-03 06:05:03 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item cf783f48-bd5e-5f09-82ee-022051d55284
2025-12-03 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd35f6f58-4e22-4df6-870b-bcebf5cdff43_9.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d35f6f58-4e22-4df6-870b-bcebf5cdff43_9.jpg not downloaded yet
2025-12-03 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd35f6f58-4e22-4df6-870b-bcebf5cdff43_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d35f6f58-4e22-4df6-870b-bcebf5cdff43_ext_2.jpg not downloaded yet
2025-12-03 06:05:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f65f0b90>
2025-12-03 06:05:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_19.jpg HTTP/1.1" 201 0
2025-12-03 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2330511-4003932-1005.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2330511-4003932-1005.jpg saved to cache
2025-12-03 06:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5
2025-12-03 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd35f6f58-4e22-4df6-870b-bcebf5cdff43_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d35f6f58-4e22-4df6-870b-bcebf5cdff43_ext_5.jpg not downloaded yet
2025-12-03 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd35f6f58-4e22-4df6-870b-bcebf5cdff43_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d35f6f58-4e22-4df6-870b-bcebf5cdff43_ext_3.jpg not downloaded yet
2025-12-03 06:05:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d35f6f58-4e22-4df6-870b-bcebf5cdff43_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002326281-01987261-001.pdf)
2025-12-03 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd35f6f58-4e22-4df6-870b-bcebf5cdff43_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d35f6f58-4e22-4df6-870b-bcebf5cdff43_ext_4.jpg not downloaded yet
2025-12-03 06:05:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d35f6f58-4e22-4df6-870b-bcebf5cdff43_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002326281-01987261-001.pdf)
2025-12-03 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2326281-4004676-13.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2326281-4004676-13.jpg not downloaded yet
2025-12-03 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2326281-4004676-1000.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2326281-4004676-1000.jpg not downloaded yet
2025-12-03 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2326281-4004676-1001.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2326281-4004676-1001.jpg not downloaded yet
2025-12-03 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2326281-4004676-1002.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2326281-4004676-1002.jpg not downloaded yet
2025-12-03 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2326281-4004676-1003.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2326281-4004676-1003.jpg not downloaded yet
2025-12-03 06:05:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f5b436d0>
2025-12-03 06:05:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 06:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0b7b334-dc59-5030-a2b3-8abc203b93af/b0b7b334-dc59-5030-a2b3-8abc203b93af_image_1.jpg HTTP/1.1" 201 0
2025-12-03 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd35f6f58-4e22-4df6-870b-bcebf5cdff43_ext_7.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d35f6f58-4e22-4df6-870b-bcebf5cdff43_ext_7.jpg saved to cache
2025-12-03 06:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b0b7b334-dc59-5030-a2b3-8abc203b93af
2025-12-03 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2326281-4004676-1004.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2326281-4004676-1004.jpg not downloaded yet
2025-12-03 06:05:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f65f3910>
2025-12-03 06:05:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0b7b334-dc59-5030-a2b3-8abc203b93af/b0b7b334-dc59-5030-a2b3-8abc203b93af_image_2.jpg HTTP/1.1" 201 0
2025-12-03 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd35f6f58-4e22-4df6-870b-bcebf5cdff43_ext_6.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d35f6f58-4e22-4df6-870b-bcebf5cdff43_ext_6.jpg saved to cache
2025-12-03 06:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b0b7b334-dc59-5030-a2b3-8abc203b93af
2025-12-03 06:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2326281-4004676-1005.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2326281-4004676-1005.jpg not downloaded yet
2025-12-03 06:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d35f6f58-4e22-4df6-870b-bcebf5cdff43_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002326281-01987261-001.pdf)
2025-12-03 06:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d35f6f58-4e22-4df6-870b-bcebf5cdff43_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002326281-01987261-001.pdf)
2025-12-03 06:05:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f65f3950>
2025-12-03 06:05:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0b7b334-dc59-5030-a2b3-8abc203b93af/b0b7b334-dc59-5030-a2b3-8abc203b93af_image_10.jpg HTTP/1.1" 201 0
2025-12-03 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd35f6f58-4e22-4df6-870b-bcebf5cdff43_ext_5.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d35f6f58-4e22-4df6-870b-bcebf5cdff43_ext_5.jpg saved to cache
2025-12-03 06:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item b0b7b334-dc59-5030-a2b3-8abc203b93af
2025-12-03 06:05:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56fa4c0190>
2025-12-03 06:05:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 06:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0b7b334-dc59-5030-a2b3-8abc203b93af/b0b7b334-dc59-5030-a2b3-8abc203b93af_image_11.jpg HTTP/1.1" 201 0
2025-12-03 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd35f6f58-4e22-4df6-870b-bcebf5cdff43_ext_3.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d35f6f58-4e22-4df6-870b-bcebf5cdff43_ext_3.jpg saved to cache
2025-12-03 06:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item b0b7b334-dc59-5030-a2b3-8abc203b93af
2025-12-03 06:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2326281-4004676-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002326281-01987261-001.pdf)
2025-12-03 06:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2326281-4004676-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002326281-01987261-001.pdf)
2025-12-03 06:05:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6015d10>
2025-12-03 06:05:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0b7b334-dc59-5030-a2b3-8abc203b93af/b0b7b334-dc59-5030-a2b3-8abc203b93af_image_18.jpg HTTP/1.1" 201 0
2025-12-03 06:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2326281-4004676-1004.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2326281-4004676-1004.jpg saved to cache
2025-12-03 06:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item b0b7b334-dc59-5030-a2b3-8abc203b93af
2025-12-03 06:05:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f52c9890>
2025-12-03 06:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0b7b334-dc59-5030-a2b3-8abc203b93af/b0b7b334-dc59-5030-a2b3-8abc203b93af_image_19.jpg HTTP/1.1" 201 0
2025-12-03 06:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2326281-4004676-1005.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2326281-4004676-1005.jpg saved to cache
2025-12-03 06:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item b0b7b334-dc59-5030-a2b3-8abc203b93af
2025-12-03 06:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2326281-4004676-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002326281-01987261-001.pdf)
2025-12-03 06:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2326281-4004676-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002326281-01987261-001.pdf)
2025-12-03 06:05:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6466c90>
2025-12-03 06:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0b7b334-dc59-5030-a2b3-8abc203b93af/b0b7b334-dc59-5030-a2b3-8abc203b93af_image_17.jpg HTTP/1.1" 201 0
2025-12-03 06:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2326281-4004676-1003.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2326281-4004676-1003.jpg saved to cache
2025-12-03 06:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item b0b7b334-dc59-5030-a2b3-8abc203b93af
2025-12-03 06:05:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f63239d0>
2025-12-03 06:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 06:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0b7b334-dc59-5030-a2b3-8abc203b93af/b0b7b334-dc59-5030-a2b3-8abc203b93af_image_16.jpg HTTP/1.1" 201 0
2025-12-03 06:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2326281-4004676-1002.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2326281-4004676-1002.jpg saved to cache
2025-12-03 06:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item b0b7b334-dc59-5030-a2b3-8abc203b93af
2025-12-03 06:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2326281-4004676-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002326281-01987261-001.pdf)
2025-12-03 06:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2326281-4004676-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002326281-01987261-001.pdf)
2025-12-03 06:05:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6160510>
2025-12-03 06:05:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0b7b334-dc59-5030-a2b3-8abc203b93af/b0b7b334-dc59-5030-a2b3-8abc203b93af_image_14.jpg HTTP/1.1" 201 0
2025-12-03 06:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2326281-4004676-1000.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2326281-4004676-1000.jpg saved to cache
2025-12-03 06:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item b0b7b334-dc59-5030-a2b3-8abc203b93af
2025-12-03 06:05:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f64cf790>
2025-12-03 06:05:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 06:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0b7b334-dc59-5030-a2b3-8abc203b93af/b0b7b334-dc59-5030-a2b3-8abc203b93af_image_15.jpg HTTP/1.1" 201 0
2025-12-03 06:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2326281-4004676-1001.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2326281-4004676-1001.jpg saved to cache
2025-12-03 06:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item b0b7b334-dc59-5030-a2b3-8abc203b93af
2025-12-03 06:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d35f6f58-4e22-4df6-870b-bcebf5cdff43_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002326281-01987261-001.pdf)
2025-12-03 06:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2326281-4004676-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002326281-01987261-001.pdf)
2025-12-03 06:05:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f5b72410>
2025-12-03 06:05:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 06:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0b7b334-dc59-5030-a2b3-8abc203b93af/b0b7b334-dc59-5030-a2b3-8abc203b93af_image_12.jpg HTTP/1.1" 201 0
2025-12-03 06:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd35f6f58-4e22-4df6-870b-bcebf5cdff43_ext_4.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d35f6f58-4e22-4df6-870b-bcebf5cdff43_ext_4.jpg saved to cache
2025-12-03 06:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item b0b7b334-dc59-5030-a2b3-8abc203b93af
2025-12-03 06:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/FORD/FOCUS?id=2262431&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232262431&indx=105> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:05:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f659c190>
2025-12-03 06:05:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0b7b334-dc59-5030-a2b3-8abc203b93af/b0b7b334-dc59-5030-a2b3-8abc203b93af_image_13.jpg HTTP/1.1" 201 0
2025-12-03 06:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2326281-4004676-13.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2326281-4004676-13.jpg saved to cache
2025-12-03 06:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item b0b7b334-dc59-5030-a2b3-8abc203b93af
2025-12-03 06:05:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d35f6f58-4e22-4df6-870b-bcebf5cdff43_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002326281-01987261-001.pdf)
2025-12-03 06:05:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 404cbca9-16e9-5f50-bd05-e7fab382a3d0 with identifier: 2262431
2025-12-03 06:05:10 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 404cbca9-16e9-5f50-bd05-e7fab382a3d0
2025-12-03 06:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d35f6f58-4e22-4df6-870b-bcebf5cdff43_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002326281-01987261-001.pdf)
2025-12-03 06:05:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6323f90>
2025-12-03 06:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0b7b334-dc59-5030-a2b3-8abc203b93af/b0b7b334-dc59-5030-a2b3-8abc203b93af_image_8.jpg HTTP/1.1" 201 0
2025-12-03 06:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd35f6f58-4e22-4df6-870b-bcebf5cdff43_9.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d35f6f58-4e22-4df6-870b-bcebf5cdff43_9.jpg saved to cache
2025-12-03 06:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b0b7b334-dc59-5030-a2b3-8abc203b93af
2025-12-03 06:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d35f6f58-4e22-4df6-870b-bcebf5cdff43_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002326281-01987261-001.pdf)
2025-12-03 06:05:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f636cf10>
2025-12-03 06:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0b7b334-dc59-5030-a2b3-8abc203b93af/b0b7b334-dc59-5030-a2b3-8abc203b93af_image_9.jpg HTTP/1.1" 201 0
2025-12-03 06:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd35f6f58-4e22-4df6-870b-bcebf5cdff43_ext_2.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d35f6f58-4e22-4df6-870b-bcebf5cdff43_ext_2.jpg saved to cache
2025-12-03 06:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b0b7b334-dc59-5030-a2b3-8abc203b93af
2025-12-03 06:05:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6426090>
2025-12-03 06:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0b7b334-dc59-5030-a2b3-8abc203b93af/b0b7b334-dc59-5030-a2b3-8abc203b93af_image_7.jpg HTTP/1.1" 201 0
2025-12-03 06:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd35f6f58-4e22-4df6-870b-bcebf5cdff43_10.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d35f6f58-4e22-4df6-870b-bcebf5cdff43_10.jpg saved to cache
2025-12-03 06:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b0b7b334-dc59-5030-a2b3-8abc203b93af
2025-12-03 06:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d35f6f58-4e22-4df6-870b-bcebf5cdff43_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002326281-01987261-001.pdf)
2025-12-03 06:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0002286249-01972433-004.pdf> (referer: None)
2025-12-03 06:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0002262431-01985060-002.pdf> (referer: None)
2025-12-03 06:05:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6163450>
2025-12-03 06:05:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0b7b334-dc59-5030-a2b3-8abc203b93af/b0b7b334-dc59-5030-a2b3-8abc203b93af_image_6.jpg HTTP/1.1" 201 0
2025-12-03 06:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd35f6f58-4e22-4df6-870b-bcebf5cdff43_11.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d35f6f58-4e22-4df6-870b-bcebf5cdff43_11.jpg saved to cache
2025-12-03 06:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b0b7b334-dc59-5030-a2b3-8abc203b93af
2025-12-03 06:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d35f6f58-4e22-4df6-870b-bcebf5cdff43_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002326281-01987261-001.pdf)
2025-12-03 06:05:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6407710>
2025-12-03 06:05:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf783f48-bd5e-5f09-82ee-022051d55284/cf783f48-bd5e-5f09-82ee-022051d55284_expert_report_file_a58f1a54-c3ee-460b-a82c-4a323b88962e.pdf HTTP/1.1" 201 0
2025-12-03 06:05:12 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item cf783f48-bd5e-5f09-82ee-022051d55284
2025-12-03 06:05:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cf783f48-bd5e-5f09-82ee-022051d55284, skipping ID generation
2025-12-03 06:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item cf783f48-bd5e-5f09-82ee-022051d55284
2025-12-03 06:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2e74512-f41b-4cf6-ab63-00dd6a908983_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2e74512-f41b-4cf6-ab63-00dd6a908983_ext_7.jpg not downloaded yet
2025-12-03 06:05:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f64a3210>
2025-12-03 06:05:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_404cbca9-16e9-5f50-bd05-e7fab382a3d0/404cbca9-16e9-5f50-bd05-e7fab382a3d0_expert_report_file_3d9940b7-a053-4ead-aac0-30b9ae470eec.pdf HTTP/1.1" 201 0
2025-12-03 06:05:13 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 404cbca9-16e9-5f50-bd05-e7fab382a3d0
2025-12-03 06:05:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 404cbca9-16e9-5f50-bd05-e7fab382a3d0, skipping ID generation
2025-12-03 06:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 404cbca9-16e9-5f50-bd05-e7fab382a3d0
2025-12-03 06:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F15bed765-7949-4121-b326-e53c14273ddc_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/15bed765-7949-4121-b326-e53c14273ddc_ext_7.jpg not downloaded yet
2025-12-03 06:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2e74512-f41b-4cf6-ab63-00dd6a908983_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2e74512-f41b-4cf6-ab63-00dd6a908983_ext_7.jpg not downloaded yet
2025-12-03 06:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F15bed765-7949-4121-b326-e53c14273ddc_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/15bed765-7949-4121-b326-e53c14273ddc_ext_7.jpg not downloaded yet
2025-12-03 06:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/FORD/SMAX?id=2255216&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232255216&indx=103> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2e74512-f41b-4cf6-ab63-00dd6a908983_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2e74512-f41b-4cf6-ab63-00dd6a908983_ext_6.jpg not downloaded yet
2025-12-03 06:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F15bed765-7949-4121-b326-e53c14273ddc_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/15bed765-7949-4121-b326-e53c14273ddc_ext_6.jpg not downloaded yet
2025-12-03 06:05:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:05:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6405490>
2025-12-03 06:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0b7b334-dc59-5030-a2b3-8abc203b93af/b0b7b334-dc59-5030-a2b3-8abc203b93af_image_5.jpg HTTP/1.1" 201 0
2025-12-03 06:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd35f6f58-4e22-4df6-870b-bcebf5cdff43_4.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d35f6f58-4e22-4df6-870b-bcebf5cdff43_4.jpg saved to cache
2025-12-03 06:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b0b7b334-dc59-5030-a2b3-8abc203b93af
2025-12-03 06:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2e74512-f41b-4cf6-ab63-00dd6a908983_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2e74512-f41b-4cf6-ab63-00dd6a908983_ext_1.jpg not downloaded yet
2025-12-03 06:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F15bed765-7949-4121-b326-e53c14273ddc_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/15bed765-7949-4121-b326-e53c14273ddc_ext_1.jpg not downloaded yet
2025-12-03 06:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2e74512-f41b-4cf6-ab63-00dd6a908983_5.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2e74512-f41b-4cf6-ab63-00dd6a908983_5.jpg not downloaded yet
2025-12-03 06:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F15bed765-7949-4121-b326-e53c14273ddc_5.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/15bed765-7949-4121-b326-e53c14273ddc_5.jpg not downloaded yet
2025-12-03 06:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2e74512-f41b-4cf6-ab63-00dd6a908983_4.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2e74512-f41b-4cf6-ab63-00dd6a908983_4.jpg not downloaded yet
2025-12-03 06:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F15bed765-7949-4121-b326-e53c14273ddc_4.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/15bed765-7949-4121-b326-e53c14273ddc_4.jpg not downloaded yet
2025-12-03 06:05:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea671044-60e2-5537-89a1-04ede30d8044 with identifier: 2255216
2025-12-03 06:05:13 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item ea671044-60e2-5537-89a1-04ede30d8044
2025-12-03 06:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2e74512-f41b-4cf6-ab63-00dd6a908983_11.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2e74512-f41b-4cf6-ab63-00dd6a908983_11.jpg not downloaded yet
2025-12-03 06:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F15bed765-7949-4121-b326-e53c14273ddc_11.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/15bed765-7949-4121-b326-e53c14273ddc_11.jpg not downloaded yet
2025-12-03 06:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2e74512-f41b-4cf6-ab63-00dd6a908983_10.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2e74512-f41b-4cf6-ab63-00dd6a908983_10.jpg not downloaded yet
2025-12-03 06:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F15bed765-7949-4121-b326-e53c14273ddc_10.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/15bed765-7949-4121-b326-e53c14273ddc_10.jpg not downloaded yet
2025-12-03 06:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2e74512-f41b-4cf6-ab63-00dd6a908983_9.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2e74512-f41b-4cf6-ab63-00dd6a908983_9.jpg not downloaded yet
2025-12-03 06:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F15bed765-7949-4121-b326-e53c14273ddc_9.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/15bed765-7949-4121-b326-e53c14273ddc_9.jpg not downloaded yet
2025-12-03 06:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2e74512-f41b-4cf6-ab63-00dd6a908983_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2e74512-f41b-4cf6-ab63-00dd6a908983_ext_2.jpg not downloaded yet
2025-12-03 06:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F15bed765-7949-4121-b326-e53c14273ddc_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/15bed765-7949-4121-b326-e53c14273ddc_ext_2.jpg not downloaded yet
2025-12-03 06:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2e74512-f41b-4cf6-ab63-00dd6a908983_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2e74512-f41b-4cf6-ab63-00dd6a908983_ext_5.jpg not downloaded yet
2025-12-03 06:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F15bed765-7949-4121-b326-e53c14273ddc_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/15bed765-7949-4121-b326-e53c14273ddc_ext_5.jpg not downloaded yet
2025-12-03 06:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2e74512-f41b-4cf6-ab63-00dd6a908983_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2e74512-f41b-4cf6-ab63-00dd6a908983_ext_3.jpg not downloaded yet
2025-12-03 06:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F15bed765-7949-4121-b326-e53c14273ddc_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/15bed765-7949-4121-b326-e53c14273ddc_ext_3.jpg not downloaded yet
2025-12-03 06:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2e74512-f41b-4cf6-ab63-00dd6a908983_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2e74512-f41b-4cf6-ab63-00dd6a908983_ext_4.jpg not downloaded yet
2025-12-03 06:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F15bed765-7949-4121-b326-e53c14273ddc_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/15bed765-7949-4121-b326-e53c14273ddc_ext_4.jpg not downloaded yet
2025-12-03 06:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2286249-3986933-13.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2286249-3986933-13.jpg not downloaded yet
2025-12-03 06:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2262431-4005658-13.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2262431-4005658-13.jpg not downloaded yet
2025-12-03 06:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2286249-3986933-1000.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2286249-3986933-1000.jpg not downloaded yet
2025-12-03 06:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2262431-4005658-1000.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2262431-4005658-1000.jpg not downloaded yet
2025-12-03 06:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2286249-3986933-1001.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2286249-3986933-1001.jpg not downloaded yet
2025-12-03 06:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2262431-4005658-1001.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2262431-4005658-1001.jpg not downloaded yet
2025-12-03 06:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2286249-3986933-1002.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2286249-3986933-1002.jpg not downloaded yet
2025-12-03 06:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2262431-4005658-1002.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2262431-4005658-1002.jpg not downloaded yet
2025-12-03 06:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2286249-3986933-1003.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2286249-3986933-1003.jpg not downloaded yet
2025-12-03 06:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2262431-4005658-1003.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2262431-4005658-1003.jpg not downloaded yet
2025-12-03 06:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2286249-3986933-1004.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2286249-3986933-1004.jpg not downloaded yet
2025-12-03 06:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2262431-4005658-1004.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2262431-4005658-1004.jpg not downloaded yet
2025-12-03 06:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2286249-3986933-1005.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2286249-3986933-1005.jpg not downloaded yet
2025-12-03 06:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2262431-4005658-1005.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2262431-4005658-1005.jpg not downloaded yet
2025-12-03 06:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2286249-3986933-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002286249-01972433-004.pdf)
2025-12-03 06:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2286249-3986933-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002286249-01972433-004.pdf)
2025-12-03 06:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2262431-4005658-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002262431-01985060-002.pdf)
2025-12-03 06:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2262431-4005658-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002262431-01985060-002.pdf)
2025-12-03 06:05:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f659fcd0>
2025-12-03 06:05:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf783f48-bd5e-5f09-82ee-022051d55284/cf783f48-bd5e-5f09-82ee-022051d55284_image_18.jpg HTTP/1.1" 201 0
2025-12-03 06:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2286249-3986933-1004.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2286249-3986933-1004.jpg saved to cache
2025-12-03 06:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item cf783f48-bd5e-5f09-82ee-022051d55284
2025-12-03 06:05:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2262431-4005658-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002262431-01985060-002.pdf)
2025-12-03 06:05:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2262431-4005658-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002262431-01985060-002.pdf)
2025-12-03 06:05:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2286249-3986933-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002286249-01972433-004.pdf)
2025-12-03 06:05:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f5b43b90>
2025-12-03 06:05:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf783f48-bd5e-5f09-82ee-022051d55284/cf783f48-bd5e-5f09-82ee-022051d55284_image_19.jpg HTTP/1.1" 201 0
2025-12-03 06:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2286249-3986933-1005.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2286249-3986933-1005.jpg saved to cache
2025-12-03 06:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item cf783f48-bd5e-5f09-82ee-022051d55284
2025-12-03 06:05:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f5bcb4d0>
2025-12-03 06:05:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_404cbca9-16e9-5f50-bd05-e7fab382a3d0/404cbca9-16e9-5f50-bd05-e7fab382a3d0_image_19.jpg HTTP/1.1" 201 0
2025-12-03 06:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2262431-4005658-1005.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2262431-4005658-1005.jpg saved to cache
2025-12-03 06:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 404cbca9-16e9-5f50-bd05-e7fab382a3d0
2025-12-03 06:05:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f5231650>
2025-12-03 06:05:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_404cbca9-16e9-5f50-bd05-e7fab382a3d0/404cbca9-16e9-5f50-bd05-e7fab382a3d0_image_18.jpg HTTP/1.1" 201 0
2025-12-03 06:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2262431-4005658-1004.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2262431-4005658-1004.jpg saved to cache
2025-12-03 06:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 404cbca9-16e9-5f50-bd05-e7fab382a3d0
2025-12-03 06:05:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2286249-3986933-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002286249-01972433-004.pdf)
2025-12-03 06:05:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f65d7310>
2025-12-03 06:05:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 06:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_404cbca9-16e9-5f50-bd05-e7fab382a3d0/404cbca9-16e9-5f50-bd05-e7fab382a3d0_image_17.jpg HTTP/1.1" 201 0
2025-12-03 06:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2262431-4005658-1003.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2262431-4005658-1003.jpg saved to cache
2025-12-03 06:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 404cbca9-16e9-5f50-bd05-e7fab382a3d0
2025-12-03 06:05:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f603dcd0>
2025-12-03 06:05:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_404cbca9-16e9-5f50-bd05-e7fab382a3d0/404cbca9-16e9-5f50-bd05-e7fab382a3d0_image_16.jpg HTTP/1.1" 201 0
2025-12-03 06:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2262431-4005658-1002.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2262431-4005658-1002.jpg saved to cache
2025-12-03 06:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 404cbca9-16e9-5f50-bd05-e7fab382a3d0
2025-12-03 06:05:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f64eab50>
2025-12-03 06:05:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf783f48-bd5e-5f09-82ee-022051d55284/cf783f48-bd5e-5f09-82ee-022051d55284_image_16.jpg HTTP/1.1" 201 0
2025-12-03 06:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2286249-3986933-1002.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2286249-3986933-1002.jpg saved to cache
2025-12-03 06:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item cf783f48-bd5e-5f09-82ee-022051d55284
2025-12-03 06:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2286249-3986933-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002286249-01972433-004.pdf)
2025-12-03 06:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2262431-4005658-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002262431-01985060-002.pdf)
2025-12-03 06:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2262431-4005658-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002262431-01985060-002.pdf)
2025-12-03 06:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2286249-3986933-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002286249-01972433-004.pdf)
2025-12-03 06:05:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f5b89950>
2025-12-03 06:05:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf783f48-bd5e-5f09-82ee-022051d55284/cf783f48-bd5e-5f09-82ee-022051d55284_image_17.jpg HTTP/1.1" 201 0
2025-12-03 06:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2286249-3986933-1003.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2286249-3986933-1003.jpg saved to cache
2025-12-03 06:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item cf783f48-bd5e-5f09-82ee-022051d55284
2025-12-03 06:05:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f62c3a50>
2025-12-03 06:05:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 06:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf783f48-bd5e-5f09-82ee-022051d55284/cf783f48-bd5e-5f09-82ee-022051d55284_image_15.jpg HTTP/1.1" 201 0
2025-12-03 06:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2286249-3986933-1001.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2286249-3986933-1001.jpg saved to cache
2025-12-03 06:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item cf783f48-bd5e-5f09-82ee-022051d55284
2025-12-03 06:05:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f521c4d0>
2025-12-03 06:05:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_404cbca9-16e9-5f50-bd05-e7fab382a3d0/404cbca9-16e9-5f50-bd05-e7fab382a3d0_image_14.jpg HTTP/1.1" 201 0
2025-12-03 06:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2262431-4005658-1000.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2262431-4005658-1000.jpg saved to cache
2025-12-03 06:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 404cbca9-16e9-5f50-bd05-e7fab382a3d0
2025-12-03 06:05:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f642c490>
2025-12-03 06:05:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_404cbca9-16e9-5f50-bd05-e7fab382a3d0/404cbca9-16e9-5f50-bd05-e7fab382a3d0_image_15.jpg HTTP/1.1" 201 0
2025-12-03 06:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2262431-4005658-1001.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2262431-4005658-1001.jpg saved to cache
2025-12-03 06:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 404cbca9-16e9-5f50-bd05-e7fab382a3d0
2025-12-03 06:05:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f643c710>
2025-12-03 06:05:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf783f48-bd5e-5f09-82ee-022051d55284/cf783f48-bd5e-5f09-82ee-022051d55284_image_14.jpg HTTP/1.1" 201 0
2025-12-03 06:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2286249-3986933-1000.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2286249-3986933-1000.jpg saved to cache
2025-12-03 06:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item cf783f48-bd5e-5f09-82ee-022051d55284
2025-12-03 06:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/PEUGEOT/308?id=2243807&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232243807&indx=100> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/BMW/Z4?id=196679&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%23196679&indx=74> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:05:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:05:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/15bed765-7949-4121-b326-e53c14273ddc_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002262431-01985060-002.pdf)
2025-12-03 06:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2286249-3986933-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002286249-01972433-004.pdf)
2025-12-03 06:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a2e74512-f41b-4cf6-ab63-00dd6a908983_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002286249-01972433-004.pdf)
2025-12-03 06:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2262431-4005658-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002262431-01985060-002.pdf)
2025-12-03 06:05:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4275b9b-87fa-56c4-8048-0ce6cf9935a1 with identifier: 2243807
2025-12-03 06:05:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4275b9b-87fa-56c4-8048-0ce6cf9935a1 with scrape type 2
2025-12-03 06:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d4275b9b-87fa-56c4-8048-0ce6cf9935a1 with scrape type 2
2025-12-03 06:05:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: d4275b9b-87fa-56c4-8048-0ce6cf9935a1, identifier: 2243807
2025-12-03 06:05:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: d4275b9b-87fa-56c4-8048-0ce6cf9935a1 with identifier: 2243807
2025-12-03 06:05:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: d4275b9b-87fa-56c4-8048-0ce6cf9935a1 with identifier: 2243807
2025-12-03 06:05:18 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 154018 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    154018
2025-12-03 06:05:18 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: d4275b9b-87fa-56c4-8048-0ce6cf9935a1 spider: manheim.gb
2025-12-03 06:05:18 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: d4275b9b-87fa-56c4-8048-0ce6cf9935a1 due to rule: high_mileage_for_country.json, error: 154018 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    154018
{'auction_title': '',
 'c_o_2_emission_value': 100,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002243807-01976275-003.pdf',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '1.5L',
 'expiration_date': '2025-12-03T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'd4275b9b-87fa-56c4-8048-0ce6cf9935a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'KT19PFN',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/PEUGEOT/308?id=2243807',
 'listing': 'auction',
 'location': 'Plymouth',
 'make': 'PEUGEOT',
 'model': '308',
 'odometer': 95703,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-30',
 'seller_name': 'Yeomans',
 'title': 'PEUGEOT 308 1.5 BlueHDi 130 GT Line 5dr',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi 130 GT Line 5dr',
 'year': 2019}
2025-12-03 06:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272243807%27 HTTP/1.1" 200 None
2025-12-03 06:05:19 [manheim.gb] INFO: Saving data for 2243807: {'auction_closing_time': 1764752400.0, 'created_time': 1764583922.247107, 'last_price_update_time': 1764741919.009447}
2025-12-03 06:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2243807') HTTP/1.1" 204 0
2025-12-03 06:05:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 391b4f4c-6885-5c72-8cdf-5a04e9575729 with identifier: 196679
2025-12-03 06:05:19 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 391b4f4c-6885-5c72-8cdf-5a04e9575729
2025-12-03 06:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/15bed765-7949-4121-b326-e53c14273ddc_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002262431-01985060-002.pdf)
2025-12-03 06:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/15bed765-7949-4121-b326-e53c14273ddc_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002262431-01985060-002.pdf)
2025-12-03 06:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a2e74512-f41b-4cf6-ab63-00dd6a908983_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002286249-01972433-004.pdf)
2025-12-03 06:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a2e74512-f41b-4cf6-ab63-00dd6a908983_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002286249-01972433-004.pdf)
2025-12-03 06:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/15bed765-7949-4121-b326-e53c14273ddc_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002262431-01985060-002.pdf)
2025-12-03 06:05:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f65bffd0>
2025-12-03 06:05:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_404cbca9-16e9-5f50-bd05-e7fab382a3d0/404cbca9-16e9-5f50-bd05-e7fab382a3d0_image_12.jpg HTTP/1.1" 201 0
2025-12-03 06:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F15bed765-7949-4121-b326-e53c14273ddc_ext_4.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/15bed765-7949-4121-b326-e53c14273ddc_ext_4.jpg saved to cache
2025-12-03 06:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 404cbca9-16e9-5f50-bd05-e7fab382a3d0
2025-12-03 06:05:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f52de710>
2025-12-03 06:05:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 06:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf783f48-bd5e-5f09-82ee-022051d55284/cf783f48-bd5e-5f09-82ee-022051d55284_image_13.jpg HTTP/1.1" 201 0
2025-12-03 06:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2286249-3986933-13.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2286249-3986933-13.jpg saved to cache
2025-12-03 06:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item cf783f48-bd5e-5f09-82ee-022051d55284
2025-12-03 06:05:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f52d4a10>
2025-12-03 06:05:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf783f48-bd5e-5f09-82ee-022051d55284/cf783f48-bd5e-5f09-82ee-022051d55284_image_12.jpg HTTP/1.1" 201 0
2025-12-03 06:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2e74512-f41b-4cf6-ab63-00dd6a908983_ext_4.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2e74512-f41b-4cf6-ab63-00dd6a908983_ext_4.jpg saved to cache
2025-12-03 06:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item cf783f48-bd5e-5f09-82ee-022051d55284
2025-12-03 06:05:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f642c710>
2025-12-03 06:05:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_404cbca9-16e9-5f50-bd05-e7fab382a3d0/404cbca9-16e9-5f50-bd05-e7fab382a3d0_image_13.jpg HTTP/1.1" 201 0
2025-12-03 06:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2262431-4005658-13.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2262431-4005658-13.jpg saved to cache
2025-12-03 06:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 404cbca9-16e9-5f50-bd05-e7fab382a3d0
2025-12-03 06:05:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a2e74512-f41b-4cf6-ab63-00dd6a908983_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002286249-01972433-004.pdf)
2025-12-03 06:05:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/SCLASS?id=1976170&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231976170&indx=75> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:05:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:05:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f52a6c90>
2025-12-03 06:05:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_404cbca9-16e9-5f50-bd05-e7fab382a3d0/404cbca9-16e9-5f50-bd05-e7fab382a3d0_image_9.jpg HTTP/1.1" 201 0
2025-12-03 06:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F15bed765-7949-4121-b326-e53c14273ddc_ext_2.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/15bed765-7949-4121-b326-e53c14273ddc_ext_2.jpg saved to cache
2025-12-03 06:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 404cbca9-16e9-5f50-bd05-e7fab382a3d0
2025-12-03 06:05:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f64640d0>
2025-12-03 06:05:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_404cbca9-16e9-5f50-bd05-e7fab382a3d0/404cbca9-16e9-5f50-bd05-e7fab382a3d0_image_10.jpg HTTP/1.1" 201 0
2025-12-03 06:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F15bed765-7949-4121-b326-e53c14273ddc_ext_5.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/15bed765-7949-4121-b326-e53c14273ddc_ext_5.jpg saved to cache
2025-12-03 06:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 404cbca9-16e9-5f50-bd05-e7fab382a3d0
2025-12-03 06:05:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f7a44710>
2025-12-03 06:05:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf783f48-bd5e-5f09-82ee-022051d55284/cf783f48-bd5e-5f09-82ee-022051d55284_image_9.jpg HTTP/1.1" 201 0
2025-12-03 06:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2e74512-f41b-4cf6-ab63-00dd6a908983_ext_2.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2e74512-f41b-4cf6-ab63-00dd6a908983_ext_2.jpg saved to cache
2025-12-03 06:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cf783f48-bd5e-5f09-82ee-022051d55284
2025-12-03 06:05:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f62b8050>
2025-12-03 06:05:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf783f48-bd5e-5f09-82ee-022051d55284/cf783f48-bd5e-5f09-82ee-022051d55284_image_10.jpg HTTP/1.1" 201 0
2025-12-03 06:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2e74512-f41b-4cf6-ab63-00dd6a908983_ext_5.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2e74512-f41b-4cf6-ab63-00dd6a908983_ext_5.jpg saved to cache
2025-12-03 06:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item cf783f48-bd5e-5f09-82ee-022051d55284
2025-12-03 06:05:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f62f4c10>
2025-12-03 06:05:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_404cbca9-16e9-5f50-bd05-e7fab382a3d0/404cbca9-16e9-5f50-bd05-e7fab382a3d0_image_11.jpg HTTP/1.1" 201 0
2025-12-03 06:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F15bed765-7949-4121-b326-e53c14273ddc_ext_3.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/15bed765-7949-4121-b326-e53c14273ddc_ext_3.jpg saved to cache
2025-12-03 06:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 404cbca9-16e9-5f50-bd05-e7fab382a3d0
2025-12-03 06:05:21 [scrapy.extensions.logstats] INFO: Crawled 86 pages (at 24 pages/min), scraped 27 items (at 6 items/min)
2025-12-03 06:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a2e74512-f41b-4cf6-ab63-00dd6a908983_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002286249-01972433-004.pdf)
2025-12-03 06:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a2e74512-f41b-4cf6-ab63-00dd6a908983_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002286249-01972433-004.pdf)
2025-12-03 06:05:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f637dcd0>
2025-12-03 06:05:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf783f48-bd5e-5f09-82ee-022051d55284/cf783f48-bd5e-5f09-82ee-022051d55284_image_11.jpg HTTP/1.1" 201 0
2025-12-03 06:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2e74512-f41b-4cf6-ab63-00dd6a908983_ext_3.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2e74512-f41b-4cf6-ab63-00dd6a908983_ext_3.jpg saved to cache
2025-12-03 06:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item cf783f48-bd5e-5f09-82ee-022051d55284
2025-12-03 06:05:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8ec3d9f-037e-5080-8a18-a670d1eb7b38 with identifier: 1976170
2025-12-03 06:05:22 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item b8ec3d9f-037e-5080-8a18-a670d1eb7b38
2025-12-03 06:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/15bed765-7949-4121-b326-e53c14273ddc_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002262431-01985060-002.pdf)
2025-12-03 06:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/15bed765-7949-4121-b326-e53c14273ddc_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002262431-01985060-002.pdf)
2025-12-03 06:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/15bed765-7949-4121-b326-e53c14273ddc_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002262431-01985060-002.pdf)
2025-12-03 06:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a2e74512-f41b-4cf6-ab63-00dd6a908983_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002286249-01972433-004.pdf)
2025-12-03 06:05:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6321810>
2025-12-03 06:05:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 06:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf783f48-bd5e-5f09-82ee-022051d55284/cf783f48-bd5e-5f09-82ee-022051d55284_image_8.jpg HTTP/1.1" 201 0
2025-12-03 06:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2e74512-f41b-4cf6-ab63-00dd6a908983_9.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2e74512-f41b-4cf6-ab63-00dd6a908983_9.jpg saved to cache
2025-12-03 06:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cf783f48-bd5e-5f09-82ee-022051d55284
2025-12-03 06:05:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f614da90>
2025-12-03 06:05:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf783f48-bd5e-5f09-82ee-022051d55284/cf783f48-bd5e-5f09-82ee-022051d55284_image_7.jpg HTTP/1.1" 201 0
2025-12-03 06:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2e74512-f41b-4cf6-ab63-00dd6a908983_10.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2e74512-f41b-4cf6-ab63-00dd6a908983_10.jpg saved to cache
2025-12-03 06:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cf783f48-bd5e-5f09-82ee-022051d55284
2025-12-03 06:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a2e74512-f41b-4cf6-ab63-00dd6a908983_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002286249-01972433-004.pdf)
2025-12-03 06:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a2e74512-f41b-4cf6-ab63-00dd6a908983_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002286249-01972433-004.pdf)
2025-12-03 06:05:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f603c110>
2025-12-03 06:05:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 06:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_404cbca9-16e9-5f50-bd05-e7fab382a3d0/404cbca9-16e9-5f50-bd05-e7fab382a3d0_image_8.jpg HTTP/1.1" 201 0
2025-12-03 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F15bed765-7949-4121-b326-e53c14273ddc_9.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/15bed765-7949-4121-b326-e53c14273ddc_9.jpg saved to cache
2025-12-03 06:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 404cbca9-16e9-5f50-bd05-e7fab382a3d0
2025-12-03 06:05:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f631cc10>
2025-12-03 06:05:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_404cbca9-16e9-5f50-bd05-e7fab382a3d0/404cbca9-16e9-5f50-bd05-e7fab382a3d0_image_7.jpg HTTP/1.1" 201 0
2025-12-03 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F15bed765-7949-4121-b326-e53c14273ddc_10.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/15bed765-7949-4121-b326-e53c14273ddc_10.jpg saved to cache
2025-12-03 06:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 404cbca9-16e9-5f50-bd05-e7fab382a3d0
2025-12-03 06:05:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f631f1d0>
2025-12-03 06:05:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_404cbca9-16e9-5f50-bd05-e7fab382a3d0/404cbca9-16e9-5f50-bd05-e7fab382a3d0_image_6.jpg HTTP/1.1" 201 0
2025-12-03 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F15bed765-7949-4121-b326-e53c14273ddc_11.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/15bed765-7949-4121-b326-e53c14273ddc_11.jpg saved to cache
2025-12-03 06:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 404cbca9-16e9-5f50-bd05-e7fab382a3d0
2025-12-03 06:05:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6364850>
2025-12-03 06:05:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf783f48-bd5e-5f09-82ee-022051d55284/cf783f48-bd5e-5f09-82ee-022051d55284_image_6.jpg HTTP/1.1" 201 0
2025-12-03 06:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2e74512-f41b-4cf6-ab63-00dd6a908983_11.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2e74512-f41b-4cf6-ab63-00dd6a908983_11.jpg saved to cache
2025-12-03 06:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cf783f48-bd5e-5f09-82ee-022051d55284
2025-12-03 06:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/15bed765-7949-4121-b326-e53c14273ddc_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002262431-01985060-002.pdf)
2025-12-03 06:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/15bed765-7949-4121-b326-e53c14273ddc_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002262431-01985060-002.pdf)
2025-12-03 06:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/ACLASS?id=1962040&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231962040&indx=73> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:05:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:05:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6482b90>
2025-12-03 06:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf783f48-bd5e-5f09-82ee-022051d55284/cf783f48-bd5e-5f09-82ee-022051d55284_image_5.jpg HTTP/1.1" 201 0
2025-12-03 06:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2e74512-f41b-4cf6-ab63-00dd6a908983_4.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2e74512-f41b-4cf6-ab63-00dd6a908983_4.jpg saved to cache
2025-12-03 06:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cf783f48-bd5e-5f09-82ee-022051d55284
2025-12-03 06:05:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f62f4f10>
2025-12-03 06:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf783f48-bd5e-5f09-82ee-022051d55284/cf783f48-bd5e-5f09-82ee-022051d55284_image_4.jpg HTTP/1.1" 201 0
2025-12-03 06:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2e74512-f41b-4cf6-ab63-00dd6a908983_5.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2e74512-f41b-4cf6-ab63-00dd6a908983_5.jpg saved to cache
2025-12-03 06:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cf783f48-bd5e-5f09-82ee-022051d55284
2025-12-03 06:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/15bed765-7949-4121-b326-e53c14273ddc_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002262431-01985060-002.pdf)
2025-12-03 06:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a2e74512-f41b-4cf6-ab63-00dd6a908983_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002286249-01972433-004.pdf)
2025-12-03 06:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/15bed765-7949-4121-b326-e53c14273ddc_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002262431-01985060-002.pdf)
2025-12-03 06:05:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f62af590>
2025-12-03 06:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_404cbca9-16e9-5f50-bd05-e7fab382a3d0/404cbca9-16e9-5f50-bd05-e7fab382a3d0_image_5.jpg HTTP/1.1" 201 0
2025-12-03 06:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F15bed765-7949-4121-b326-e53c14273ddc_4.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/15bed765-7949-4121-b326-e53c14273ddc_4.jpg saved to cache
2025-12-03 06:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 404cbca9-16e9-5f50-bd05-e7fab382a3d0
2025-12-03 06:05:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f62ea6d0>
2025-12-03 06:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_404cbca9-16e9-5f50-bd05-e7fab382a3d0/404cbca9-16e9-5f50-bd05-e7fab382a3d0_image_4.jpg HTTP/1.1" 201 0
2025-12-03 06:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F15bed765-7949-4121-b326-e53c14273ddc_5.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/15bed765-7949-4121-b326-e53c14273ddc_5.jpg saved to cache
2025-12-03 06:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 404cbca9-16e9-5f50-bd05-e7fab382a3d0
2025-12-03 06:05:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe16ff0c-02dc-5b78-b499-78e1d2e32fac with identifier: 1962040
2025-12-03 06:05:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe16ff0c-02dc-5b78-b499-78e1d2e32fac with scrape type 2
2025-12-03 06:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe16ff0c-02dc-5b78-b499-78e1d2e32fac with scrape type 2
2025-12-03 06:05:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: fe16ff0c-02dc-5b78-b499-78e1d2e32fac, identifier: 1962040
2025-12-03 06:05:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: fe16ff0c-02dc-5b78-b499-78e1d2e32fac with identifier: 1962040
2025-12-03 06:05:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: fe16ff0c-02dc-5b78-b499-78e1d2e32fac with identifier: 1962040
2025-12-03 06:05:25 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: fe16ff0c-02dc-5b78-b499-78e1d2e32fac with identifier: 1962040 to the API
2025-12-03 06:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 06:05:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-03 06:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27fe16ff0c-02dc-5b78-b499-78e1d2e32fac%27 HTTP/1.1" 200 None
2025-12-03 06:05:25 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id fe16ff0c-02dc-5b78-b499-78e1d2e32fac: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 03 Dec 2025 06:05:24 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-03 06:05:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/ACLASS?id=1962040&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231962040&indx=73>
{'auction_title': '',
 'c_o_2_emission_value': 101,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001962040-01961556-003.pdf',
 'color': 'RED',
 'currency': 'GBP',
 'engine': '1.5L',
 'expiration_date': '2025-12-03T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'fe16ff0c-02dc-5b78-b499-78e1d2e32fac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'WR67XGA',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/A%20CLASS?id=1962040',
 'listing': 'auction',
 'location': 'Birmingham',
 'make': 'MERCEDES-BENZ',
 'model': 'A CLASS',
 'odometer': 47734,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-31',
 'seller_name': 'Wheelers Group',
 'title': 'MERCEDES-BENZ A CLASS A180d AMG Line 5dr Auto',
 'transmission': 'automatic',
 'trim': 'A180d AMG Line 5dr Auto',
 'year': 2017}
2025-12-03 06:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271962040%27 HTTP/1.1" 200 None
2025-12-03 06:05:25 [manheim.gb] INFO: Saving data for 1962040: {'auction_closing_time': 1764752400.0, 'created_time': 1764583987.046153, 'last_price_update_time': 1764741925.747333}
2025-12-03 06:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1962040') HTTP/1.1" 204 0
2025-12-03 06:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a2e74512-f41b-4cf6-ab63-00dd6a908983_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002286249-01972433-004.pdf)
2025-12-03 06:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a2e74512-f41b-4cf6-ab63-00dd6a908983_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002286249-01972433-004.pdf)
2025-12-03 06:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a2e74512-f41b-4cf6-ab63-00dd6a908983_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002286249-01972433-004.pdf)
2025-12-03 06:05:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f614f310>
2025-12-03 06:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_404cbca9-16e9-5f50-bd05-e7fab382a3d0/404cbca9-16e9-5f50-bd05-e7fab382a3d0_image_3.jpg HTTP/1.1" 201 0
2025-12-03 06:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F15bed765-7949-4121-b326-e53c14273ddc_ext_1.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/15bed765-7949-4121-b326-e53c14273ddc_ext_1.jpg saved to cache
2025-12-03 06:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 404cbca9-16e9-5f50-bd05-e7fab382a3d0
2025-12-03 06:05:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f63c1290>
2025-12-03 06:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf783f48-bd5e-5f09-82ee-022051d55284/cf783f48-bd5e-5f09-82ee-022051d55284_image_3.jpg HTTP/1.1" 201 0
2025-12-03 06:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2e74512-f41b-4cf6-ab63-00dd6a908983_ext_1.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2e74512-f41b-4cf6-ab63-00dd6a908983_ext_1.jpg saved to cache
2025-12-03 06:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cf783f48-bd5e-5f09-82ee-022051d55284
2025-12-03 06:05:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f63e52d0>
2025-12-03 06:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_404cbca9-16e9-5f50-bd05-e7fab382a3d0/404cbca9-16e9-5f50-bd05-e7fab382a3d0_image_2.jpg HTTP/1.1" 201 0
2025-12-03 06:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F15bed765-7949-4121-b326-e53c14273ddc_ext_6.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/15bed765-7949-4121-b326-e53c14273ddc_ext_6.jpg saved to cache
2025-12-03 06:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 404cbca9-16e9-5f50-bd05-e7fab382a3d0
2025-12-03 06:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/15bed765-7949-4121-b326-e53c14273ddc_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002262431-01985060-002.pdf)
2025-12-03 06:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/15bed765-7949-4121-b326-e53c14273ddc_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002262431-01985060-002.pdf)
2025-12-03 06:05:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f62c2650>
2025-12-03 06:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf783f48-bd5e-5f09-82ee-022051d55284/cf783f48-bd5e-5f09-82ee-022051d55284_image_2.jpg HTTP/1.1" 201 0
2025-12-03 06:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2e74512-f41b-4cf6-ab63-00dd6a908983_ext_6.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2e74512-f41b-4cf6-ab63-00dd6a908983_ext_6.jpg saved to cache
2025-12-03 06:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cf783f48-bd5e-5f09-82ee-022051d55284
2025-12-03 06:05:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f5b575d0>
2025-12-03 06:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 06:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf783f48-bd5e-5f09-82ee-022051d55284/cf783f48-bd5e-5f09-82ee-022051d55284_image_0.jpg HTTP/1.1" 201 0
2025-12-03 06:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2e74512-f41b-4cf6-ab63-00dd6a908983_ext_7.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2e74512-f41b-4cf6-ab63-00dd6a908983_ext_7.jpg saved to cache
2025-12-03 06:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cf783f48-bd5e-5f09-82ee-022051d55284
2025-12-03 06:05:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f659d7d0>
2025-12-03 06:05:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf783f48-bd5e-5f09-82ee-022051d55284/cf783f48-bd5e-5f09-82ee-022051d55284_image_1.jpg HTTP/1.1" 201 0
2025-12-03 06:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa2e74512-f41b-4cf6-ab63-00dd6a908983_ext_7.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a2e74512-f41b-4cf6-ab63-00dd6a908983_ext_7.jpg saved to cache
2025-12-03 06:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cf783f48-bd5e-5f09-82ee-022051d55284
2025-12-03 06:05:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cf783f48-bd5e-5f09-82ee-022051d55284, skipping ID generation
2025-12-03 06:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Removing item cf783f48-bd5e-5f09-82ee-022051d55284 from tracking dictionaries
2025-12-03 06:05:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cf783f48-bd5e-5f09-82ee-022051d55284 sending to next pipeline
2025-12-03 06:05:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: cf783f48-bd5e-5f09-82ee-022051d55284, identifier: 2286249
2025-12-03 06:05:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: cf783f48-bd5e-5f09-82ee-022051d55284 with identifier: 2286249
2025-12-03 06:05:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: cf783f48-bd5e-5f09-82ee-022051d55284 with identifier: 2286249
2025-12-03 06:05:27 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: cf783f48-bd5e-5f09-82ee-022051d55284 with identifier: 2286249 to the API
2025-12-03 06:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 06:05:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 06:05:28 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/a2e74512-f41b-4cf6-ab63-00dd6a908983_ext_7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf783f48-bd5e-5f09-82ee-022051d55284/cf783f48-bd5e-5f09-82ee-022051d55284_expert_report_file_a58f1a54-c3ee-460b-a82c-4a323b88962e.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002286249-01972433-004.pdf',
 'color': 'BLUE',
 'currency': 'GBP',
 'engine': '1.4L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'cf783f48-bd5e-5f09-82ee-022051d55284',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'DA17HYM',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/SEAT/LEON?id=2286249',
 'listing': 'auction',
 'location': 'Bristol',
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 84751,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 40,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf783f48-bd5e-5f09-82ee-022051d55284/cf783f48-bd5e-5f09-82ee-022051d55284_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 135771,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a2e74512-f41b-4cf6-ab63-00dd6a908983_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf783f48-bd5e-5f09-82ee-022051d55284/cf783f48-bd5e-5f09-82ee-022051d55284_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 135771,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a2e74512-f41b-4cf6-ab63-00dd6a908983_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf783f48-bd5e-5f09-82ee-022051d55284/cf783f48-bd5e-5f09-82ee-022051d55284_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 240566,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a2e74512-f41b-4cf6-ab63-00dd6a908983_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf783f48-bd5e-5f09-82ee-022051d55284/cf783f48-bd5e-5f09-82ee-022051d55284_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 183808,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a2e74512-f41b-4cf6-ab63-00dd6a908983_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf783f48-bd5e-5f09-82ee-022051d55284/cf783f48-bd5e-5f09-82ee-022051d55284_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 128757,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a2e74512-f41b-4cf6-ab63-00dd6a908983_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf783f48-bd5e-5f09-82ee-022051d55284/cf783f48-bd5e-5f09-82ee-022051d55284_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 124471,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a2e74512-f41b-4cf6-ab63-00dd6a908983_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf783f48-bd5e-5f09-82ee-022051d55284/cf783f48-bd5e-5f09-82ee-022051d55284_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 126863,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a2e74512-f41b-4cf6-ab63-00dd6a908983_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf783f48-bd5e-5f09-82ee-022051d55284/cf783f48-bd5e-5f09-82ee-022051d55284_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120714,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a2e74512-f41b-4cf6-ab63-00dd6a908983_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf783f48-bd5e-5f09-82ee-022051d55284/cf783f48-bd5e-5f09-82ee-022051d55284_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 128334,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a2e74512-f41b-4cf6-ab63-00dd6a908983_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf783f48-bd5e-5f09-82ee-022051d55284/cf783f48-bd5e-5f09-82ee-022051d55284_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 219380,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a2e74512-f41b-4cf6-ab63-00dd6a908983_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf783f48-bd5e-5f09-82ee-022051d55284/cf783f48-bd5e-5f09-82ee-022051d55284_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 216573,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a2e74512-f41b-4cf6-ab63-00dd6a908983_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf783f48-bd5e-5f09-82ee-022051d55284/cf783f48-bd5e-5f09-82ee-022051d55284_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 193844,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a2e74512-f41b-4cf6-ab63-00dd6a908983_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf783f48-bd5e-5f09-82ee-022051d55284/cf783f48-bd5e-5f09-82ee-022051d55284_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 310487,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a2e74512-f41b-4cf6-ab63-00dd6a908983_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf783f48-bd5e-5f09-82ee-022051d55284/cf783f48-bd5e-5f09-82ee-022051d55284_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 251866,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2286249-3986933-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf783f48-bd5e-5f09-82ee-022051d55284/cf783f48-bd5e-5f09-82ee-022051d55284_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 258342,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2286249-3986933-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf783f48-bd5e-5f09-82ee-022051d55284/cf783f48-bd5e-5f09-82ee-022051d55284_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 161721,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2286249-3986933-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf783f48-bd5e-5f09-82ee-022051d55284/cf783f48-bd5e-5f09-82ee-022051d55284_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 216649,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2286249-3986933-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf783f48-bd5e-5f09-82ee-022051d55284/cf783f48-bd5e-5f09-82ee-022051d55284_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 295133,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2286249-3986933-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf783f48-bd5e-5f09-82ee-022051d55284/cf783f48-bd5e-5f09-82ee-022051d55284_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 283880,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2286249-3986933-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf783f48-bd5e-5f09-82ee-022051d55284/cf783f48-bd5e-5f09-82ee-022051d55284_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 292705,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2286249-3986933-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-10',
 'seller_name': 'Novuna Vehicle Solutions',
 'title': 'SEAT LEON 1.4 TSI 125 FR Technology 5dr',
 'transmission': 'manual',
 'trim': '1.4 TSI 125 FR Technology 5dr',
 'year': 2017}
2025-12-03 06:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272286249%27 HTTP/1.1" 200 None
2025-12-03 06:05:28 [manheim.gb] INFO: Saving data for 2286249: {'created_time': 1764741928.072219, 'last_price_update_time': 1764741928.072231, 'auction_closing_time': 1765270800.0}
2025-12-03 06:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2286249') HTTP/1.1" 204 0
2025-12-03 06:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2330511-4003932-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002330511-01982847-005.pdf)
2025-12-03 06:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d35f6f58-4e22-4df6-870b-bcebf5cdff43_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002326281-01987261-001.pdf)
2025-12-03 06:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d35f6f58-4e22-4df6-870b-bcebf5cdff43_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002326281-01987261-001.pdf)
2025-12-03 06:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d35f6f58-4e22-4df6-870b-bcebf5cdff43_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002326281-01987261-001.pdf)
2025-12-03 06:05:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f62570d0>
2025-12-03 06:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_404cbca9-16e9-5f50-bd05-e7fab382a3d0/404cbca9-16e9-5f50-bd05-e7fab382a3d0_image_1.jpg HTTP/1.1" 201 0
2025-12-03 06:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F15bed765-7949-4121-b326-e53c14273ddc_ext_7.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/15bed765-7949-4121-b326-e53c14273ddc_ext_7.jpg saved to cache
2025-12-03 06:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 404cbca9-16e9-5f50-bd05-e7fab382a3d0
2025-12-03 06:05:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6016350>
2025-12-03 06:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_404cbca9-16e9-5f50-bd05-e7fab382a3d0/404cbca9-16e9-5f50-bd05-e7fab382a3d0_image_0.jpg HTTP/1.1" 201 0
2025-12-03 06:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F15bed765-7949-4121-b326-e53c14273ddc_ext_7.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/15bed765-7949-4121-b326-e53c14273ddc_ext_7.jpg saved to cache
2025-12-03 06:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 404cbca9-16e9-5f50-bd05-e7fab382a3d0
2025-12-03 06:05:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 404cbca9-16e9-5f50-bd05-e7fab382a3d0, skipping ID generation
2025-12-03 06:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 404cbca9-16e9-5f50-bd05-e7fab382a3d0 from tracking dictionaries
2025-12-03 06:05:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 404cbca9-16e9-5f50-bd05-e7fab382a3d0 sending to next pipeline
2025-12-03 06:05:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 404cbca9-16e9-5f50-bd05-e7fab382a3d0, identifier: 2262431
2025-12-03 06:05:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 404cbca9-16e9-5f50-bd05-e7fab382a3d0 with identifier: 2262431
2025-12-03 06:05:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 404cbca9-16e9-5f50-bd05-e7fab382a3d0 with identifier: 2262431
2025-12-03 06:05:28 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 10 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    10
2025-12-03 06:05:28 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: 404cbca9-16e9-5f50-bd05-e7fab382a3d0 spider: manheim.gb
2025-12-03 06:05:29 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 404cbca9-16e9-5f50-bd05-e7fab382a3d0 due to rule: registration_date_old.json, error: 10 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    10
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_404cbca9-16e9-5f50-bd05-e7fab382a3d0/404cbca9-16e9-5f50-bd05-e7fab382a3d0_expert_report_file_3d9940b7-a053-4ead-aac0-30b9ae470eec.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002262431-01985060-002.pdf',
 'color': 'RED',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '404cbca9-16e9-5f50-bd05-e7fab382a3d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'EN64OFA',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FORD/FOCUS?id=2262431',
 'listing': 'auction',
 'location': 'Bristol',
 'make': 'FORD',
 'model': 'FOCUS',
 'odometer': 81392,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 43,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_404cbca9-16e9-5f50-bd05-e7fab382a3d0/404cbca9-16e9-5f50-bd05-e7fab382a3d0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 274965,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/15bed765-7949-4121-b326-e53c14273ddc_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_404cbca9-16e9-5f50-bd05-e7fab382a3d0/404cbca9-16e9-5f50-bd05-e7fab382a3d0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 274965,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/15bed765-7949-4121-b326-e53c14273ddc_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_404cbca9-16e9-5f50-bd05-e7fab382a3d0/404cbca9-16e9-5f50-bd05-e7fab382a3d0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 211954,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/15bed765-7949-4121-b326-e53c14273ddc_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_404cbca9-16e9-5f50-bd05-e7fab382a3d0/404cbca9-16e9-5f50-bd05-e7fab382a3d0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 158425,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/15bed765-7949-4121-b326-e53c14273ddc_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_404cbca9-16e9-5f50-bd05-e7fab382a3d0/404cbca9-16e9-5f50-bd05-e7fab382a3d0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 266768,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/15bed765-7949-4121-b326-e53c14273ddc_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_404cbca9-16e9-5f50-bd05-e7fab382a3d0/404cbca9-16e9-5f50-bd05-e7fab382a3d0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 238666,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/15bed765-7949-4121-b326-e53c14273ddc_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_404cbca9-16e9-5f50-bd05-e7fab382a3d0/404cbca9-16e9-5f50-bd05-e7fab382a3d0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 210833,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/15bed765-7949-4121-b326-e53c14273ddc_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_404cbca9-16e9-5f50-bd05-e7fab382a3d0/404cbca9-16e9-5f50-bd05-e7fab382a3d0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 221969,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/15bed765-7949-4121-b326-e53c14273ddc_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_404cbca9-16e9-5f50-bd05-e7fab382a3d0/404cbca9-16e9-5f50-bd05-e7fab382a3d0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257219,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/15bed765-7949-4121-b326-e53c14273ddc_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_404cbca9-16e9-5f50-bd05-e7fab382a3d0/404cbca9-16e9-5f50-bd05-e7fab382a3d0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 169069,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/15bed765-7949-4121-b326-e53c14273ddc_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_404cbca9-16e9-5f50-bd05-e7fab382a3d0/404cbca9-16e9-5f50-bd05-e7fab382a3d0_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 169375,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/15bed765-7949-4121-b326-e53c14273ddc_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_404cbca9-16e9-5f50-bd05-e7fab382a3d0/404cbca9-16e9-5f50-bd05-e7fab382a3d0_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 144284,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/15bed765-7949-4121-b326-e53c14273ddc_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_404cbca9-16e9-5f50-bd05-e7fab382a3d0/404cbca9-16e9-5f50-bd05-e7fab382a3d0_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 207399,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/15bed765-7949-4121-b326-e53c14273ddc_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_404cbca9-16e9-5f50-bd05-e7fab382a3d0/404cbca9-16e9-5f50-bd05-e7fab382a3d0_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 331925,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2262431-4005658-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_404cbca9-16e9-5f50-bd05-e7fab382a3d0/404cbca9-16e9-5f50-bd05-e7fab382a3d0_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 165111,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2262431-4005658-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_404cbca9-16e9-5f50-bd05-e7fab382a3d0/404cbca9-16e9-5f50-bd05-e7fab382a3d0_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 234854,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2262431-4005658-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_404cbca9-16e9-5f50-bd05-e7fab382a3d0/404cbca9-16e9-5f50-bd05-e7fab382a3d0_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 240400,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2262431-4005658-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_404cbca9-16e9-5f50-bd05-e7fab382a3d0/404cbca9-16e9-5f50-bd05-e7fab382a3d0_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 140102,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2262431-4005658-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_404cbca9-16e9-5f50-bd05-e7fab382a3d0/404cbca9-16e9-5f50-bd05-e7fab382a3d0_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 157970,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2262431-4005658-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_404cbca9-16e9-5f50-bd05-e7fab382a3d0/404cbca9-16e9-5f50-bd05-e7fab382a3d0_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 280075,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2262431-4005658-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-23',
 'seller_name': 'Mon Motors',
 'title': 'FORD FOCUS 1.6 TDCi 115 Titanium 5dr',
 'transmission': 'manual',
 'trim': '1.6 TDCi 115 Titanium 5dr',
 'year': 2015}
2025-12-03 06:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272262431%27 HTTP/1.1" 200 None
2025-12-03 06:05:29 [manheim.gb] INFO: Saving data for 2262431: {'created_time': 1764741929.07245, 'last_price_update_time': 1764741929.072463, 'auction_closing_time': 1764838800.0}
2025-12-03 06:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2262431') HTTP/1.1" 204 0
2025-12-03 06:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2330511-4003932-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002330511-01982847-005.pdf)
2025-12-03 06:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/SKODA/OCTAVIA?id=1950952&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231950952&indx=72> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:05:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f62a5290>
2025-12-03 06:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_18.jpg HTTP/1.1" 201 0
2025-12-03 06:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2330511-4003932-1004.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2330511-4003932-1004.jpg saved to cache
2025-12-03 06:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5
2025-12-03 06:05:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f62c2fd0>
2025-12-03 06:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0b7b334-dc59-5030-a2b3-8abc203b93af/b0b7b334-dc59-5030-a2b3-8abc203b93af_image_3.jpg HTTP/1.1" 201 0
2025-12-03 06:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd35f6f58-4e22-4df6-870b-bcebf5cdff43_ext_1.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d35f6f58-4e22-4df6-870b-bcebf5cdff43_ext_1.jpg saved to cache
2025-12-03 06:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b0b7b334-dc59-5030-a2b3-8abc203b93af
2025-12-03 06:05:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f62c3710>
2025-12-03 06:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0b7b334-dc59-5030-a2b3-8abc203b93af/b0b7b334-dc59-5030-a2b3-8abc203b93af_image_0.jpg HTTP/1.1" 201 0
2025-12-03 06:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd35f6f58-4e22-4df6-870b-bcebf5cdff43_ext_7.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d35f6f58-4e22-4df6-870b-bcebf5cdff43_ext_7.jpg saved to cache
2025-12-03 06:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b0b7b334-dc59-5030-a2b3-8abc203b93af
2025-12-03 06:05:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6140ad0>
2025-12-03 06:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0b7b334-dc59-5030-a2b3-8abc203b93af/b0b7b334-dc59-5030-a2b3-8abc203b93af_image_4.jpg HTTP/1.1" 201 0
2025-12-03 06:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd35f6f58-4e22-4df6-870b-bcebf5cdff43_5.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d35f6f58-4e22-4df6-870b-bcebf5cdff43_5.jpg saved to cache
2025-12-03 06:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b0b7b334-dc59-5030-a2b3-8abc203b93af
2025-12-03 06:05:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b0b7b334-dc59-5030-a2b3-8abc203b93af, skipping ID generation
2025-12-03 06:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b0b7b334-dc59-5030-a2b3-8abc203b93af from tracking dictionaries
2025-12-03 06:05:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b0b7b334-dc59-5030-a2b3-8abc203b93af sending to next pipeline
2025-12-03 06:05:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: b0b7b334-dc59-5030-a2b3-8abc203b93af, identifier: 2326281
2025-12-03 06:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2330511-4003932-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002330511-01982847-005.pdf)
2025-12-03 06:05:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: b0b7b334-dc59-5030-a2b3-8abc203b93af with identifier: 2326281
2025-12-03 06:05:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: b0b7b334-dc59-5030-a2b3-8abc203b93af with identifier: 2326281
2025-12-03 06:05:30 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: b0b7b334-dc59-5030-a2b3-8abc203b93af with identifier: 2326281 to the API
2025-12-03 06:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 06:05:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 06:05:30 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/d35f6f58-4e22-4df6-870b-bcebf5cdff43_5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0b7b334-dc59-5030-a2b3-8abc203b93af/b0b7b334-dc59-5030-a2b3-8abc203b93af_expert_report_file_520036db-25ed-40e1-bd15-c058f5c32d6a.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002326281-01987261-001.pdf',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'b0b7b334-dc59-5030-a2b3-8abc203b93af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'BT66XLM',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/LAND%20ROVER/DISCOVERY%20SPORT?id=2326281',
 'listing': 'auction',
 'location': 'Northampton',
 'make': 'LAND ROVER',
 'model': 'DISCOVERY SPORT',
 'odometer': 73785,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 33,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0b7b334-dc59-5030-a2b3-8abc203b93af/b0b7b334-dc59-5030-a2b3-8abc203b93af_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 233874,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d35f6f58-4e22-4df6-870b-bcebf5cdff43_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0b7b334-dc59-5030-a2b3-8abc203b93af/b0b7b334-dc59-5030-a2b3-8abc203b93af_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 233874,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d35f6f58-4e22-4df6-870b-bcebf5cdff43_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0b7b334-dc59-5030-a2b3-8abc203b93af/b0b7b334-dc59-5030-a2b3-8abc203b93af_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 285392,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d35f6f58-4e22-4df6-870b-bcebf5cdff43_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0b7b334-dc59-5030-a2b3-8abc203b93af/b0b7b334-dc59-5030-a2b3-8abc203b93af_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 215793,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d35f6f58-4e22-4df6-870b-bcebf5cdff43_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0b7b334-dc59-5030-a2b3-8abc203b93af/b0b7b334-dc59-5030-a2b3-8abc203b93af_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 239483,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d35f6f58-4e22-4df6-870b-bcebf5cdff43_5.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0b7b334-dc59-5030-a2b3-8abc203b93af/b0b7b334-dc59-5030-a2b3-8abc203b93af_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 236134,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d35f6f58-4e22-4df6-870b-bcebf5cdff43_4.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0b7b334-dc59-5030-a2b3-8abc203b93af/b0b7b334-dc59-5030-a2b3-8abc203b93af_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 229947,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d35f6f58-4e22-4df6-870b-bcebf5cdff43_11.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0b7b334-dc59-5030-a2b3-8abc203b93af/b0b7b334-dc59-5030-a2b3-8abc203b93af_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 229573,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d35f6f58-4e22-4df6-870b-bcebf5cdff43_10.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0b7b334-dc59-5030-a2b3-8abc203b93af/b0b7b334-dc59-5030-a2b3-8abc203b93af_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 240292,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d35f6f58-4e22-4df6-870b-bcebf5cdff43_9.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0b7b334-dc59-5030-a2b3-8abc203b93af/b0b7b334-dc59-5030-a2b3-8abc203b93af_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347915,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d35f6f58-4e22-4df6-870b-bcebf5cdff43_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0b7b334-dc59-5030-a2b3-8abc203b93af/b0b7b334-dc59-5030-a2b3-8abc203b93af_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 263255,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d35f6f58-4e22-4df6-870b-bcebf5cdff43_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0b7b334-dc59-5030-a2b3-8abc203b93af/b0b7b334-dc59-5030-a2b3-8abc203b93af_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 281547,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d35f6f58-4e22-4df6-870b-bcebf5cdff43_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0b7b334-dc59-5030-a2b3-8abc203b93af/b0b7b334-dc59-5030-a2b3-8abc203b93af_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 262705,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d35f6f58-4e22-4df6-870b-bcebf5cdff43_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0b7b334-dc59-5030-a2b3-8abc203b93af/b0b7b334-dc59-5030-a2b3-8abc203b93af_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 353790,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2326281-4004676-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0b7b334-dc59-5030-a2b3-8abc203b93af/b0b7b334-dc59-5030-a2b3-8abc203b93af_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 285801,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2326281-4004676-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0b7b334-dc59-5030-a2b3-8abc203b93af/b0b7b334-dc59-5030-a2b3-8abc203b93af_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 330522,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2326281-4004676-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0b7b334-dc59-5030-a2b3-8abc203b93af/b0b7b334-dc59-5030-a2b3-8abc203b93af_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 363541,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2326281-4004676-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0b7b334-dc59-5030-a2b3-8abc203b93af/b0b7b334-dc59-5030-a2b3-8abc203b93af_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 336641,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2326281-4004676-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0b7b334-dc59-5030-a2b3-8abc203b93af/b0b7b334-dc59-5030-a2b3-8abc203b93af_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 248349,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2326281-4004676-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0b7b334-dc59-5030-a2b3-8abc203b93af/b0b7b334-dc59-5030-a2b3-8abc203b93af_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 272317,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2326281-4004676-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-13',
 'seller_name': 'Vindis Group',
 'title': 'LAND ROVER DISCOVERY SPORT 2.0 TD4 180 HSE Black 5dr Auto',
 'transmission': 'automatic',
 'trim': '2.0 TD4 180 HSE Black 5dr Auto',
 'year': 2017}
2025-12-03 06:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272326281%27 HTTP/1.1" 200 None
2025-12-03 06:05:30 [manheim.gb] INFO: Saving data for 2326281: {'created_time': 1764741930.734388, 'last_price_update_time': 1764741930.7344, 'auction_closing_time': 1764838800.0}
2025-12-03 06:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2326281') HTTP/1.1" 204 0
2025-12-03 06:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2330511-4003932-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002330511-01982847-005.pdf)
2025-12-03 06:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2330511-4003932-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002330511-01982847-005.pdf)
2025-12-03 06:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2330511-4003932-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002330511-01982847-005.pdf)
2025-12-03 06:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/CITROEN/C1?id=1940647&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231940647&indx=71> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002330511-01982847-005.pdf)
2025-12-03 06:05:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f64d38d0>
2025-12-03 06:05:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_17.jpg HTTP/1.1" 201 0
2025-12-03 06:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2330511-4003932-1003.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2330511-4003932-1003.jpg saved to cache
2025-12-03 06:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5
2025-12-03 06:05:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46e4e2fa-35d1-51aa-aa3e-d458911a9872 with identifier: 1950952
2025-12-03 06:05:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46e4e2fa-35d1-51aa-aa3e-d458911a9872 with scrape type 2
2025-12-03 06:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46e4e2fa-35d1-51aa-aa3e-d458911a9872 with scrape type 2
2025-12-03 06:05:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 46e4e2fa-35d1-51aa-aa3e-d458911a9872, identifier: 1950952
2025-12-03 06:05:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6481850>
2025-12-03 06:05:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_14.jpg HTTP/1.1" 201 0
2025-12-03 06:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2330511-4003932-1000.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2330511-4003932-1000.jpg saved to cache
2025-12-03 06:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5
2025-12-03 06:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002330511-01982847-005.pdf)
2025-12-03 06:05:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 46e4e2fa-35d1-51aa-aa3e-d458911a9872 with identifier: 1950952
2025-12-03 06:05:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 46e4e2fa-35d1-51aa-aa3e-d458911a9872 with identifier: 1950952
2025-12-03 06:05:31 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'green', 'original_photo_count': 0, 'seller_name': 'stellantis & you', 'price_includes_vat': False, 'title': 'skoda octavia 2.0 tdi cr vrs 5dr dsg', 'price': 0, 'currency': 'gbp', 'make': 'skoda', 'model': 'octavia', 'transmission': 'automatic', 'engine': '2.0l', 'fuel_type': 'diesel', 'odometer': 141308, 'odometer_reading_unit': 'mi', 'registration_date': '2014-10-23', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/skoda/octavia?id=1950952', 'location': 'colchester', 'origin_country_code': 'gb', 'trim': '2.0 tdi cr vrs 5dr dsg', 'license_plate': 'yc64xbz', 'year': 2014, 'listing': 'auction', 'c_o_2_emission_value': 129, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0001950952-01983946-004.pdf', 'expiration_date': '2025-12-04t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': '46e4e2fa-35d1-51aa-aa3e-d458911a9872', 'current_year_diff': 11, 'age_in_months': 133, 'make_model': 'skoda octavia', 'sanitized_make': 'skoda', 'odometer_in_km': 227412}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 133,
     'auction_title': '',
     'c_o_2_emission_value': 129,
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0001950952-01983946-004.pdf',
     'color': 'green',
     'currency': 'gbp',
     'current_year_diff': 11,
     'engine': '2.0l',
     'expiration_date': '2025-12-04t09:00:00z',
     'fuel_type': 'diesel',
     'id': '46e4e2fa-35d1-51aa-aa3e-d458911a9872',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'yc64xbz',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/skoda/octavia?id=1950952',
     'listing': 'auction',
     'location': 'colchester',
     'make': 'skoda',
     'make_model': 'skoda octavia',
     'model': 'octavia',
     'odometer': 141308,
     'odometer_in_km': 227412,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2014-10-23',
     'sanitized_make': 'skoda',
     'seller_name': 'stellantis & you',
     'title': 'skoda octavia 2.0 tdi cr vrs 5dr dsg',
     'transmission': 'automatic',
     'trim': '2.0 tdi cr vrs 5dr dsg',
     'year': 2014}
2025-12-03 06:05:31 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 46e4e2fa-35d1-51aa-aa3e-d458911a9872 spider: manheim.gb
2025-12-03 06:05:31 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 46e4e2fa-35d1-51aa-aa3e-d458911a9872 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'green', 'original_photo_count': 0, 'seller_name': 'stellantis & you', 'price_includes_vat': False, 'title': 'skoda octavia 2.0 tdi cr vrs 5dr dsg', 'price': 0, 'currency': 'gbp', 'make': 'skoda', 'model': 'octavia', 'transmission': 'automatic', 'engine': '2.0l', 'fuel_type': 'diesel', 'odometer': 141308, 'odometer_reading_unit': 'mi', 'registration_date': '2014-10-23', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/skoda/octavia?id=1950952', 'location': 'colchester', 'origin_country_code': 'gb', 'trim': '2.0 tdi cr vrs 5dr dsg', 'license_plate': 'yc64xbz', 'year': 2014, 'listing': 'auction', 'c_o_2_emission_value': 129, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0001950952-01983946-004.pdf', 'expiration_date': '2025-12-04t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': '46e4e2fa-35d1-51aa-aa3e-d458911a9872', 'current_year_diff': 11, 'age_in_months': 133, 'make_model': 'skoda octavia', 'sanitized_make': 'skoda', 'odometer_in_km': 227412}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 133,
     'auction_title': '',
     'c_o_2_emission_value': 129,
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0001950952-01983946-004.pdf',
     'color': 'green',
     'currency': 'gbp',
     'current_year_diff': 11,
     'engine': '2.0l',
     'expiration_date': '2025-12-04t09:00:00z',
     'fuel_type': 'diesel',
     'id': '46e4e2fa-35d1-51aa-aa3e-d458911a9872',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'yc64xbz',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/skoda/octavia?id=1950952',
     'listing': 'auction',
     'location': 'colchester',
     'make': 'skoda',
     'make_model': 'skoda octavia',
     'model': 'octavia',
     'odometer': 141308,
     'odometer_in_km': 227412,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2014-10-23',
     'sanitized_make': 'skoda',
     'seller_name': 'stellantis & you',
     'title': 'skoda octavia 2.0 tdi cr vrs 5dr dsg',
     'transmission': 'automatic',
     'trim': '2.0 tdi cr vrs 5dr dsg',
     'year': 2014}
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001950952-01983946-004.pdf',
 'color': 'GREEN',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '46e4e2fa-35d1-51aa-aa3e-d458911a9872',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'YC64XBZ',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/SKODA/OCTAVIA?id=1950952',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'SKODA',
 'model': 'OCTAVIA',
 'odometer': 141308,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-23',
 'seller_name': 'Stellantis & You',
 'title': 'SKODA OCTAVIA 2.0 TDI CR vRS 5dr DSG',
 'transmission': 'automatic',
 'trim': '2.0 TDI CR vRS 5dr DSG',
 'year': 2014}
2025-12-03 06:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271950952%27 HTTP/1.1" 200 None
2025-12-03 06:05:31 [manheim.gb] INFO: Saving data for 1950952: {'auction_closing_time': 1764838800.0, 'created_time': 1764584052.8576, 'last_price_update_time': 1764741931.943593}
2025-12-03 06:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1950952') HTTP/1.1" 204 0
2025-12-03 06:05:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6017d50>
2025-12-03 06:05:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_16.jpg HTTP/1.1" 201 0
2025-12-03 06:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2330511-4003932-1002.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2330511-4003932-1002.jpg saved to cache
2025-12-03 06:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5
2025-12-03 06:05:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6105650>
2025-12-03 06:05:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 06:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_13.jpg HTTP/1.1" 201 0
2025-12-03 06:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2330511-4003932-13.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2330511-4003932-13.jpg saved to cache
2025-12-03 06:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5
2025-12-03 06:05:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6427350>
2025-12-03 06:05:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 06:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_15.jpg HTTP/1.1" 201 0
2025-12-03 06:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2330511-4003932-1001.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2330511-4003932-1001.jpg saved to cache
2025-12-03 06:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5
2025-12-03 06:05:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd94fc1f-4992-5127-abe7-2438f2e64acd with identifier: 1940647
2025-12-03 06:05:32 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item fd94fc1f-4992-5127-abe7-2438f2e64acd
2025-12-03 06:05:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f64d0b90>
2025-12-03 06:05:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_11.jpg HTTP/1.1" 201 0
2025-12-03 06:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F27832954-5645-45e4-91f5-730f1f06814f_ext_3.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_ext_3.jpg saved to cache
2025-12-03 06:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5
2025-12-03 06:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002330511-01982847-005.pdf)
2025-12-03 06:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002330511-01982847-005.pdf)
2025-12-03 06:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002330511-01982847-005.pdf)
2025-12-03 06:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002330511-01982847-005.pdf)
2025-12-03 06:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002330511-01982847-005.pdf)
2025-12-03 06:05:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f618ca90>
2025-12-03 06:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_12.jpg HTTP/1.1" 201 0
2025-12-03 06:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F27832954-5645-45e4-91f5-730f1f06814f_ext_4.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_ext_4.jpg saved to cache
2025-12-03 06:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5
2025-12-03 06:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002330511-01982847-005.pdf)
2025-12-03 06:05:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:05:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f5b98bd0>
2025-12-03 06:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_8.jpg HTTP/1.1" 201 0
2025-12-03 06:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F27832954-5645-45e4-91f5-730f1f06814f_9.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_9.jpg saved to cache
2025-12-03 06:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5
2025-12-03 06:05:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6228410>
2025-12-03 06:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 06:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_9.jpg HTTP/1.1" 201 0
2025-12-03 06:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F27832954-5645-45e4-91f5-730f1f06814f_ext_2.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_ext_2.jpg saved to cache
2025-12-03 06:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5
2025-12-03 06:05:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f602e5d0>
2025-12-03 06:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_7.jpg HTTP/1.1" 201 0
2025-12-03 06:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F27832954-5645-45e4-91f5-730f1f06814f_10.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_10.jpg saved to cache
2025-12-03 06:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5
2025-12-03 06:05:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f61126d0>
2025-12-03 06:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_10.jpg HTTP/1.1" 201 0
2025-12-03 06:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F27832954-5645-45e4-91f5-730f1f06814f_ext_5.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_ext_5.jpg saved to cache
2025-12-03 06:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5
2025-12-03 06:05:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6435790>
2025-12-03 06:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_6.jpg HTTP/1.1" 201 0
2025-12-03 06:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F27832954-5645-45e4-91f5-730f1f06814f_11.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_11.jpg saved to cache
2025-12-03 06:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5
2025-12-03 06:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002330511-01982847-005.pdf)
2025-12-03 06:05:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002330511-01982847-005.pdf)
2025-12-03 06:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002330511-01982847-005.pdf)
2025-12-03 06:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002330511-01982847-005.pdf)
2025-12-03 06:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002330511-01982847-005.pdf)
2025-12-03 06:05:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6329690>
2025-12-03 06:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_4.jpg HTTP/1.1" 201 0
2025-12-03 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F27832954-5645-45e4-91f5-730f1f06814f_5.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_5.jpg saved to cache
2025-12-03 06:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5
2025-12-03 06:05:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f63202d0>
2025-12-03 06:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 06:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_5.jpg HTTP/1.1" 201 0
2025-12-03 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F27832954-5645-45e4-91f5-730f1f06814f_4.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_4.jpg saved to cache
2025-12-03 06:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5
2025-12-03 06:05:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f630e590>
2025-12-03 06:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 06:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_3.jpg HTTP/1.1" 201 0
2025-12-03 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F27832954-5645-45e4-91f5-730f1f06814f_ext_1.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_ext_1.jpg saved to cache
2025-12-03 06:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5
2025-12-03 06:05:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6026dd0>
2025-12-03 06:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_0.jpg HTTP/1.1" 201 0
2025-12-03 06:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F27832954-5645-45e4-91f5-730f1f06814f_ext_7.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_ext_7.jpg saved to cache
2025-12-03 06:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5
2025-12-03 06:05:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f63237d0>
2025-12-03 06:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_2.jpg HTTP/1.1" 201 0
2025-12-03 06:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F27832954-5645-45e4-91f5-730f1f06814f_ext_6.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_ext_6.jpg saved to cache
2025-12-03 06:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5
2025-12-03 06:05:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f611d4d0>
2025-12-03 06:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 06:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_1.jpg HTTP/1.1" 201 0
2025-12-03 06:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F27832954-5645-45e4-91f5-730f1f06814f_ext_7.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_ext_7.jpg saved to cache
2025-12-03 06:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5
2025-12-03 06:05:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5, skipping ID generation
2025-12-03 06:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5 from tracking dictionaries
2025-12-03 06:05:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5 sending to next pipeline
2025-12-03 06:05:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5, identifier: 2330511
2025-12-03 06:05:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5 with identifier: 2330511
2025-12-03 06:05:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5 with identifier: 2330511
2025-12-03 06:05:36 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 28, 'seller_name': 'perrys', 'price_includes_vat': False, 'title': 'kia ceed 1.6 crdi 2 5dr', 'price': 0, 'currency': 'gbp', 'make': 'kia', 'model': 'ceed', 'transmission': 'manual', 'engine': '1.6l', 'fuel_type': 'diesel', 'odometer': 184175, 'odometer_reading_unit': 'mi', 'registration_date': '2013-04-09', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/kia/ceed?id=2330511', 'location': 'leeds', 'origin_country_code': 'gb', 'trim': '1.6 crdi 2 5dr', 'license_plate': 'ay13zfz', 'year': 2013, 'listing': 'auction', 'c_o_2_emission_value': 116, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002330511-01982847-005.pdf', 'expiration_date': '2025-12-03t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': 'ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5', 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_expert_report_file_7afb5f05-133f-4228-85a5-d57d46e0d03e.pdf', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_0.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_ext_7.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 200633}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_1.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_ext_7.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 200633}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_2.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_ext_6.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 247245}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_3.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_ext_1.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 174514}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_4.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 186896}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_5.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 196236}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_6.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_11.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 190039}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_7.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_10.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 206183}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_8.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_9.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 219861}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_9.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_ext_2.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 204727}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_10.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_ext_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 231420}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_11.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_ext_3.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 175487}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_12.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_ext_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 274035}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_13.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2330511-4003932-13.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 287876}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_14.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2330511-4003932-1000.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 246051}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_15.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2330511-4003932-1001.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 336004}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_16.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2330511-4003932-1002.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 298500}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_17.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2330511-4003932-1003.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 348084}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_18.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2330511-4003932-1004.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 177379}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_19.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2330511-4003932-1005.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 277851}], 'current_year_diff': 12, 'age_in_months': 151, 'make_model': 'kia ceed', 'sanitized_make': 'kia', 'odometer_in_km': 296400}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 151,
     'auction_title': '',
     'c_o_2_emission_value': 116,
     'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_expert_report_file_7afb5f05-133f-4228-85a5-d57d46e0d03e.pdf',
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002330511-01982847-005.pdf',
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 12,
     'engine': '1.6l',
     'expiration_date': '2025-12-03t09:00:00z',
     'fuel_type': 'diesel',
     'id': 'ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'ay13zfz',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/kia/ceed?id=2330511',
     'listing': 'auction',
     'location': 'leeds',
     'make': 'kia',
     'make_model': 'kia ceed',
     'model': 'ceed',
     'odometer': 184175,
     'odometer_in_km': 296400,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 28,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 200633,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_ext_7.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 200633,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_ext_7.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 247245,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_ext_6.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 174514,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_ext_1.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 186896,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_5.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 196236,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_4.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 190039,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_11.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 206183,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_10.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 219861,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_9.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 204727,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_ext_2.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 231420,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_ext_5.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 175487,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_ext_3.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 274035,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_ext_4.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 287876,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2330511-4003932-13.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 246051,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2330511-4003932-1000.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_15.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 336004,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2330511-4003932-1001.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_16.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 298500,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2330511-4003932-1002.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_17.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 348084,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2330511-4003932-1003.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_18.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 177379,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2330511-4003932-1004.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_19.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 277851,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2330511-4003932-1005.jpg',
                 'Width': 1333}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2013-04-09',
     'sanitized_make': 'kia',
     'seller_name': 'perrys',
     'title': 'kia ceed 1.6 crdi 2 5dr',
     'transmission': 'manual',
     'trim': '1.6 crdi 2 5dr',
     'year': 2013}
2025-12-03 06:05:36 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5 spider: manheim.gb
2025-12-03 06:05:37 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 28, 'seller_name': 'perrys', 'price_includes_vat': False, 'title': 'kia ceed 1.6 crdi 2 5dr', 'price': 0, 'currency': 'gbp', 'make': 'kia', 'model': 'ceed', 'transmission': 'manual', 'engine': '1.6l', 'fuel_type': 'diesel', 'odometer': 184175, 'odometer_reading_unit': 'mi', 'registration_date': '2013-04-09', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/kia/ceed?id=2330511', 'location': 'leeds', 'origin_country_code': 'gb', 'trim': '1.6 crdi 2 5dr', 'license_plate': 'ay13zfz', 'year': 2013, 'listing': 'auction', 'c_o_2_emission_value': 116, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002330511-01982847-005.pdf', 'expiration_date': '2025-12-03t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': 'ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5', 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_expert_report_file_7afb5f05-133f-4228-85a5-d57d46e0d03e.pdf', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_0.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_ext_7.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 200633}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_1.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_ext_7.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 200633}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_2.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_ext_6.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 247245}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_3.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_ext_1.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 174514}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_4.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 186896}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_5.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 196236}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_6.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_11.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 190039}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_7.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_10.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 206183}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_8.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_9.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 219861}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_9.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_ext_2.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 204727}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_10.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_ext_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 231420}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_11.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_ext_3.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 175487}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_12.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_ext_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 274035}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_13.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2330511-4003932-13.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 287876}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_14.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2330511-4003932-1000.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 246051}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_15.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2330511-4003932-1001.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 336004}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_16.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2330511-4003932-1002.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 298500}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_17.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2330511-4003932-1003.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 348084}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_18.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2330511-4003932-1004.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 177379}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_19.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2330511-4003932-1005.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 277851}], 'current_year_diff': 12, 'age_in_months': 151, 'make_model': 'kia ceed', 'sanitized_make': 'kia', 'odometer_in_km': 296400}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 151,
     'auction_title': '',
     'c_o_2_emission_value': 116,
     'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_expert_report_file_7afb5f05-133f-4228-85a5-d57d46e0d03e.pdf',
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002330511-01982847-005.pdf',
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 12,
     'engine': '1.6l',
     'expiration_date': '2025-12-03t09:00:00z',
     'fuel_type': 'diesel',
     'id': 'ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'ay13zfz',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/kia/ceed?id=2330511',
     'listing': 'auction',
     'location': 'leeds',
     'make': 'kia',
     'make_model': 'kia ceed',
     'model': 'ceed',
     'odometer': 184175,
     'odometer_in_km': 296400,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 28,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 200633,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_ext_7.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 200633,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_ext_7.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 247245,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_ext_6.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 174514,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_ext_1.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 186896,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_5.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 196236,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_4.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 190039,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_11.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 206183,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_10.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 219861,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_9.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 204727,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_ext_2.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 231420,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_ext_5.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 175487,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_ext_3.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 274035,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_ext_4.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 287876,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2330511-4003932-13.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 246051,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2330511-4003932-1000.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_15.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 336004,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2330511-4003932-1001.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_16.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 298500,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2330511-4003932-1002.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_17.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 348084,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2330511-4003932-1003.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_18.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 177379,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2330511-4003932-1004.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_19.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 277851,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2330511-4003932-1005.jpg',
                 'Width': 1333}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2013-04-09',
     'sanitized_make': 'kia',
     'seller_name': 'perrys',
     'title': 'kia ceed 1.6 crdi 2 5dr',
     'transmission': 'manual',
     'trim': '1.6 crdi 2 5dr',
     'year': 2013}
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_expert_report_file_7afb5f05-133f-4228-85a5-d57d46e0d03e.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002330511-01982847-005.pdf',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': '2025-12-03T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'AY13ZFZ',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/KIA/CEED?id=2330511',
 'listing': 'auction',
 'location': 'Leeds',
 'make': 'KIA',
 'model': 'CEED',
 'odometer': 184175,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 28,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 200633,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 200633,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 247245,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 174514,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 186896,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 196236,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 190039,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 206183,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 219861,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 204727,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 231420,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 175487,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 274035,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/27832954-5645-45e4-91f5-730f1f06814f_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 287876,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2330511-4003932-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 246051,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2330511-4003932-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 336004,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2330511-4003932-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 298500,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2330511-4003932-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 348084,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2330511-4003932-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 177379,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2330511-4003932-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5/ef61e378-fa0d-5d2e-80a6-fcfb6ada95c5_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 277851,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2330511-4003932-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-09',
 'seller_name': 'Perrys',
 'title': 'KIA CEED 1.6 CRDi 2 5dr',
 'transmission': 'manual',
 'trim': '1.6 CRDi 2 5dr',
 'year': 2013}
2025-12-03 06:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272330511%27 HTTP/1.1" 200 None
2025-12-03 06:05:37 [manheim.gb] INFO: Saving data for 2330511: {'created_time': 1764741937.131174, 'last_price_update_time': 1764741937.131185, 'auction_closing_time': 1764752400.0}
2025-12-03 06:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2330511') HTTP/1.1" 204 0
2025-12-03 06:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0000196679-01983681-002.pdf> (referer: None)
2025-12-03 06:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0002255216-01981992-002.pdf> (referer: None)
2025-12-03 06:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0001976170-01815378-004.pdf> (referer: None)
2025-12-03 06:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0001940647-01984243-002.pdf> (referer: None)
2025-12-03 06:05:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6355090>
2025-12-03 06:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_391b4f4c-6885-5c72-8cdf-5a04e9575729/391b4f4c-6885-5c72-8cdf-5a04e9575729_expert_report_file_c3f0ea3c-9a1a-4df2-bd54-aa53ba259b41.pdf HTTP/1.1" 201 0
2025-12-03 06:05:37 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 391b4f4c-6885-5c72-8cdf-5a04e9575729
2025-12-03 06:05:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 391b4f4c-6885-5c72-8cdf-5a04e9575729, skipping ID generation
2025-12-03 06:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 391b4f4c-6885-5c72-8cdf-5a04e9575729
2025-12-03 06:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc6b8d049-47d9-4be5-92e6-cb6861fc337b_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c6b8d049-47d9-4be5-92e6-cb6861fc337b_ext_7.jpg not downloaded yet
2025-12-03 06:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc6b8d049-47d9-4be5-92e6-cb6861fc337b_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c6b8d049-47d9-4be5-92e6-cb6861fc337b_ext_7.jpg not downloaded yet
2025-12-03 06:05:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f52d91d0>
2025-12-03 06:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_expert_report_file_c12282da-97a3-4776-a94b-3b2b60ea6a85.pdf HTTP/1.1" 201 0
2025-12-03 06:05:38 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item ea671044-60e2-5537-89a1-04ede30d8044
2025-12-03 06:05:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ea671044-60e2-5537-89a1-04ede30d8044, skipping ID generation
2025-12-03 06:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item ea671044-60e2-5537-89a1-04ede30d8044
2025-12-03 06:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2255216-9999999-336141851-004.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-004.jpg not downloaded yet
2025-12-03 06:05:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f61d9b90>
2025-12-03 06:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8ec3d9f-037e-5080-8a18-a670d1eb7b38/b8ec3d9f-037e-5080-8a18-a670d1eb7b38_expert_report_file_29e070a7-c9a3-4a55-ad95-7d63567860f6.pdf HTTP/1.1" 201 0
2025-12-03 06:05:38 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item b8ec3d9f-037e-5080-8a18-a670d1eb7b38
2025-12-03 06:05:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b8ec3d9f-037e-5080-8a18-a670d1eb7b38, skipping ID generation
2025-12-03 06:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item b8ec3d9f-037e-5080-8a18-a670d1eb7b38
2025-12-03 06:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1976170-9999999-217150707-004.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1976170-9999999-217150707-004.jpg not downloaded yet
2025-12-03 06:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc6b8d049-47d9-4be5-92e6-cb6861fc337b_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c6b8d049-47d9-4be5-92e6-cb6861fc337b_ext_6.jpg not downloaded yet
2025-12-03 06:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2255216-9999999-336141851-008.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-008.jpg not downloaded yet
2025-12-03 06:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fi360-ext-0000-88482313-007.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://images.manheim.co.uk/images/units/zoom/i360-ext-0000-88482313-007.jpg not downloaded yet
2025-12-03 06:05:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f62e86d0>
2025-12-03 06:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 06:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd94fc1f-4992-5127-abe7-2438f2e64acd/fd94fc1f-4992-5127-abe7-2438f2e64acd_expert_report_file_734783b2-faf8-4e12-b591-7f530d95ef8a.pdf HTTP/1.1" 201 0
2025-12-03 06:05:38 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item fd94fc1f-4992-5127-abe7-2438f2e64acd
2025-12-03 06:05:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fd94fc1f-4992-5127-abe7-2438f2e64acd, skipping ID generation
2025-12-03 06:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item fd94fc1f-4992-5127-abe7-2438f2e64acd
2025-12-03 06:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2ed0b499-2114-4b85-97b2-37b2497e04ec_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2ed0b499-2114-4b85-97b2-37b2497e04ec_ext_7.jpg not downloaded yet
2025-12-03 06:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc6b8d049-47d9-4be5-92e6-cb6861fc337b_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c6b8d049-47d9-4be5-92e6-cb6861fc337b_ext_1.jpg not downloaded yet
2025-12-03 06:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2255216-9999999-336141851-001.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-001.jpg not downloaded yet
2025-12-03 06:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1976170-9999999-217150707-008.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1976170-9999999-217150707-008.jpg not downloaded yet
2025-12-03 06:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2ed0b499-2114-4b85-97b2-37b2497e04ec_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2ed0b499-2114-4b85-97b2-37b2497e04ec_ext_7.jpg not downloaded yet
2025-12-03 06:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc6b8d049-47d9-4be5-92e6-cb6861fc337b_5.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c6b8d049-47d9-4be5-92e6-cb6861fc337b_5.jpg not downloaded yet
2025-12-03 06:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2255216-9999999-336141851-002.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-002.jpg not downloaded yet
2025-12-03 06:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1976170-9999999-217150707-001.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1976170-9999999-217150707-001.jpg not downloaded yet
2025-12-03 06:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2ed0b499-2114-4b85-97b2-37b2497e04ec_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2ed0b499-2114-4b85-97b2-37b2497e04ec_ext_6.jpg not downloaded yet
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc6b8d049-47d9-4be5-92e6-cb6861fc337b_4.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c6b8d049-47d9-4be5-92e6-cb6861fc337b_4.jpg not downloaded yet
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2255216-9999999-336141851-003.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-003.jpg not downloaded yet
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1976170-9999999-217150707-002.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1976170-9999999-217150707-002.jpg not downloaded yet
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2ed0b499-2114-4b85-97b2-37b2497e04ec_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2ed0b499-2114-4b85-97b2-37b2497e04ec_ext_1.jpg not downloaded yet
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc6b8d049-47d9-4be5-92e6-cb6861fc337b_11.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c6b8d049-47d9-4be5-92e6-cb6861fc337b_11.jpg not downloaded yet
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2255216-9999999-336141851-005.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-005.jpg not downloaded yet
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1976170-9999999-217150707-003.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1976170-9999999-217150707-003.jpg not downloaded yet
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2ed0b499-2114-4b85-97b2-37b2497e04ec_5.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2ed0b499-2114-4b85-97b2-37b2497e04ec_5.jpg not downloaded yet
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc6b8d049-47d9-4be5-92e6-cb6861fc337b_10.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c6b8d049-47d9-4be5-92e6-cb6861fc337b_10.jpg not downloaded yet
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2255216-9999999-336141851-006.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-006.jpg not downloaded yet
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1976170-9999999-217150707-005.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1976170-9999999-217150707-005.jpg not downloaded yet
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2ed0b499-2114-4b85-97b2-37b2497e04ec_4.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2ed0b499-2114-4b85-97b2-37b2497e04ec_4.jpg not downloaded yet
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc6b8d049-47d9-4be5-92e6-cb6861fc337b_9.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c6b8d049-47d9-4be5-92e6-cb6861fc337b_9.jpg not downloaded yet
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2255216-9999999-336141851-007.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-007.jpg not downloaded yet
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1976170-9999999-217150707-006.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1976170-9999999-217150707-006.jpg not downloaded yet
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2ed0b499-2114-4b85-97b2-37b2497e04ec_11.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2ed0b499-2114-4b85-97b2-37b2497e04ec_11.jpg not downloaded yet
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc6b8d049-47d9-4be5-92e6-cb6861fc337b_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c6b8d049-47d9-4be5-92e6-cb6861fc337b_ext_2.jpg not downloaded yet
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2255216-9999999-336141851-009.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-009.jpg not downloaded yet
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1976170-9999999-217150707-007.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1976170-9999999-217150707-007.jpg not downloaded yet
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2ed0b499-2114-4b85-97b2-37b2497e04ec_10.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2ed0b499-2114-4b85-97b2-37b2497e04ec_10.jpg not downloaded yet
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc6b8d049-47d9-4be5-92e6-cb6861fc337b_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c6b8d049-47d9-4be5-92e6-cb6861fc337b_ext_5.jpg not downloaded yet
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2255216-9999999-336141851-010.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-010.jpg not downloaded yet
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1976170-9999999-217150707-009.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1976170-9999999-217150707-009.jpg not downloaded yet
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2ed0b499-2114-4b85-97b2-37b2497e04ec_9.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2ed0b499-2114-4b85-97b2-37b2497e04ec_9.jpg not downloaded yet
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc6b8d049-47d9-4be5-92e6-cb6861fc337b_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c6b8d049-47d9-4be5-92e6-cb6861fc337b_ext_3.jpg not downloaded yet
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2255216-9999999-336141851-011.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-011.jpg not downloaded yet
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1976170-9999999-217150707-010.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1976170-9999999-217150707-010.jpg not downloaded yet
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2ed0b499-2114-4b85-97b2-37b2497e04ec_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2ed0b499-2114-4b85-97b2-37b2497e04ec_ext_2.jpg not downloaded yet
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc6b8d049-47d9-4be5-92e6-cb6861fc337b_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c6b8d049-47d9-4be5-92e6-cb6861fc337b_ext_4.jpg not downloaded yet
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2255216-9999999-336141851-012.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-012.jpg not downloaded yet
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1976170-9999999-217150707-011.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1976170-9999999-217150707-011.jpg not downloaded yet
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2ed0b499-2114-4b85-97b2-37b2497e04ec_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2ed0b499-2114-4b85-97b2-37b2497e04ec_ext_5.jpg not downloaded yet
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-196679-4003916-13.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-196679-4003916-13.jpg not downloaded yet
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2255216-4005331-13.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2255216-4005331-13.jpg not downloaded yet
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1976170-9999999-217150707-012.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1976170-9999999-217150707-012.jpg not downloaded yet
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2ed0b499-2114-4b85-97b2-37b2497e04ec_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2ed0b499-2114-4b85-97b2-37b2497e04ec_ext_3.jpg not downloaded yet
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-196679-4003916-1000.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-196679-4003916-1000.jpg not downloaded yet
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2255216-4005331-1000.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2255216-4005331-1000.jpg not downloaded yet
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1976170-3871875-13.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1976170-3871875-13.jpg not downloaded yet
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2ed0b499-2114-4b85-97b2-37b2497e04ec_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2ed0b499-2114-4b85-97b2-37b2497e04ec_ext_4.jpg not downloaded yet
2025-12-03 06:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/RENAULT/CLIO?id=1905242&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231905242&indx=69> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-196679-4003916-1001.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-196679-4003916-1001.jpg not downloaded yet
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2255216-4005331-1001.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2255216-4005331-1001.jpg not downloaded yet
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1976170-3871875-1000.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1976170-3871875-1000.jpg not downloaded yet
2025-12-03 06:05:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1940647-4004272-13.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1940647-4004272-13.jpg not downloaded yet
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-196679-4003916-1002.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-196679-4003916-1002.jpg not downloaded yet
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2255216-4005331-1002.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2255216-4005331-1002.jpg not downloaded yet
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1976170-3871875-1001.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1976170-3871875-1001.jpg not downloaded yet
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1940647-4004272-1000.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1940647-4004272-1000.jpg not downloaded yet
2025-12-03 06:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VAUXHALL/CORSA?id=1912686&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231912686&indx=70> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-196679-4003916-1003.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-196679-4003916-1003.jpg not downloaded yet
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2255216-4005331-1003.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2255216-4005331-1003.jpg not downloaded yet
2025-12-03 06:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1976170-3871875-1002.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1976170-3871875-1002.jpg not downloaded yet
2025-12-03 06:05:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1940647-4004272-1001.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1940647-4004272-1001.jpg not downloaded yet
2025-12-03 06:05:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e37714f4-2645-502d-85f4-7f38cb37dd67 with identifier: 1905242
2025-12-03 06:05:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e37714f4-2645-502d-85f4-7f38cb37dd67 with scrape type 2
2025-12-03 06:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e37714f4-2645-502d-85f4-7f38cb37dd67 with scrape type 2
2025-12-03 06:05:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: e37714f4-2645-502d-85f4-7f38cb37dd67, identifier: 1905242
2025-12-03 06:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-196679-4003916-1004.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-196679-4003916-1004.jpg not downloaded yet
2025-12-03 06:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2255216-4005331-1004.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2255216-4005331-1004.jpg not downloaded yet
2025-12-03 06:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1976170-3871875-1003.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1976170-3871875-1003.jpg not downloaded yet
2025-12-03 06:05:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: e37714f4-2645-502d-85f4-7f38cb37dd67 with identifier: 1905242
2025-12-03 06:05:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: e37714f4-2645-502d-85f4-7f38cb37dd67 with identifier: 1905242
2025-12-03 06:05:40 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: e37714f4-2645-502d-85f4-7f38cb37dd67 with identifier: 1905242 to the API
2025-12-03 06:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 06:05:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 06:05:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/RENAULT/CLIO?id=1905242&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231905242&indx=69>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001905242-01977233-004.pdf',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.5L',
 'expiration_date': '2025-12-03T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'e37714f4-2645-502d-85f4-7f38cb37dd67',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'HT18AYJ',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/RENAULT/CLIO?id=1905242',
 'listing': 'auction',
 'location': 'Leeds',
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 53625,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-20',
 'seller_name': 'NextGear Capital UK Ltd',
 'title': 'RENAULT CLIO 1.5 dCi 90 GT Line 5dr',
 'transmission': 'manual',
 'trim': '1.5 dCi 90 GT Line 5dr',
 'year': 2018}
2025-12-03 06:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271905242%27 HTTP/1.1" 200 None
2025-12-03 06:05:42 [manheim.gb] INFO: Saving data for 1905242: {'auction_closing_time': 1764752400.0, 'created_time': 1764583997.261215, 'last_price_update_time': 1764741942.13887}
2025-12-03 06:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1905242') HTTP/1.1" 204 0
2025-12-03 06:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1940647-4004272-1002.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1940647-4004272-1002.jpg not downloaded yet
2025-12-03 06:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-196679-4003916-1005.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-196679-4003916-1005.jpg not downloaded yet
2025-12-03 06:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2255216-4005331-1005.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2255216-4005331-1005.jpg not downloaded yet
2025-12-03 06:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1976170-3871875-1004.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1976170-3871875-1004.jpg not downloaded yet
2025-12-03 06:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1940647-4004272-1003.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1940647-4004272-1003.jpg not downloaded yet
2025-12-03 06:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2255216-4005331-1006.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2255216-4005331-1006.jpg not downloaded yet
2025-12-03 06:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1976170-3871875-1005.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1976170-3871875-1005.jpg not downloaded yet
2025-12-03 06:05:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1b26391-08cb-5b60-9737-ef0afa324128 with identifier: 1912686
2025-12-03 06:05:42 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item f1b26391-08cb-5b60-9737-ef0afa324128
2025-12-03 06:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1940647-4004272-1004.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1940647-4004272-1004.jpg not downloaded yet
2025-12-03 06:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1940647-4004272-1005.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1940647-4004272-1005.jpg not downloaded yet
2025-12-03 06:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1940647-4004272-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001940647-01984243-002.pdf)
2025-12-03 06:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1940647-4004272-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001940647-01984243-002.pdf)
2025-12-03 06:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1976170-3871875-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001976170-01815378-004.pdf)
2025-12-03 06:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1940647-4004272-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001940647-01984243-002.pdf)
2025-12-03 06:05:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f65f38d0>
2025-12-03 06:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd94fc1f-4992-5127-abe7-2438f2e64acd/fd94fc1f-4992-5127-abe7-2438f2e64acd_image_18.jpg HTTP/1.1" 201 0
2025-12-03 06:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1940647-4004272-1004.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1940647-4004272-1004.jpg saved to cache
2025-12-03 06:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item fd94fc1f-4992-5127-abe7-2438f2e64acd
2025-12-03 06:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2255216-4005331-1006.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002255216-01981992-002.pdf)
2025-12-03 06:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1976170-3871875-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001976170-01815378-004.pdf)
2025-12-03 06:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1940647-4004272-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001940647-01984243-002.pdf)
2025-12-03 06:05:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6024850>
2025-12-03 06:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 06:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd94fc1f-4992-5127-abe7-2438f2e64acd/fd94fc1f-4992-5127-abe7-2438f2e64acd_image_17.jpg HTTP/1.1" 201 0
2025-12-03 06:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1940647-4004272-1003.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1940647-4004272-1003.jpg saved to cache
2025-12-03 06:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item fd94fc1f-4992-5127-abe7-2438f2e64acd
2025-12-03 06:05:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f618df90>
2025-12-03 06:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8ec3d9f-037e-5080-8a18-a670d1eb7b38/b8ec3d9f-037e-5080-8a18-a670d1eb7b38_image_19.jpg HTTP/1.1" 201 0
2025-12-03 06:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1976170-3871875-1005.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1976170-3871875-1005.jpg saved to cache
2025-12-03 06:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item b8ec3d9f-037e-5080-8a18-a670d1eb7b38
2025-12-03 06:05:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f659d050>
2025-12-03 06:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd94fc1f-4992-5127-abe7-2438f2e64acd/fd94fc1f-4992-5127-abe7-2438f2e64acd_image_19.jpg HTTP/1.1" 201 0
2025-12-03 06:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1940647-4004272-1005.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1940647-4004272-1005.jpg saved to cache
2025-12-03 06:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item fd94fc1f-4992-5127-abe7-2438f2e64acd
2025-12-03 06:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2255216-4005331-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002255216-01981992-002.pdf)
2025-12-03 06:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-196679-4003916-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000196679-01983681-002.pdf)
2025-12-03 06:05:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f5bb2750>
2025-12-03 06:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_19.jpg HTTP/1.1" 201 0
2025-12-03 06:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2255216-4005331-1006.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2255216-4005331-1006.jpg saved to cache
2025-12-03 06:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item ea671044-60e2-5537-89a1-04ede30d8044
2025-12-03 06:05:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f65f3810>
2025-12-03 06:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8ec3d9f-037e-5080-8a18-a670d1eb7b38/b8ec3d9f-037e-5080-8a18-a670d1eb7b38_image_18.jpg HTTP/1.1" 201 0
2025-12-03 06:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1976170-3871875-1004.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1976170-3871875-1004.jpg saved to cache
2025-12-03 06:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item b8ec3d9f-037e-5080-8a18-a670d1eb7b38
2025-12-03 06:05:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6056ed0>
2025-12-03 06:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd94fc1f-4992-5127-abe7-2438f2e64acd/fd94fc1f-4992-5127-abe7-2438f2e64acd_image_16.jpg HTTP/1.1" 201 0
2025-12-03 06:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1940647-4004272-1002.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1940647-4004272-1002.jpg saved to cache
2025-12-03 06:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item fd94fc1f-4992-5127-abe7-2438f2e64acd
2025-12-03 06:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1940647-4004272-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001940647-01984243-002.pdf)
2025-12-03 06:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1976170-3871875-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001976170-01815378-004.pdf)
2025-12-03 06:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1976170-3871875-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001976170-01815378-004.pdf)
2025-12-03 06:05:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f5b5f4d0>
2025-12-03 06:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_18.jpg HTTP/1.1" 201 0
2025-12-03 06:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2255216-4005331-1005.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2255216-4005331-1005.jpg saved to cache
2025-12-03 06:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item ea671044-60e2-5537-89a1-04ede30d8044
2025-12-03 06:05:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6481250>
2025-12-03 06:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_391b4f4c-6885-5c72-8cdf-5a04e9575729/391b4f4c-6885-5c72-8cdf-5a04e9575729_image_19.jpg HTTP/1.1" 201 0
2025-12-03 06:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-196679-4003916-1005.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-196679-4003916-1005.jpg saved to cache
2025-12-03 06:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 391b4f4c-6885-5c72-8cdf-5a04e9575729
2025-12-03 06:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2255216-4005331-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002255216-01981992-002.pdf)
2025-12-03 06:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-196679-4003916-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000196679-01983681-002.pdf)
2025-12-03 06:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=1859294&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231859294&indx=66> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:05:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:05:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f64eab50>
2025-12-03 06:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd94fc1f-4992-5127-abe7-2438f2e64acd/fd94fc1f-4992-5127-abe7-2438f2e64acd_image_15.jpg HTTP/1.1" 201 0
2025-12-03 06:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1940647-4004272-1001.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1940647-4004272-1001.jpg saved to cache
2025-12-03 06:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item fd94fc1f-4992-5127-abe7-2438f2e64acd
2025-12-03 06:05:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6112e50>
2025-12-03 06:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8ec3d9f-037e-5080-8a18-a670d1eb7b38/b8ec3d9f-037e-5080-8a18-a670d1eb7b38_image_17.jpg HTTP/1.1" 201 0
2025-12-03 06:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1976170-3871875-1003.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1976170-3871875-1003.jpg saved to cache
2025-12-03 06:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item b8ec3d9f-037e-5080-8a18-a670d1eb7b38
2025-12-03 06:05:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f7a45790>
2025-12-03 06:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 06:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8ec3d9f-037e-5080-8a18-a670d1eb7b38/b8ec3d9f-037e-5080-8a18-a670d1eb7b38_image_16.jpg HTTP/1.1" 201 0
2025-12-03 06:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1976170-3871875-1002.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1976170-3871875-1002.jpg saved to cache
2025-12-03 06:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item b8ec3d9f-037e-5080-8a18-a670d1eb7b38
2025-12-03 06:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2255216-4005331-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002255216-01981992-002.pdf)
2025-12-03 06:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2255216-4005331-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002255216-01981992-002.pdf)
2025-12-03 06:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1940647-4004272-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001940647-01984243-002.pdf)
2025-12-03 06:05:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6026d10>
2025-12-03 06:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_17.jpg HTTP/1.1" 201 0
2025-12-03 06:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2255216-4005331-1004.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2255216-4005331-1004.jpg saved to cache
2025-12-03 06:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item ea671044-60e2-5537-89a1-04ede30d8044
2025-12-03 06:05:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f61ce390>
2025-12-03 06:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_391b4f4c-6885-5c72-8cdf-5a04e9575729/391b4f4c-6885-5c72-8cdf-5a04e9575729_image_18.jpg HTTP/1.1" 201 0
2025-12-03 06:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-196679-4003916-1004.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-196679-4003916-1004.jpg saved to cache
2025-12-03 06:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 391b4f4c-6885-5c72-8cdf-5a04e9575729
2025-12-03 06:05:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a15b50bd-fd0c-5231-9cb4-a7e5f2ca9778 with identifier: 1859294
2025-12-03 06:05:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a15b50bd-fd0c-5231-9cb4-a7e5f2ca9778 with scrape type 2
2025-12-03 06:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a15b50bd-fd0c-5231-9cb4-a7e5f2ca9778 with scrape type 2
2025-12-03 06:05:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: a15b50bd-fd0c-5231-9cb4-a7e5f2ca9778, identifier: 1859294
2025-12-03 06:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-196679-4003916-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000196679-01983681-002.pdf)
2025-12-03 06:05:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: a15b50bd-fd0c-5231-9cb4-a7e5f2ca9778 with identifier: 1859294
2025-12-03 06:05:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: a15b50bd-fd0c-5231-9cb4-a7e5f2ca9778 with identifier: 1859294
2025-12-03 06:05:47 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': False, 'title': 'nissan qashqai 1.6 dci n-tec+ 5dr xtronic', 'price': 0, 'currency': 'gbp', 'make': 'nissan', 'model': 'qashqai', 'transmission': 'automatic', 'engine': '1.6l', 'fuel_type': 'diesel', 'odometer': 130214, 'odometer_reading_unit': 'mi', 'registration_date': '2015-09-15', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/nissan/qashqai?id=1859294', 'location': 'bristol', 'origin_country_code': 'gb', 'trim': '1.6 dci n-tec+ 5dr xtronic', 'license_plate': 'lt65utp', 'year': 2015, 'listing': 'auction', 'c_o_2_emission_value': 128, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0001859294-01977159-003.pdf', 'expiration_date': '2025-12-04t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': 'a15b50bd-fd0c-5231-9cb4-a7e5f2ca9778', 'current_year_diff': 10, 'age_in_months': 122, 'make_model': 'nissan qashqai', 'sanitized_make': 'nissan', 'odometer_in_km': 209558}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 122,
     'auction_title': '',
     'c_o_2_emission_value': 128,
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0001859294-01977159-003.pdf',
     'color': 'blue',
     'currency': 'gbp',
     'current_year_diff': 10,
     'engine': '1.6l',
     'expiration_date': '2025-12-04t09:00:00z',
     'fuel_type': 'diesel',
     'id': 'a15b50bd-fd0c-5231-9cb4-a7e5f2ca9778',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'lt65utp',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/nissan/qashqai?id=1859294',
     'listing': 'auction',
     'location': 'bristol',
     'make': 'nissan',
     'make_model': 'nissan qashqai',
     'model': 'qashqai',
     'odometer': 130214,
     'odometer_in_km': 209558,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2015-09-15',
     'sanitized_make': 'nissan',
     'seller_name': None,
     'title': 'nissan qashqai 1.6 dci n-tec+ 5dr xtronic',
     'transmission': 'automatic',
     'trim': '1.6 dci n-tec+ 5dr xtronic',
     'year': 2015}
2025-12-03 06:05:47 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: a15b50bd-fd0c-5231-9cb4-a7e5f2ca9778 spider: manheim.gb
2025-12-03 06:05:47 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: a15b50bd-fd0c-5231-9cb4-a7e5f2ca9778 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': False, 'title': 'nissan qashqai 1.6 dci n-tec+ 5dr xtronic', 'price': 0, 'currency': 'gbp', 'make': 'nissan', 'model': 'qashqai', 'transmission': 'automatic', 'engine': '1.6l', 'fuel_type': 'diesel', 'odometer': 130214, 'odometer_reading_unit': 'mi', 'registration_date': '2015-09-15', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/nissan/qashqai?id=1859294', 'location': 'bristol', 'origin_country_code': 'gb', 'trim': '1.6 dci n-tec+ 5dr xtronic', 'license_plate': 'lt65utp', 'year': 2015, 'listing': 'auction', 'c_o_2_emission_value': 128, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0001859294-01977159-003.pdf', 'expiration_date': '2025-12-04t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': 'a15b50bd-fd0c-5231-9cb4-a7e5f2ca9778', 'current_year_diff': 10, 'age_in_months': 122, 'make_model': 'nissan qashqai', 'sanitized_make': 'nissan', 'odometer_in_km': 209558}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 122,
     'auction_title': '',
     'c_o_2_emission_value': 128,
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0001859294-01977159-003.pdf',
     'color': 'blue',
     'currency': 'gbp',
     'current_year_diff': 10,
     'engine': '1.6l',
     'expiration_date': '2025-12-04t09:00:00z',
     'fuel_type': 'diesel',
     'id': 'a15b50bd-fd0c-5231-9cb4-a7e5f2ca9778',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'lt65utp',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/nissan/qashqai?id=1859294',
     'listing': 'auction',
     'location': 'bristol',
     'make': 'nissan',
     'make_model': 'nissan qashqai',
     'model': 'qashqai',
     'odometer': 130214,
     'odometer_in_km': 209558,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2015-09-15',
     'sanitized_make': 'nissan',
     'seller_name': None,
     'title': 'nissan qashqai 1.6 dci n-tec+ 5dr xtronic',
     'transmission': 'automatic',
     'trim': '1.6 dci n-tec+ 5dr xtronic',
     'year': 2015}
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001859294-01977159-003.pdf',
 'color': 'BLUE',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'a15b50bd-fd0c-5231-9cb4-a7e5f2ca9778',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'LT65UTP',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=1859294',
 'listing': 'auction',
 'location': 'Bristol',
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 130214,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-15',
 'seller_name': None,
 'title': 'NISSAN QASHQAI 1.6 dCi N-Tec+ 5dr Xtronic',
 'transmission': 'automatic',
 'trim': '1.6 dCi N-Tec+ 5dr Xtronic',
 'year': 2015}
2025-12-03 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271859294%27 HTTP/1.1" 200 None
2025-12-03 06:05:47 [manheim.gb] INFO: Saving data for 1859294: {'auction_closing_time': 1764838800.0, 'created_time': 1764584045.598769, 'last_price_update_time': 1764741947.508123}
2025-12-03 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1859294') HTTP/1.1" 204 0
2025-12-03 06:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1976170-3871875-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001976170-01815378-004.pdf)
2025-12-03 06:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1940647-4004272-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001940647-01984243-002.pdf)
2025-12-03 06:05:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f63a9e90>
2025-12-03 06:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_16.jpg HTTP/1.1" 201 0
2025-12-03 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2255216-4005331-1003.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2255216-4005331-1003.jpg saved to cache
2025-12-03 06:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item ea671044-60e2-5537-89a1-04ede30d8044
2025-12-03 06:05:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6140a10>
2025-12-03 06:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 06:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_15.jpg HTTP/1.1" 201 0
2025-12-03 06:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2255216-4005331-1002.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2255216-4005331-1002.jpg saved to cache
2025-12-03 06:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item ea671044-60e2-5537-89a1-04ede30d8044
2025-12-03 06:05:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f630f550>
2025-12-03 06:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 06:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd94fc1f-4992-5127-abe7-2438f2e64acd/fd94fc1f-4992-5127-abe7-2438f2e64acd_image_14.jpg HTTP/1.1" 201 0
2025-12-03 06:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1940647-4004272-1000.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1940647-4004272-1000.jpg saved to cache
2025-12-03 06:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item fd94fc1f-4992-5127-abe7-2438f2e64acd
2025-12-03 06:05:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6141e10>
2025-12-03 06:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 06:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_391b4f4c-6885-5c72-8cdf-5a04e9575729/391b4f4c-6885-5c72-8cdf-5a04e9575729_image_17.jpg HTTP/1.1" 201 0
2025-12-03 06:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-196679-4003916-1003.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-196679-4003916-1003.jpg saved to cache
2025-12-03 06:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 391b4f4c-6885-5c72-8cdf-5a04e9575729
2025-12-03 06:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-196679-4003916-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000196679-01983681-002.pdf)
2025-12-03 06:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1976170-3871875-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001976170-01815378-004.pdf)
2025-12-03 06:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2255216-4005331-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002255216-01981992-002.pdf)
2025-12-03 06:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/PEUGEOT/3008?id=1877473&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231877473&indx=68> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:05:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-196679-4003916-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000196679-01983681-002.pdf)
2025-12-03 06:05:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f605ef50>
2025-12-03 06:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8ec3d9f-037e-5080-8a18-a670d1eb7b38/b8ec3d9f-037e-5080-8a18-a670d1eb7b38_image_15.jpg HTTP/1.1" 201 0
2025-12-03 06:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1976170-3871875-1001.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1976170-3871875-1001.jpg saved to cache
2025-12-03 06:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item b8ec3d9f-037e-5080-8a18-a670d1eb7b38
2025-12-03 06:05:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6483e90>
2025-12-03 06:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 06:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd94fc1f-4992-5127-abe7-2438f2e64acd/fd94fc1f-4992-5127-abe7-2438f2e64acd_image_13.jpg HTTP/1.1" 201 0
2025-12-03 06:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1940647-4004272-13.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1940647-4004272-13.jpg saved to cache
2025-12-03 06:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item fd94fc1f-4992-5127-abe7-2438f2e64acd
2025-12-03 06:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2ed0b499-2114-4b85-97b2-37b2497e04ec_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001940647-01984243-002.pdf)
2025-12-03 06:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2255216-4005331-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002255216-01981992-002.pdf)
2025-12-03 06:05:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f5bc0990>
2025-12-03 06:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_391b4f4c-6885-5c72-8cdf-5a04e9575729/391b4f4c-6885-5c72-8cdf-5a04e9575729_image_16.jpg HTTP/1.1" 201 0
2025-12-03 06:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-196679-4003916-1002.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-196679-4003916-1002.jpg saved to cache
2025-12-03 06:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 391b4f4c-6885-5c72-8cdf-5a04e9575729
2025-12-03 06:05:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6057fd0>
2025-12-03 06:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8ec3d9f-037e-5080-8a18-a670d1eb7b38/b8ec3d9f-037e-5080-8a18-a670d1eb7b38_image_14.jpg HTTP/1.1" 201 0
2025-12-03 06:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1976170-3871875-1000.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1976170-3871875-1000.jpg saved to cache
2025-12-03 06:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item b8ec3d9f-037e-5080-8a18-a670d1eb7b38
2025-12-03 06:05:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6436210>
2025-12-03 06:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_14.jpg HTTP/1.1" 201 0
2025-12-03 06:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2255216-4005331-1001.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2255216-4005331-1001.jpg saved to cache
2025-12-03 06:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item ea671044-60e2-5537-89a1-04ede30d8044
2025-12-03 06:05:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94b69d29-057e-5615-9947-92f19df1ec23 with identifier: 1877473
2025-12-03 06:05:50 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 94b69d29-057e-5615-9947-92f19df1ec23
2025-12-03 06:05:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f60571d0>
2025-12-03 06:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_391b4f4c-6885-5c72-8cdf-5a04e9575729/391b4f4c-6885-5c72-8cdf-5a04e9575729_image_15.jpg HTTP/1.1" 201 0
2025-12-03 06:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-196679-4003916-1001.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-196679-4003916-1001.jpg saved to cache
2025-12-03 06:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 391b4f4c-6885-5c72-8cdf-5a04e9575729
2025-12-03 06:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2ed0b499-2114-4b85-97b2-37b2497e04ec_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001940647-01984243-002.pdf)
2025-12-03 06:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-196679-4003916-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000196679-01983681-002.pdf)
2025-12-03 06:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1976170-9999999-217150707-012.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001976170-01815378-004.pdf)
2025-12-03 06:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1976170-3871875-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001976170-01815378-004.pdf)
2025-12-03 06:05:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6104250>
2025-12-03 06:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd94fc1f-4992-5127-abe7-2438f2e64acd/fd94fc1f-4992-5127-abe7-2438f2e64acd_image_12.jpg HTTP/1.1" 201 0
2025-12-03 06:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2ed0b499-2114-4b85-97b2-37b2497e04ec_ext_4.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2ed0b499-2114-4b85-97b2-37b2497e04ec_ext_4.jpg saved to cache
2025-12-03 06:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item fd94fc1f-4992-5127-abe7-2438f2e64acd
2025-12-03 06:05:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f643da50>
2025-12-03 06:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_13.jpg HTTP/1.1" 201 0
2025-12-03 06:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2255216-4005331-1000.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2255216-4005331-1000.jpg saved to cache
2025-12-03 06:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item ea671044-60e2-5537-89a1-04ede30d8044
2025-12-03 06:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1976170-9999999-217150707-011.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001976170-01815378-004.pdf)
2025-12-03 06:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2255216-4005331-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002255216-01981992-002.pdf)
2025-12-03 06:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2ed0b499-2114-4b85-97b2-37b2497e04ec_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001940647-01984243-002.pdf)
2025-12-03 06:05:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f613dfd0>
2025-12-03 06:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 06:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd94fc1f-4992-5127-abe7-2438f2e64acd/fd94fc1f-4992-5127-abe7-2438f2e64acd_image_11.jpg HTTP/1.1" 201 0
2025-12-03 06:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2ed0b499-2114-4b85-97b2-37b2497e04ec_ext_3.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2ed0b499-2114-4b85-97b2-37b2497e04ec_ext_3.jpg saved to cache
2025-12-03 06:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item fd94fc1f-4992-5127-abe7-2438f2e64acd
2025-12-03 06:05:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f62afc10>
2025-12-03 06:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_391b4f4c-6885-5c72-8cdf-5a04e9575729/391b4f4c-6885-5c72-8cdf-5a04e9575729_image_14.jpg HTTP/1.1" 201 0
2025-12-03 06:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-196679-4003916-1000.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-196679-4003916-1000.jpg saved to cache
2025-12-03 06:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 391b4f4c-6885-5c72-8cdf-5a04e9575729
2025-12-03 06:05:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f87ba6d0>
2025-12-03 06:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8ec3d9f-037e-5080-8a18-a670d1eb7b38/b8ec3d9f-037e-5080-8a18-a670d1eb7b38_image_12.jpg HTTP/1.1" 201 0
2025-12-03 06:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1976170-9999999-217150707-012.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1976170-9999999-217150707-012.jpg saved to cache
2025-12-03 06:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item b8ec3d9f-037e-5080-8a18-a670d1eb7b38
2025-12-03 06:05:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f62293d0>
2025-12-03 06:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8ec3d9f-037e-5080-8a18-a670d1eb7b38/b8ec3d9f-037e-5080-8a18-a670d1eb7b38_image_13.jpg HTTP/1.1" 201 0
2025-12-03 06:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1976170-3871875-13.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1976170-3871875-13.jpg saved to cache
2025-12-03 06:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item b8ec3d9f-037e-5080-8a18-a670d1eb7b38
2025-12-03 06:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-196679-4003916-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000196679-01983681-002.pdf)
2025-12-03 06:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-012.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002255216-01981992-002.pdf)
2025-12-03 06:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2ed0b499-2114-4b85-97b2-37b2497e04ec_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001940647-01984243-002.pdf)
2025-12-03 06:05:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f61afbd0>
2025-12-03 06:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 06:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8ec3d9f-037e-5080-8a18-a670d1eb7b38/b8ec3d9f-037e-5080-8a18-a670d1eb7b38_image_11.jpg HTTP/1.1" 201 0
2025-12-03 06:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1976170-9999999-217150707-011.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1976170-9999999-217150707-011.jpg saved to cache
2025-12-03 06:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item b8ec3d9f-037e-5080-8a18-a670d1eb7b38
2025-12-03 06:05:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f624a1d0>
2025-12-03 06:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_12.jpg HTTP/1.1" 201 0
2025-12-03 06:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2255216-4005331-13.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2255216-4005331-13.jpg saved to cache
2025-12-03 06:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item ea671044-60e2-5537-89a1-04ede30d8044
2025-12-03 06:05:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f624a550>
2025-12-03 06:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd94fc1f-4992-5127-abe7-2438f2e64acd/fd94fc1f-4992-5127-abe7-2438f2e64acd_image_10.jpg HTTP/1.1" 201 0
2025-12-03 06:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2ed0b499-2114-4b85-97b2-37b2497e04ec_ext_5.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2ed0b499-2114-4b85-97b2-37b2497e04ec_ext_5.jpg saved to cache
2025-12-03 06:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item fd94fc1f-4992-5127-abe7-2438f2e64acd
2025-12-03 06:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c6b8d049-47d9-4be5-92e6-cb6861fc337b_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000196679-01983681-002.pdf)
2025-12-03 06:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1976170-9999999-217150707-010.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001976170-01815378-004.pdf)
2025-12-03 06:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/PEUGEOT/108?id=1835329&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231835329&indx=63> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-011.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002255216-01981992-002.pdf)
2025-12-03 06:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2ed0b499-2114-4b85-97b2-37b2497e04ec_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001940647-01984243-002.pdf)
2025-12-03 06:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c6b8d049-47d9-4be5-92e6-cb6861fc337b_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000196679-01983681-002.pdf)
2025-12-03 06:05:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f63c36d0>
2025-12-03 06:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_391b4f4c-6885-5c72-8cdf-5a04e9575729/391b4f4c-6885-5c72-8cdf-5a04e9575729_image_13.jpg HTTP/1.1" 201 0
2025-12-03 06:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-196679-4003916-13.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-196679-4003916-13.jpg saved to cache
2025-12-03 06:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 391b4f4c-6885-5c72-8cdf-5a04e9575729
2025-12-03 06:05:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6055c90>
2025-12-03 06:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_11.jpg HTTP/1.1" 201 0
2025-12-03 06:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2255216-9999999-336141851-012.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-012.jpg saved to cache
2025-12-03 06:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item ea671044-60e2-5537-89a1-04ede30d8044
2025-12-03 06:05:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6057b50>
2025-12-03 06:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd94fc1f-4992-5127-abe7-2438f2e64acd/fd94fc1f-4992-5127-abe7-2438f2e64acd_image_9.jpg HTTP/1.1" 201 0
2025-12-03 06:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2ed0b499-2114-4b85-97b2-37b2497e04ec_ext_2.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2ed0b499-2114-4b85-97b2-37b2497e04ec_ext_2.jpg saved to cache
2025-12-03 06:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fd94fc1f-4992-5127-abe7-2438f2e64acd
2025-12-03 06:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1976170-9999999-217150707-009.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001976170-01815378-004.pdf)
2025-12-03 06:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/TIGUAN?id=1856076&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231856076&indx=65> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c6b8d049-47d9-4be5-92e6-cb6861fc337b_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000196679-01983681-002.pdf)
2025-12-03 06:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-010.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002255216-01981992-002.pdf)
2025-12-03 06:05:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f600d190>
2025-12-03 06:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_391b4f4c-6885-5c72-8cdf-5a04e9575729/391b4f4c-6885-5c72-8cdf-5a04e9575729_image_12.jpg HTTP/1.1" 201 0
2025-12-03 06:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc6b8d049-47d9-4be5-92e6-cb6861fc337b_ext_4.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c6b8d049-47d9-4be5-92e6-cb6861fc337b_ext_4.jpg saved to cache
2025-12-03 06:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 391b4f4c-6885-5c72-8cdf-5a04e9575729
2025-12-03 06:05:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f5b68150>
2025-12-03 06:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8ec3d9f-037e-5080-8a18-a670d1eb7b38/b8ec3d9f-037e-5080-8a18-a670d1eb7b38_image_10.jpg HTTP/1.1" 201 0
2025-12-03 06:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1976170-9999999-217150707-010.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1976170-9999999-217150707-010.jpg saved to cache
2025-12-03 06:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item b8ec3d9f-037e-5080-8a18-a670d1eb7b38
2025-12-03 06:05:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d4df0fa-98da-5d45-bc17-84c3ed423fbe with identifier: 1835329
2025-12-03 06:05:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d4df0fa-98da-5d45-bc17-84c3ed423fbe with scrape type 2
2025-12-03 06:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d4df0fa-98da-5d45-bc17-84c3ed423fbe with scrape type 2
2025-12-03 06:05:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 1d4df0fa-98da-5d45-bc17-84c3ed423fbe, identifier: 1835329
2025-12-03 06:05:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6085010>
2025-12-03 06:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_10.jpg HTTP/1.1" 201 0
2025-12-03 06:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2255216-9999999-336141851-011.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-011.jpg saved to cache
2025-12-03 06:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item ea671044-60e2-5537-89a1-04ede30d8044
2025-12-03 06:05:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6376810>
2025-12-03 06:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd94fc1f-4992-5127-abe7-2438f2e64acd/fd94fc1f-4992-5127-abe7-2438f2e64acd_image_8.jpg HTTP/1.1" 201 0
2025-12-03 06:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2ed0b499-2114-4b85-97b2-37b2497e04ec_9.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2ed0b499-2114-4b85-97b2-37b2497e04ec_9.jpg saved to cache
2025-12-03 06:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fd94fc1f-4992-5127-abe7-2438f2e64acd
2025-12-03 06:05:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f52dac10>
2025-12-03 06:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 06:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_391b4f4c-6885-5c72-8cdf-5a04e9575729/391b4f4c-6885-5c72-8cdf-5a04e9575729_image_11.jpg HTTP/1.1" 201 0
2025-12-03 06:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc6b8d049-47d9-4be5-92e6-cb6861fc337b_ext_3.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c6b8d049-47d9-4be5-92e6-cb6861fc337b_ext_3.jpg saved to cache
2025-12-03 06:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 391b4f4c-6885-5c72-8cdf-5a04e9575729
2025-12-03 06:05:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 1d4df0fa-98da-5d45-bc17-84c3ed423fbe with identifier: 1835329
2025-12-03 06:05:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 1d4df0fa-98da-5d45-bc17-84c3ed423fbe with identifier: 1835329
2025-12-03 06:05:56 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 1d4df0fa-98da-5d45-bc17-84c3ed423fbe with identifier: 1835329 to the API
2025-12-03 06:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 06:05:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 06:05:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/PEUGEOT/108?id=1835329&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231835329&indx=63>
{'auction_title': '',
 'c_o_2_emission_value': 95,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001835329-01984636-003.pdf',
 'color': 'BLUE',
 'currency': 'GBP',
 'engine': '1.0L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '1d4df0fa-98da-5d45-bc17-84c3ed423fbe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'LF17KLP',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/PEUGEOT/108?id=1835329',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'PEUGEOT',
 'model': '108',
 'odometer': 75018,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-19',
 'seller_name': 'DIRECT HEALTHCARE COMPANY',
 'title': 'PEUGEOT 108 1.0 Active 3dr',
 'transmission': 'manual',
 'trim': '1.0 Active 3dr',
 'year': 2017}
2025-12-03 06:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271835329%27 HTTP/1.1" 200 None
2025-12-03 06:05:56 [manheim.gb] INFO: Saving data for 1835329: {'auction_closing_time': 1764838800.0, 'created_time': 1764584049.195568, 'last_price_update_time': 1764741956.524392}
2025-12-03 06:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1835329') HTTP/1.1" 204 0
2025-12-03 06:05:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f645e990>
2025-12-03 06:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8ec3d9f-037e-5080-8a18-a670d1eb7b38/b8ec3d9f-037e-5080-8a18-a670d1eb7b38_image_9.jpg HTTP/1.1" 201 0
2025-12-03 06:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1976170-9999999-217150707-009.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1976170-9999999-217150707-009.jpg saved to cache
2025-12-03 06:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b8ec3d9f-037e-5080-8a18-a670d1eb7b38
2025-12-03 06:05:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17393bf4-8b87-575f-90cc-271c21397470 with identifier: 1856076
2025-12-03 06:05:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17393bf4-8b87-575f-90cc-271c21397470 with scrape type 2
2025-12-03 06:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17393bf4-8b87-575f-90cc-271c21397470 with scrape type 2
2025-12-03 06:05:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 17393bf4-8b87-575f-90cc-271c21397470, identifier: 1856076
2025-12-03 06:05:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f5b6b4d0>
2025-12-03 06:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_391b4f4c-6885-5c72-8cdf-5a04e9575729/391b4f4c-6885-5c72-8cdf-5a04e9575729_image_10.jpg HTTP/1.1" 201 0
2025-12-03 06:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc6b8d049-47d9-4be5-92e6-cb6861fc337b_ext_5.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c6b8d049-47d9-4be5-92e6-cb6861fc337b_ext_5.jpg saved to cache
2025-12-03 06:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 391b4f4c-6885-5c72-8cdf-5a04e9575729
2025-12-03 06:05:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f63b1b10>
2025-12-03 06:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 06:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_9.jpg HTTP/1.1" 201 0
2025-12-03 06:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2255216-9999999-336141851-010.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-010.jpg saved to cache
2025-12-03 06:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ea671044-60e2-5537-89a1-04ede30d8044
2025-12-03 06:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2ed0b499-2114-4b85-97b2-37b2497e04ec_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001940647-01984243-002.pdf)
2025-12-03 06:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2ed0b499-2114-4b85-97b2-37b2497e04ec_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001940647-01984243-002.pdf)
2025-12-03 06:05:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 17393bf4-8b87-575f-90cc-271c21397470 with identifier: 1856076
2025-12-03 06:05:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 17393bf4-8b87-575f-90cc-271c21397470 with identifier: 1856076
2025-12-03 06:05:57 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 185181 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    185181
2025-12-03 06:05:57 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 17393bf4-8b87-575f-90cc-271c21397470 spider: manheim.gb
2025-12-03 06:05:57 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 17393bf4-8b87-575f-90cc-271c21397470 due to rule: high_mileage_for_country.json, error: 185181 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    185181
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001856076-01977163-004.pdf',
 'color': 'SILVER',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '17393bf4-8b87-575f-90cc-271c21397470',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'SF15LTJ',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/TIGUAN?id=1856076',
 'listing': 'auction',
 'location': 'Bristol',
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN',
 'odometer': 115067,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-15',
 'seller_name': 'Baylis',
 'title': 'VOLKSWAGEN TIGUAN 2.0 TDi BlueMotion Tech Match 177 5dr DSG',
 'transmission': 'automatic',
 'trim': '2.0 TDi BlueMotion Tech Match 177 5dr DSG',
 'year': 2015}
2025-12-03 06:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271856076%27 HTTP/1.1" 200 None
2025-12-03 06:05:57 [manheim.gb] INFO: Saving data for 1856076: {'auction_closing_time': 1764838800.0, 'created_time': 1764584029.498309, 'last_price_update_time': 1764741957.792335}
2025-12-03 06:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1856076') HTTP/1.1" 204 0
2025-12-03 06:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c6b8d049-47d9-4be5-92e6-cb6861fc337b_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000196679-01983681-002.pdf)
2025-12-03 06:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-009.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002255216-01981992-002.pdf)
2025-12-03 06:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1976170-9999999-217150707-006.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001976170-01815378-004.pdf)
2025-12-03 06:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1976170-9999999-217150707-007.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001976170-01815378-004.pdf)
2025-12-03 06:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-007.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002255216-01981992-002.pdf)
2025-12-03 06:05:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f61d80d0>
2025-12-03 06:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd94fc1f-4992-5127-abe7-2438f2e64acd/fd94fc1f-4992-5127-abe7-2438f2e64acd_image_7.jpg HTTP/1.1" 201 0
2025-12-03 06:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2ed0b499-2114-4b85-97b2-37b2497e04ec_10.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2ed0b499-2114-4b85-97b2-37b2497e04ec_10.jpg saved to cache
2025-12-03 06:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fd94fc1f-4992-5127-abe7-2438f2e64acd
2025-12-03 06:05:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f624a750>
2025-12-03 06:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 06:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd94fc1f-4992-5127-abe7-2438f2e64acd/fd94fc1f-4992-5127-abe7-2438f2e64acd_image_6.jpg HTTP/1.1" 201 0
2025-12-03 06:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2ed0b499-2114-4b85-97b2-37b2497e04ec_11.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2ed0b499-2114-4b85-97b2-37b2497e04ec_11.jpg saved to cache
2025-12-03 06:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fd94fc1f-4992-5127-abe7-2438f2e64acd
2025-12-03 06:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c6b8d049-47d9-4be5-92e6-cb6861fc337b_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000196679-01983681-002.pdf)
2025-12-03 06:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2ed0b499-2114-4b85-97b2-37b2497e04ec_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001940647-01984243-002.pdf)
2025-12-03 06:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2ed0b499-2114-4b85-97b2-37b2497e04ec_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001940647-01984243-002.pdf)
2025-12-03 06:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c6b8d049-47d9-4be5-92e6-cb6861fc337b_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000196679-01983681-002.pdf)
2025-12-03 06:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-006.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002255216-01981992-002.pdf)
2025-12-03 06:05:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f7a45810>
2025-12-03 06:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_391b4f4c-6885-5c72-8cdf-5a04e9575729/391b4f4c-6885-5c72-8cdf-5a04e9575729_image_9.jpg HTTP/1.1" 201 0
2025-12-03 06:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc6b8d049-47d9-4be5-92e6-cb6861fc337b_ext_2.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c6b8d049-47d9-4be5-92e6-cb6861fc337b_ext_2.jpg saved to cache
2025-12-03 06:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 391b4f4c-6885-5c72-8cdf-5a04e9575729
2025-12-03 06:05:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f633a910>
2025-12-03 06:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_8.jpg HTTP/1.1" 201 0
2025-12-03 06:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2255216-9999999-336141851-009.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-009.jpg saved to cache
2025-12-03 06:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ea671044-60e2-5537-89a1-04ede30d8044
2025-12-03 06:05:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6322f50>
2025-12-03 06:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8ec3d9f-037e-5080-8a18-a670d1eb7b38/b8ec3d9f-037e-5080-8a18-a670d1eb7b38_image_7.jpg HTTP/1.1" 201 0
2025-12-03 06:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1976170-9999999-217150707-006.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1976170-9999999-217150707-006.jpg saved to cache
2025-12-03 06:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b8ec3d9f-037e-5080-8a18-a670d1eb7b38
2025-12-03 06:05:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f5bc1650>
2025-12-03 06:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 06:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8ec3d9f-037e-5080-8a18-a670d1eb7b38/b8ec3d9f-037e-5080-8a18-a670d1eb7b38_image_8.jpg HTTP/1.1" 201 0
2025-12-03 06:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1976170-9999999-217150707-007.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1976170-9999999-217150707-007.jpg saved to cache
2025-12-03 06:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b8ec3d9f-037e-5080-8a18-a670d1eb7b38
2025-12-03 06:05:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6301710>
2025-12-03 06:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:05:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_7.jpg HTTP/1.1" 201 0
2025-12-03 06:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2255216-9999999-336141851-007.jpg') HTTP/1.1" 204 0
2025-12-03 06:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-007.jpg saved to cache
2025-12-03 06:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ea671044-60e2-5537-89a1-04ede30d8044
2025-12-03 06:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1976170-9999999-217150707-005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001976170-01815378-004.pdf)
2025-12-03 06:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c6b8d049-47d9-4be5-92e6-cb6861fc337b_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000196679-01983681-002.pdf)
2025-12-03 06:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002255216-01981992-002.pdf)
2025-12-03 06:05:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:05:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f7a2f590>
2025-12-03 06:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_391b4f4c-6885-5c72-8cdf-5a04e9575729/391b4f4c-6885-5c72-8cdf-5a04e9575729_image_8.jpg HTTP/1.1" 201 0
2025-12-03 06:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc6b8d049-47d9-4be5-92e6-cb6861fc337b_9.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c6b8d049-47d9-4be5-92e6-cb6861fc337b_9.jpg saved to cache
2025-12-03 06:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 391b4f4c-6885-5c72-8cdf-5a04e9575729
2025-12-03 06:06:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f637f950>
2025-12-03 06:06:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd94fc1f-4992-5127-abe7-2438f2e64acd/fd94fc1f-4992-5127-abe7-2438f2e64acd_image_4.jpg HTTP/1.1" 201 0
2025-12-03 06:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2ed0b499-2114-4b85-97b2-37b2497e04ec_5.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2ed0b499-2114-4b85-97b2-37b2497e04ec_5.jpg saved to cache
2025-12-03 06:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fd94fc1f-4992-5127-abe7-2438f2e64acd
2025-12-03 06:06:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6467ad0>
2025-12-03 06:06:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd94fc1f-4992-5127-abe7-2438f2e64acd/fd94fc1f-4992-5127-abe7-2438f2e64acd_image_5.jpg HTTP/1.1" 201 0
2025-12-03 06:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2ed0b499-2114-4b85-97b2-37b2497e04ec_4.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2ed0b499-2114-4b85-97b2-37b2497e04ec_4.jpg saved to cache
2025-12-03 06:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fd94fc1f-4992-5127-abe7-2438f2e64acd
2025-12-03 06:06:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6465490>
2025-12-03 06:06:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_391b4f4c-6885-5c72-8cdf-5a04e9575729/391b4f4c-6885-5c72-8cdf-5a04e9575729_image_7.jpg HTTP/1.1" 201 0
2025-12-03 06:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc6b8d049-47d9-4be5-92e6-cb6861fc337b_10.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c6b8d049-47d9-4be5-92e6-cb6861fc337b_10.jpg saved to cache
2025-12-03 06:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 391b4f4c-6885-5c72-8cdf-5a04e9575729
2025-12-03 06:06:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f5231290>
2025-12-03 06:06:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 06:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_6.jpg HTTP/1.1" 201 0
2025-12-03 06:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2255216-9999999-336141851-006.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-006.jpg saved to cache
2025-12-03 06:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ea671044-60e2-5537-89a1-04ede30d8044
2025-12-03 06:06:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f61eb410>
2025-12-03 06:06:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 06:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8ec3d9f-037e-5080-8a18-a670d1eb7b38/b8ec3d9f-037e-5080-8a18-a670d1eb7b38_image_6.jpg HTTP/1.1" 201 0
2025-12-03 06:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1976170-9999999-217150707-005.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1976170-9999999-217150707-005.jpg saved to cache
2025-12-03 06:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b8ec3d9f-037e-5080-8a18-a670d1eb7b38
2025-12-03 06:06:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f52ca350>
2025-12-03 06:06:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_391b4f4c-6885-5c72-8cdf-5a04e9575729/391b4f4c-6885-5c72-8cdf-5a04e9575729_image_6.jpg HTTP/1.1" 201 0
2025-12-03 06:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc6b8d049-47d9-4be5-92e6-cb6861fc337b_11.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c6b8d049-47d9-4be5-92e6-cb6861fc337b_11.jpg saved to cache
2025-12-03 06:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 391b4f4c-6885-5c72-8cdf-5a04e9575729
2025-12-03 06:06:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f659df10>
2025-12-03 06:06:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:06:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_5.jpg HTTP/1.1" 201 0
2025-12-03 06:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2255216-9999999-336141851-005.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-005.jpg saved to cache
2025-12-03 06:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ea671044-60e2-5537-89a1-04ede30d8044
2025-12-03 06:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2ed0b499-2114-4b85-97b2-37b2497e04ec_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001940647-01984243-002.pdf)
2025-12-03 06:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c6b8d049-47d9-4be5-92e6-cb6861fc337b_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000196679-01983681-002.pdf)
2025-12-03 06:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0001877473-01989665-002.pdf> (referer: None)
2025-12-03 06:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002255216-01981992-002.pdf)
2025-12-03 06:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1976170-9999999-217150707-003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001976170-01815378-004.pdf)
2025-12-03 06:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1976170-9999999-217150707-001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001976170-01815378-004.pdf)
2025-12-03 06:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0001912686-01985791-002.pdf> (referer: None)
2025-12-03 06:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1976170-9999999-217150707-002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001976170-01815378-004.pdf)
2025-12-03 06:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002255216-01981992-002.pdf)
2025-12-03 06:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2ed0b499-2114-4b85-97b2-37b2497e04ec_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001940647-01984243-002.pdf)
2025-12-03 06:06:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f659f310>
2025-12-03 06:06:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:06:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd94fc1f-4992-5127-abe7-2438f2e64acd/fd94fc1f-4992-5127-abe7-2438f2e64acd_image_3.jpg HTTP/1.1" 201 0
2025-12-03 06:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2ed0b499-2114-4b85-97b2-37b2497e04ec_ext_1.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2ed0b499-2114-4b85-97b2-37b2497e04ec_ext_1.jpg saved to cache
2025-12-03 06:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fd94fc1f-4992-5127-abe7-2438f2e64acd
2025-12-03 06:06:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f65ae8d0>
2025-12-03 06:06:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:06:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_391b4f4c-6885-5c72-8cdf-5a04e9575729/391b4f4c-6885-5c72-8cdf-5a04e9575729_image_5.jpg HTTP/1.1" 201 0
2025-12-03 06:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc6b8d049-47d9-4be5-92e6-cb6861fc337b_4.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c6b8d049-47d9-4be5-92e6-cb6861fc337b_4.jpg saved to cache
2025-12-03 06:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 391b4f4c-6885-5c72-8cdf-5a04e9575729
2025-12-03 06:06:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6445750>
2025-12-03 06:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 06:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94b69d29-057e-5615-9947-92f19df1ec23/94b69d29-057e-5615-9947-92f19df1ec23_expert_report_file_c2efaee9-f08e-4364-863f-14ccefdcbe83.pdf HTTP/1.1" 201 0
2025-12-03 06:06:03 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 94b69d29-057e-5615-9947-92f19df1ec23
2025-12-03 06:06:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 94b69d29-057e-5615-9947-92f19df1ec23, skipping ID generation
2025-12-03 06:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 94b69d29-057e-5615-9947-92f19df1ec23
2025-12-03 06:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdc089fca-4db0-4844-a59b-0ea34365f4f5_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dc089fca-4db0-4844-a59b-0ea34365f4f5_ext_7.jpg not downloaded yet
2025-12-03 06:06:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f64831d0>
2025-12-03 06:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_4.jpg HTTP/1.1" 201 0
2025-12-03 06:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2255216-9999999-336141851-003.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-003.jpg saved to cache
2025-12-03 06:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ea671044-60e2-5537-89a1-04ede30d8044
2025-12-03 06:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1976170-9999999-217150707-008.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001976170-01815378-004.pdf)
2025-12-03 06:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c6b8d049-47d9-4be5-92e6-cb6861fc337b_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000196679-01983681-002.pdf)
2025-12-03 06:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2ed0b499-2114-4b85-97b2-37b2497e04ec_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001940647-01984243-002.pdf)
2025-12-03 06:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2ed0b499-2114-4b85-97b2-37b2497e04ec_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001940647-01984243-002.pdf)
2025-12-03 06:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdc089fca-4db0-4844-a59b-0ea34365f4f5_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dc089fca-4db0-4844-a59b-0ea34365f4f5_ext_7.jpg not downloaded yet
2025-12-03 06:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c6b8d049-47d9-4be5-92e6-cb6861fc337b_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000196679-01983681-002.pdf)
2025-12-03 06:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002255216-01981992-002.pdf)
2025-12-03 06:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/FORD/FOCUS?id=1825401&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231825401&indx=61> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:06:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f642f550>
2025-12-03 06:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:06:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8ec3d9f-037e-5080-8a18-a670d1eb7b38/b8ec3d9f-037e-5080-8a18-a670d1eb7b38_image_5.jpg HTTP/1.1" 201 0
2025-12-03 06:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1976170-9999999-217150707-003.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1976170-9999999-217150707-003.jpg saved to cache
2025-12-03 06:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b8ec3d9f-037e-5080-8a18-a670d1eb7b38
2025-12-03 06:06:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6197810>
2025-12-03 06:06:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:06:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8ec3d9f-037e-5080-8a18-a670d1eb7b38/b8ec3d9f-037e-5080-8a18-a670d1eb7b38_image_3.jpg HTTP/1.1" 201 0
2025-12-03 06:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1976170-9999999-217150707-001.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1976170-9999999-217150707-001.jpg saved to cache
2025-12-03 06:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b8ec3d9f-037e-5080-8a18-a670d1eb7b38
2025-12-03 06:06:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f5b420d0>
2025-12-03 06:06:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:06:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1b26391-08cb-5b60-9737-ef0afa324128/f1b26391-08cb-5b60-9737-ef0afa324128_expert_report_file_f64907e2-886c-4dea-a693-53eda0a1c5b3.pdf HTTP/1.1" 201 0
2025-12-03 06:06:04 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item f1b26391-08cb-5b60-9737-ef0afa324128
2025-12-03 06:06:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f1b26391-08cb-5b60-9737-ef0afa324128, skipping ID generation
2025-12-03 06:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item f1b26391-08cb-5b60-9737-ef0afa324128
2025-12-03 06:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F30f54bb8-6876-40ff-97d0-3b6f9a16409f_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/30f54bb8-6876-40ff-97d0-3b6f9a16409f_ext_7.jpg not downloaded yet
2025-12-03 06:06:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f65aea10>
2025-12-03 06:06:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8ec3d9f-037e-5080-8a18-a670d1eb7b38/b8ec3d9f-037e-5080-8a18-a670d1eb7b38_image_4.jpg HTTP/1.1" 201 0
2025-12-03 06:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1976170-9999999-217150707-002.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1976170-9999999-217150707-002.jpg saved to cache
2025-12-03 06:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b8ec3d9f-037e-5080-8a18-a670d1eb7b38
2025-12-03 06:06:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6262890>
2025-12-03 06:06:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_3.jpg HTTP/1.1" 201 0
2025-12-03 06:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2255216-9999999-336141851-002.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-002.jpg saved to cache
2025-12-03 06:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ea671044-60e2-5537-89a1-04ede30d8044
2025-12-03 06:06:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6130f50>
2025-12-03 06:06:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd94fc1f-4992-5127-abe7-2438f2e64acd/fd94fc1f-4992-5127-abe7-2438f2e64acd_image_2.jpg HTTP/1.1" 201 0
2025-12-03 06:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2ed0b499-2114-4b85-97b2-37b2497e04ec_ext_6.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2ed0b499-2114-4b85-97b2-37b2497e04ec_ext_6.jpg saved to cache
2025-12-03 06:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fd94fc1f-4992-5127-abe7-2438f2e64acd
2025-12-03 06:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdc089fca-4db0-4844-a59b-0ea34365f4f5_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dc089fca-4db0-4844-a59b-0ea34365f4f5_ext_6.jpg not downloaded yet
2025-12-03 06:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F30f54bb8-6876-40ff-97d0-3b6f9a16409f_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/30f54bb8-6876-40ff-97d0-3b6f9a16409f_ext_7.jpg not downloaded yet
2025-12-03 06:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdc089fca-4db0-4844-a59b-0ea34365f4f5_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dc089fca-4db0-4844-a59b-0ea34365f4f5_ext_1.jpg not downloaded yet
2025-12-03 06:06:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/RENAULT/CAPTUR?id=1815539&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231815539&indx=60> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:06:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f62a5d50>
2025-12-03 06:06:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8ec3d9f-037e-5080-8a18-a670d1eb7b38/b8ec3d9f-037e-5080-8a18-a670d1eb7b38_image_2.jpg HTTP/1.1" 201 0
2025-12-03 06:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1976170-9999999-217150707-008.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1976170-9999999-217150707-008.jpg saved to cache
2025-12-03 06:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b8ec3d9f-037e-5080-8a18-a670d1eb7b38
2025-12-03 06:06:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f62a7b50>
2025-12-03 06:06:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:06:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_391b4f4c-6885-5c72-8cdf-5a04e9575729/391b4f4c-6885-5c72-8cdf-5a04e9575729_image_4.jpg HTTP/1.1" 201 0
2025-12-03 06:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc6b8d049-47d9-4be5-92e6-cb6861fc337b_5.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c6b8d049-47d9-4be5-92e6-cb6861fc337b_5.jpg saved to cache
2025-12-03 06:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 391b4f4c-6885-5c72-8cdf-5a04e9575729
2025-12-03 06:06:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f620b410>
2025-12-03 06:06:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 06:06:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd94fc1f-4992-5127-abe7-2438f2e64acd/fd94fc1f-4992-5127-abe7-2438f2e64acd_image_0.jpg HTTP/1.1" 201 0
2025-12-03 06:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2ed0b499-2114-4b85-97b2-37b2497e04ec_ext_7.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2ed0b499-2114-4b85-97b2-37b2497e04ec_ext_7.jpg saved to cache
2025-12-03 06:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fd94fc1f-4992-5127-abe7-2438f2e64acd
2025-12-03 06:06:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f603ec90>
2025-12-03 06:06:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 06:06:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd94fc1f-4992-5127-abe7-2438f2e64acd/fd94fc1f-4992-5127-abe7-2438f2e64acd_image_1.jpg HTTP/1.1" 201 0
2025-12-03 06:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2ed0b499-2114-4b85-97b2-37b2497e04ec_ext_7.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2ed0b499-2114-4b85-97b2-37b2497e04ec_ext_7.jpg saved to cache
2025-12-03 06:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fd94fc1f-4992-5127-abe7-2438f2e64acd
2025-12-03 06:06:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fd94fc1f-4992-5127-abe7-2438f2e64acd, skipping ID generation
2025-12-03 06:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Removing item fd94fc1f-4992-5127-abe7-2438f2e64acd from tracking dictionaries
2025-12-03 06:06:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fd94fc1f-4992-5127-abe7-2438f2e64acd sending to next pipeline
2025-12-03 06:06:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: fd94fc1f-4992-5127-abe7-2438f2e64acd, identifier: 1940647
2025-12-03 06:06:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6022bd0>
2025-12-03 06:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 06:06:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_391b4f4c-6885-5c72-8cdf-5a04e9575729/391b4f4c-6885-5c72-8cdf-5a04e9575729_image_3.jpg HTTP/1.1" 201 0
2025-12-03 06:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc6b8d049-47d9-4be5-92e6-cb6861fc337b_ext_1.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c6b8d049-47d9-4be5-92e6-cb6861fc337b_ext_1.jpg saved to cache
2025-12-03 06:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 391b4f4c-6885-5c72-8cdf-5a04e9575729
2025-12-03 06:06:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f63f7810>
2025-12-03 06:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 06:06:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_2.jpg HTTP/1.1" 201 0
2025-12-03 06:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2255216-9999999-336141851-001.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-001.jpg saved to cache
2025-12-03 06:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ea671044-60e2-5537-89a1-04ede30d8044
2025-12-03 06:06:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 039c8b0d-da08-5360-b8ff-457fa96fc80e with identifier: 1825401
2025-12-03 06:06:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 039c8b0d-da08-5360-b8ff-457fa96fc80e with scrape type 2
2025-12-03 06:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 039c8b0d-da08-5360-b8ff-457fa96fc80e with scrape type 2
2025-12-03 06:06:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 039c8b0d-da08-5360-b8ff-457fa96fc80e, identifier: 1825401
2025-12-03 06:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F30f54bb8-6876-40ff-97d0-3b6f9a16409f_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/30f54bb8-6876-40ff-97d0-3b6f9a16409f_ext_6.jpg not downloaded yet
2025-12-03 06:06:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: fd94fc1f-4992-5127-abe7-2438f2e64acd with identifier: 1940647
2025-12-03 06:06:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: fd94fc1f-4992-5127-abe7-2438f2e64acd with identifier: 1940647
2025-12-03 06:06:08 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: fd94fc1f-4992-5127-abe7-2438f2e64acd with identifier: 1940647 to the API
2025-12-03 06:06:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 06:06:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 06:06:08 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/2ed0b499-2114-4b85-97b2-37b2497e04ec_ext_7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd94fc1f-4992-5127-abe7-2438f2e64acd/fd94fc1f-4992-5127-abe7-2438f2e64acd_expert_report_file_734783b2-faf8-4e12-b591-7f530d95ef8a.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001940647-01984243-002.pdf',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': '2025-12-03T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'fd94fc1f-4992-5127-abe7-2438f2e64acd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'BG17XAW',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/CITROEN/C1?id=1940647',
 'listing': 'auction',
 'location': 'Leeds',
 'make': 'CITROEN',
 'model': 'C1',
 'odometer': 91107,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 31,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd94fc1f-4992-5127-abe7-2438f2e64acd/fd94fc1f-4992-5127-abe7-2438f2e64acd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 187319,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2ed0b499-2114-4b85-97b2-37b2497e04ec_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd94fc1f-4992-5127-abe7-2438f2e64acd/fd94fc1f-4992-5127-abe7-2438f2e64acd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 187319,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2ed0b499-2114-4b85-97b2-37b2497e04ec_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd94fc1f-4992-5127-abe7-2438f2e64acd/fd94fc1f-4992-5127-abe7-2438f2e64acd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 218731,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2ed0b499-2114-4b85-97b2-37b2497e04ec_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd94fc1f-4992-5127-abe7-2438f2e64acd/fd94fc1f-4992-5127-abe7-2438f2e64acd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 191659,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2ed0b499-2114-4b85-97b2-37b2497e04ec_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd94fc1f-4992-5127-abe7-2438f2e64acd/fd94fc1f-4992-5127-abe7-2438f2e64acd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 155744,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2ed0b499-2114-4b85-97b2-37b2497e04ec_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd94fc1f-4992-5127-abe7-2438f2e64acd/fd94fc1f-4992-5127-abe7-2438f2e64acd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 158838,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2ed0b499-2114-4b85-97b2-37b2497e04ec_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd94fc1f-4992-5127-abe7-2438f2e64acd/fd94fc1f-4992-5127-abe7-2438f2e64acd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 157368,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2ed0b499-2114-4b85-97b2-37b2497e04ec_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd94fc1f-4992-5127-abe7-2438f2e64acd/fd94fc1f-4992-5127-abe7-2438f2e64acd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 168966,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2ed0b499-2114-4b85-97b2-37b2497e04ec_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd94fc1f-4992-5127-abe7-2438f2e64acd/fd94fc1f-4992-5127-abe7-2438f2e64acd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 163643,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2ed0b499-2114-4b85-97b2-37b2497e04ec_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd94fc1f-4992-5127-abe7-2438f2e64acd/fd94fc1f-4992-5127-abe7-2438f2e64acd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 208008,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2ed0b499-2114-4b85-97b2-37b2497e04ec_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd94fc1f-4992-5127-abe7-2438f2e64acd/fd94fc1f-4992-5127-abe7-2438f2e64acd_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 170384,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2ed0b499-2114-4b85-97b2-37b2497e04ec_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd94fc1f-4992-5127-abe7-2438f2e64acd/fd94fc1f-4992-5127-abe7-2438f2e64acd_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 327214,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2ed0b499-2114-4b85-97b2-37b2497e04ec_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd94fc1f-4992-5127-abe7-2438f2e64acd/fd94fc1f-4992-5127-abe7-2438f2e64acd_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 213380,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2ed0b499-2114-4b85-97b2-37b2497e04ec_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd94fc1f-4992-5127-abe7-2438f2e64acd/fd94fc1f-4992-5127-abe7-2438f2e64acd_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 221295,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1940647-4004272-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd94fc1f-4992-5127-abe7-2438f2e64acd/fd94fc1f-4992-5127-abe7-2438f2e64acd_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 238442,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1940647-4004272-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd94fc1f-4992-5127-abe7-2438f2e64acd/fd94fc1f-4992-5127-abe7-2438f2e64acd_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45372,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1940647-4004272-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd94fc1f-4992-5127-abe7-2438f2e64acd/fd94fc1f-4992-5127-abe7-2438f2e64acd_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 256274,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1940647-4004272-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd94fc1f-4992-5127-abe7-2438f2e64acd/fd94fc1f-4992-5127-abe7-2438f2e64acd_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 264479,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1940647-4004272-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd94fc1f-4992-5127-abe7-2438f2e64acd/fd94fc1f-4992-5127-abe7-2438f2e64acd_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 182720,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1940647-4004272-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd94fc1f-4992-5127-abe7-2438f2e64acd/fd94fc1f-4992-5127-abe7-2438f2e64acd_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 240702,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1940647-4004272-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-31',
 'seller_name': 'Perrys',
 'title': 'CITROEN C1 1.2 PureTech Flair 5dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech Flair 5dr',
 'year': 2017}
2025-12-03 06:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271940647%27 HTTP/1.1" 200 None
2025-12-03 06:06:08 [manheim.gb] INFO: Saving data for 1940647: {'created_time': 1764741968.333648, 'last_price_update_time': 1764741968.33366, 'auction_closing_time': 1764752400.0}
2025-12-03 06:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1940647') HTTP/1.1" 204 0
2025-12-03 06:06:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 039c8b0d-da08-5360-b8ff-457fa96fc80e with identifier: 1825401
2025-12-03 06:06:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 039c8b0d-da08-5360-b8ff-457fa96fc80e with identifier: 1825401
2025-12-03 06:06:08 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 10 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    10
2025-12-03 06:06:08 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: 039c8b0d-da08-5360-b8ff-457fa96fc80e spider: manheim.gb
2025-12-03 06:06:08 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 039c8b0d-da08-5360-b8ff-457fa96fc80e due to rule: registration_date_old.json, error: 10 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    10
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001825401-01984710-004.pdf',
 'color': 'Silver',
 'currency': 'GBP',
 'engine': '1.0L',
 'expiration_date': '2025-12-03T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '039c8b0d-da08-5360-b8ff-457fa96fc80e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'DF65WRR',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FORD/FOCUS?id=1825401',
 'listing': 'auction',
 'location': 'Birmingham',
 'make': 'FORD',
 'model': 'FOCUS',
 'odometer': 52206,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-17',
 'seller_name': 'Hilton Garage Ltd',
 'title': 'FORD FOCUS 1.0 EcoBoost 125 Titanium X 5dr',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost 125 Titanium X 5dr',
 'year': 2015}
2025-12-03 06:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271825401%27 HTTP/1.1" 200 None
2025-12-03 06:06:08 [manheim.gb] INFO: Saving data for 1825401: {'auction_closing_time': 1764752400.0, 'created_time': 1764584073.150251, 'last_price_update_time': 1764741968.576165}
2025-12-03 06:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1825401') HTTP/1.1" 204 0
2025-12-03 06:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdc089fca-4db0-4844-a59b-0ea34365f4f5_5.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dc089fca-4db0-4844-a59b-0ea34365f4f5_5.jpg not downloaded yet
2025-12-03 06:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F30f54bb8-6876-40ff-97d0-3b6f9a16409f_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/30f54bb8-6876-40ff-97d0-3b6f9a16409f_ext_1.jpg not downloaded yet
2025-12-03 06:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/PEUGEOT/208?id=1671760&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231671760&indx=50> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:06:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a45157ed-0b57-550e-b71f-216ca1e78b3c with identifier: 1815539
2025-12-03 06:06:08 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item a45157ed-0b57-550e-b71f-216ca1e78b3c
2025-12-03 06:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdc089fca-4db0-4844-a59b-0ea34365f4f5_4.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dc089fca-4db0-4844-a59b-0ea34365f4f5_4.jpg not downloaded yet
2025-12-03 06:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F30f54bb8-6876-40ff-97d0-3b6f9a16409f_5.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/30f54bb8-6876-40ff-97d0-3b6f9a16409f_5.jpg not downloaded yet
2025-12-03 06:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdc089fca-4db0-4844-a59b-0ea34365f4f5_11.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dc089fca-4db0-4844-a59b-0ea34365f4f5_11.jpg not downloaded yet
2025-12-03 06:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F30f54bb8-6876-40ff-97d0-3b6f9a16409f_4.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/30f54bb8-6876-40ff-97d0-3b6f9a16409f_4.jpg not downloaded yet
2025-12-03 06:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdc089fca-4db0-4844-a59b-0ea34365f4f5_10.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dc089fca-4db0-4844-a59b-0ea34365f4f5_10.jpg not downloaded yet
2025-12-03 06:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F30f54bb8-6876-40ff-97d0-3b6f9a16409f_11.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/30f54bb8-6876-40ff-97d0-3b6f9a16409f_11.jpg not downloaded yet
2025-12-03 06:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdc089fca-4db0-4844-a59b-0ea34365f4f5_9.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dc089fca-4db0-4844-a59b-0ea34365f4f5_9.jpg not downloaded yet
2025-12-03 06:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F30f54bb8-6876-40ff-97d0-3b6f9a16409f_10.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/30f54bb8-6876-40ff-97d0-3b6f9a16409f_10.jpg not downloaded yet
2025-12-03 06:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdc089fca-4db0-4844-a59b-0ea34365f4f5_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dc089fca-4db0-4844-a59b-0ea34365f4f5_ext_2.jpg not downloaded yet
2025-12-03 06:06:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 305891c0-9b6f-5a98-9567-477488b7721f with identifier: 1671760
2025-12-03 06:06:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 305891c0-9b6f-5a98-9567-477488b7721f with scrape type 2
2025-12-03 06:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 305891c0-9b6f-5a98-9567-477488b7721f with scrape type 2
2025-12-03 06:06:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 305891c0-9b6f-5a98-9567-477488b7721f, identifier: 1671760
2025-12-03 06:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F30f54bb8-6876-40ff-97d0-3b6f9a16409f_9.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/30f54bb8-6876-40ff-97d0-3b6f9a16409f_9.jpg not downloaded yet
2025-12-03 06:06:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 305891c0-9b6f-5a98-9567-477488b7721f with identifier: 1671760
2025-12-03 06:06:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 305891c0-9b6f-5a98-9567-477488b7721f with identifier: 1671760
2025-12-03 06:06:09 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 10 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    10
2025-12-03 06:06:09 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: 305891c0-9b6f-5a98-9567-477488b7721f spider: manheim.gb
2025-12-03 06:06:09 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 305891c0-9b6f-5a98-9567-477488b7721f due to rule: registration_date_old.json, error: 10 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    10
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001671760-01982883-002.pdf',
 'color': 'BLUE',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': '2025-12-03T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '305891c0-9b6f-5a98-9567-477488b7721f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'YL15WLP',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/PEUGEOT/208?id=1671760',
 'listing': 'auction',
 'location': 'Washington',
 'make': 'PEUGEOT',
 'model': '208',
 'odometer': 77115,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-03',
 'seller_name': 'Lookers',
 'title': 'PEUGEOT 208 1.2 PureTech 82 Allure 3dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech 82 Allure 3dr',
 'year': 2015}
2025-12-03 06:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271671760%27 HTTP/1.1" 200 None
2025-12-03 06:06:09 [manheim.gb] INFO: Saving data for 1671760: {'auction_closing_time': 1764752400.0, 'created_time': 1764584111.72886, 'last_price_update_time': 1764741969.247539}
2025-12-03 06:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1671760') HTTP/1.1" 204 0
2025-12-03 06:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdc089fca-4db0-4844-a59b-0ea34365f4f5_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dc089fca-4db0-4844-a59b-0ea34365f4f5_ext_5.jpg not downloaded yet
2025-12-03 06:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F30f54bb8-6876-40ff-97d0-3b6f9a16409f_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/30f54bb8-6876-40ff-97d0-3b6f9a16409f_ext_2.jpg not downloaded yet
2025-12-03 06:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdc089fca-4db0-4844-a59b-0ea34365f4f5_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dc089fca-4db0-4844-a59b-0ea34365f4f5_ext_3.jpg not downloaded yet
2025-12-03 06:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F30f54bb8-6876-40ff-97d0-3b6f9a16409f_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/30f54bb8-6876-40ff-97d0-3b6f9a16409f_ext_5.jpg not downloaded yet
2025-12-03 06:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdc089fca-4db0-4844-a59b-0ea34365f4f5_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dc089fca-4db0-4844-a59b-0ea34365f4f5_ext_4.jpg not downloaded yet
2025-12-03 06:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F30f54bb8-6876-40ff-97d0-3b6f9a16409f_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/30f54bb8-6876-40ff-97d0-3b6f9a16409f_ext_3.jpg not downloaded yet
2025-12-03 06:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1877473-4005363-13.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1877473-4005363-13.jpg not downloaded yet
2025-12-03 06:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F30f54bb8-6876-40ff-97d0-3b6f9a16409f_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/30f54bb8-6876-40ff-97d0-3b6f9a16409f_ext_4.jpg not downloaded yet
2025-12-03 06:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1877473-4005363-1000.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1877473-4005363-1000.jpg not downloaded yet
2025-12-03 06:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1912686-4004919-13.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1912686-4004919-13.jpg not downloaded yet
2025-12-03 06:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1877473-4005363-1001.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1877473-4005363-1001.jpg not downloaded yet
2025-12-03 06:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1912686-4004919-1000.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1912686-4004919-1000.jpg not downloaded yet
2025-12-03 06:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1877473-4005363-1002.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1877473-4005363-1002.jpg not downloaded yet
2025-12-03 06:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1912686-4004919-1001.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1912686-4004919-1001.jpg not downloaded yet
2025-12-03 06:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1877473-4005363-1003.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1877473-4005363-1003.jpg not downloaded yet
2025-12-03 06:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1912686-4004919-1002.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1912686-4004919-1002.jpg not downloaded yet
2025-12-03 06:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1877473-4005363-1004.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1877473-4005363-1004.jpg not downloaded yet
2025-12-03 06:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1912686-4004919-1003.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1912686-4004919-1003.jpg not downloaded yet
2025-12-03 06:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1877473-4005363-1005.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1877473-4005363-1005.jpg not downloaded yet
2025-12-03 06:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1912686-4004919-1004.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1912686-4004919-1004.jpg not downloaded yet
2025-12-03 06:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1912686-4004919-1005.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1912686-4004919-1005.jpg not downloaded yet
2025-12-03 06:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=1787313&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231787313&indx=58> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:06:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc78e621-a4b4-5607-ac35-f858f92c4c33 with identifier: 1787313
2025-12-03 06:06:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc78e621-a4b4-5607-ac35-f858f92c4c33 with scrape type 2
2025-12-03 06:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc78e621-a4b4-5607-ac35-f858f92c4c33 with scrape type 2
2025-12-03 06:06:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: bc78e621-a4b4-5607-ac35-f858f92c4c33, identifier: 1787313
2025-12-03 06:06:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: bc78e621-a4b4-5607-ac35-f858f92c4c33 with identifier: 1787313
2025-12-03 06:06:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: bc78e621-a4b4-5607-ac35-f858f92c4c33 with identifier: 1787313
2025-12-03 06:06:10 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 13 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    13
2025-12-03 06:06:10 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: bc78e621-a4b4-5607-ac35-f858f92c4c33 spider: manheim.gb
2025-12-03 06:06:10 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: bc78e621-a4b4-5607-ac35-f858f92c4c33 due to rule: registration_date_old.json, error: 13 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    13
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001787313-01982150-003.pdf',
 'color': 'White',
 'currency': 'GBP',
 'engine': '1.5L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'bc78e621-a4b4-5607-ac35-f858f92c4c33',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'VN62POU',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=1787313',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 91259,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-01',
 'seller_name': 'John Banks',
 'title': 'NISSAN QASHQAI 1.5 dCi [110] N-Tec+ 5dr',
 'transmission': 'manual',
 'trim': '1.5 dCi [110] N-Tec+ 5dr',
 'year': 2012}
2025-12-03 06:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271787313%27 HTTP/1.1" 200 None
2025-12-03 06:06:10 [manheim.gb] INFO: Saving data for 1787313: {'auction_closing_time': 1764838800.0, 'created_time': 1764584115.380676, 'last_price_update_time': 1764741970.263831}
2025-12-03 06:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1787313') HTTP/1.1" 204 0
2025-12-03 06:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1912686-4004919-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001912686-01985791-002.pdf)
2025-12-03 06:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1877473-4005363-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001877473-01989665-002.pdf)
2025-12-03 06:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1877473-4005363-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001877473-01989665-002.pdf)
2025-12-03 06:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1912686-4004919-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001912686-01985791-002.pdf)
2025-12-03 06:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1912686-4004919-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001912686-01985791-002.pdf)
2025-12-03 06:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1912686-4004919-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001912686-01985791-002.pdf)
2025-12-03 06:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1912686-4004919-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001912686-01985791-002.pdf)
2025-12-03 06:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1877473-4005363-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001877473-01989665-002.pdf)
2025-12-03 06:06:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f619b6d0>
2025-12-03 06:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 06:06:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1b26391-08cb-5b60-9737-ef0afa324128/f1b26391-08cb-5b60-9737-ef0afa324128_image_18.jpg HTTP/1.1" 201 0
2025-12-03 06:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1912686-4004919-1004.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1912686-4004919-1004.jpg saved to cache
2025-12-03 06:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item f1b26391-08cb-5b60-9737-ef0afa324128
2025-12-03 06:06:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6175650>
2025-12-03 06:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:06:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94b69d29-057e-5615-9947-92f19df1ec23/94b69d29-057e-5615-9947-92f19df1ec23_image_17.jpg HTTP/1.1" 201 0
2025-12-03 06:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1877473-4005363-1003.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1877473-4005363-1003.jpg saved to cache
2025-12-03 06:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 94b69d29-057e-5615-9947-92f19df1ec23
2025-12-03 06:06:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f5227650>
2025-12-03 06:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94b69d29-057e-5615-9947-92f19df1ec23/94b69d29-057e-5615-9947-92f19df1ec23_image_19.jpg HTTP/1.1" 201 0
2025-12-03 06:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1877473-4005363-1005.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1877473-4005363-1005.jpg saved to cache
2025-12-03 06:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 94b69d29-057e-5615-9947-92f19df1ec23
2025-12-03 06:06:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f617e290>
2025-12-03 06:06:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1b26391-08cb-5b60-9737-ef0afa324128/f1b26391-08cb-5b60-9737-ef0afa324128_image_19.jpg HTTP/1.1" 201 0
2025-12-03 06:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1912686-4004919-1005.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1912686-4004919-1005.jpg saved to cache
2025-12-03 06:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item f1b26391-08cb-5b60-9737-ef0afa324128
2025-12-03 06:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1877473-4005363-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001877473-01989665-002.pdf)
2025-12-03 06:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/30f54bb8-6876-40ff-97d0-3b6f9a16409f_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001912686-01985791-002.pdf)
2025-12-03 06:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1877473-4005363-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001877473-01989665-002.pdf)
2025-12-03 06:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/30f54bb8-6876-40ff-97d0-3b6f9a16409f_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001912686-01985791-002.pdf)
2025-12-03 06:06:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f60851d0>
2025-12-03 06:06:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1b26391-08cb-5b60-9737-ef0afa324128/f1b26391-08cb-5b60-9737-ef0afa324128_image_17.jpg HTTP/1.1" 201 0
2025-12-03 06:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1912686-4004919-1003.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1912686-4004919-1003.jpg saved to cache
2025-12-03 06:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item f1b26391-08cb-5b60-9737-ef0afa324128
2025-12-03 06:06:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f5224790>
2025-12-03 06:06:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:06:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1b26391-08cb-5b60-9737-ef0afa324128/f1b26391-08cb-5b60-9737-ef0afa324128_image_15.jpg HTTP/1.1" 201 0
2025-12-03 06:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1912686-4004919-1001.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1912686-4004919-1001.jpg saved to cache
2025-12-03 06:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item f1b26391-08cb-5b60-9737-ef0afa324128
2025-12-03 06:06:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f614c450>
2025-12-03 06:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:06:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1b26391-08cb-5b60-9737-ef0afa324128/f1b26391-08cb-5b60-9737-ef0afa324128_image_16.jpg HTTP/1.1" 201 0
2025-12-03 06:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1912686-4004919-1002.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1912686-4004919-1002.jpg saved to cache
2025-12-03 06:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item f1b26391-08cb-5b60-9737-ef0afa324128
2025-12-03 06:06:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f602cd10>
2025-12-03 06:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:06:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94b69d29-057e-5615-9947-92f19df1ec23/94b69d29-057e-5615-9947-92f19df1ec23_image_18.jpg HTTP/1.1" 201 0
2025-12-03 06:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1877473-4005363-1004.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1877473-4005363-1004.jpg saved to cache
2025-12-03 06:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 94b69d29-057e-5615-9947-92f19df1ec23
2025-12-03 06:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1912686-4004919-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001912686-01985791-002.pdf)
2025-12-03 06:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1912686-4004919-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001912686-01985791-002.pdf)
2025-12-03 06:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1877473-4005363-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001877473-01989665-002.pdf)
2025-12-03 06:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1877473-4005363-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001877473-01989665-002.pdf)
2025-12-03 06:06:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f5ba6e90>
2025-12-03 06:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:06:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94b69d29-057e-5615-9947-92f19df1ec23/94b69d29-057e-5615-9947-92f19df1ec23_image_16.jpg HTTP/1.1" 201 0
2025-12-03 06:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1877473-4005363-1002.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1877473-4005363-1002.jpg saved to cache
2025-12-03 06:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 94b69d29-057e-5615-9947-92f19df1ec23
2025-12-03 06:06:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6198350>
2025-12-03 06:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:06:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1b26391-08cb-5b60-9737-ef0afa324128/f1b26391-08cb-5b60-9737-ef0afa324128_image_12.jpg HTTP/1.1" 201 0
2025-12-03 06:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F30f54bb8-6876-40ff-97d0-3b6f9a16409f_ext_4.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/30f54bb8-6876-40ff-97d0-3b6f9a16409f_ext_4.jpg saved to cache
2025-12-03 06:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item f1b26391-08cb-5b60-9737-ef0afa324128
2025-12-03 06:06:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6356010>
2025-12-03 06:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 06:06:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94b69d29-057e-5615-9947-92f19df1ec23/94b69d29-057e-5615-9947-92f19df1ec23_image_14.jpg HTTP/1.1" 201 0
2025-12-03 06:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1877473-4005363-1000.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1877473-4005363-1000.jpg saved to cache
2025-12-03 06:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 94b69d29-057e-5615-9947-92f19df1ec23
2025-12-03 06:06:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f65a3bd0>
2025-12-03 06:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:06:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1b26391-08cb-5b60-9737-ef0afa324128/f1b26391-08cb-5b60-9737-ef0afa324128_image_11.jpg HTTP/1.1" 201 0
2025-12-03 06:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F30f54bb8-6876-40ff-97d0-3b6f9a16409f_ext_3.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/30f54bb8-6876-40ff-97d0-3b6f9a16409f_ext_3.jpg saved to cache
2025-12-03 06:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item f1b26391-08cb-5b60-9737-ef0afa324128
2025-12-03 06:06:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/dc089fca-4db0-4844-a59b-0ea34365f4f5_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001877473-01989665-002.pdf)
2025-12-03 06:06:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f645e190>
2025-12-03 06:06:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1b26391-08cb-5b60-9737-ef0afa324128/f1b26391-08cb-5b60-9737-ef0afa324128_image_14.jpg HTTP/1.1" 201 0
2025-12-03 06:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1912686-4004919-1000.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1912686-4004919-1000.jpg saved to cache
2025-12-03 06:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item f1b26391-08cb-5b60-9737-ef0afa324128
2025-12-03 06:06:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f5208590>
2025-12-03 06:06:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1b26391-08cb-5b60-9737-ef0afa324128/f1b26391-08cb-5b60-9737-ef0afa324128_image_13.jpg HTTP/1.1" 201 0
2025-12-03 06:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1912686-4004919-13.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1912686-4004919-13.jpg saved to cache
2025-12-03 06:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item f1b26391-08cb-5b60-9737-ef0afa324128
2025-12-03 06:06:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f60842d0>
2025-12-03 06:06:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94b69d29-057e-5615-9947-92f19df1ec23/94b69d29-057e-5615-9947-92f19df1ec23_image_15.jpg HTTP/1.1" 201 0
2025-12-03 06:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1877473-4005363-1001.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1877473-4005363-1001.jpg saved to cache
2025-12-03 06:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 94b69d29-057e-5615-9947-92f19df1ec23
2025-12-03 06:06:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f62dc9d0>
2025-12-03 06:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:06:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94b69d29-057e-5615-9947-92f19df1ec23/94b69d29-057e-5615-9947-92f19df1ec23_image_13.jpg HTTP/1.1" 201 0
2025-12-03 06:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1877473-4005363-13.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1877473-4005363-13.jpg saved to cache
2025-12-03 06:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 94b69d29-057e-5615-9947-92f19df1ec23
2025-12-03 06:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/30f54bb8-6876-40ff-97d0-3b6f9a16409f_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001912686-01985791-002.pdf)
2025-12-03 06:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/30f54bb8-6876-40ff-97d0-3b6f9a16409f_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001912686-01985791-002.pdf)
2025-12-03 06:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/30f54bb8-6876-40ff-97d0-3b6f9a16409f_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001912686-01985791-002.pdf)
2025-12-03 06:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/dc089fca-4db0-4844-a59b-0ea34365f4f5_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001877473-01989665-002.pdf)
2025-12-03 06:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/dc089fca-4db0-4844-a59b-0ea34365f4f5_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001877473-01989665-002.pdf)
2025-12-03 06:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/dc089fca-4db0-4844-a59b-0ea34365f4f5_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001877473-01989665-002.pdf)
2025-12-03 06:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/GOLF?id=1580164&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231580164&indx=47> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:06:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f605e810>
2025-12-03 06:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:06:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94b69d29-057e-5615-9947-92f19df1ec23/94b69d29-057e-5615-9947-92f19df1ec23_image_12.jpg HTTP/1.1" 201 0
2025-12-03 06:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdc089fca-4db0-4844-a59b-0ea34365f4f5_ext_4.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dc089fca-4db0-4844-a59b-0ea34365f4f5_ext_4.jpg saved to cache
2025-12-03 06:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 94b69d29-057e-5615-9947-92f19df1ec23
2025-12-03 06:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/30f54bb8-6876-40ff-97d0-3b6f9a16409f_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001912686-01985791-002.pdf)
2025-12-03 06:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/dc089fca-4db0-4844-a59b-0ea34365f4f5_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001877473-01989665-002.pdf)
2025-12-03 06:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/30f54bb8-6876-40ff-97d0-3b6f9a16409f_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001912686-01985791-002.pdf)
2025-12-03 06:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/30f54bb8-6876-40ff-97d0-3b6f9a16409f_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001912686-01985791-002.pdf)
2025-12-03 06:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/dc089fca-4db0-4844-a59b-0ea34365f4f5_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001877473-01989665-002.pdf)
2025-12-03 06:06:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6015dd0>
2025-12-03 06:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:06:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1b26391-08cb-5b60-9737-ef0afa324128/f1b26391-08cb-5b60-9737-ef0afa324128_image_7.jpg HTTP/1.1" 201 0
2025-12-03 06:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F30f54bb8-6876-40ff-97d0-3b6f9a16409f_10.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/30f54bb8-6876-40ff-97d0-3b6f9a16409f_10.jpg saved to cache
2025-12-03 06:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f1b26391-08cb-5b60-9737-ef0afa324128
2025-12-03 06:06:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f62d0110>
2025-12-03 06:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 06:06:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1b26391-08cb-5b60-9737-ef0afa324128/f1b26391-08cb-5b60-9737-ef0afa324128_image_10.jpg HTTP/1.1" 201 0
2025-12-03 06:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F30f54bb8-6876-40ff-97d0-3b6f9a16409f_ext_5.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/30f54bb8-6876-40ff-97d0-3b6f9a16409f_ext_5.jpg saved to cache
2025-12-03 06:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item f1b26391-08cb-5b60-9737-ef0afa324128
2025-12-03 06:06:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6393950>
2025-12-03 06:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 06:06:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1b26391-08cb-5b60-9737-ef0afa324128/f1b26391-08cb-5b60-9737-ef0afa324128_image_8.jpg HTTP/1.1" 201 0
2025-12-03 06:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F30f54bb8-6876-40ff-97d0-3b6f9a16409f_9.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/30f54bb8-6876-40ff-97d0-3b6f9a16409f_9.jpg saved to cache
2025-12-03 06:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f1b26391-08cb-5b60-9737-ef0afa324128
2025-12-03 06:06:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6390c10>
2025-12-03 06:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:06:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94b69d29-057e-5615-9947-92f19df1ec23/94b69d29-057e-5615-9947-92f19df1ec23_image_11.jpg HTTP/1.1" 201 0
2025-12-03 06:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdc089fca-4db0-4844-a59b-0ea34365f4f5_ext_3.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dc089fca-4db0-4844-a59b-0ea34365f4f5_ext_3.jpg saved to cache
2025-12-03 06:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 94b69d29-057e-5615-9947-92f19df1ec23
2025-12-03 06:06:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f61d8090>
2025-12-03 06:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 06:06:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94b69d29-057e-5615-9947-92f19df1ec23/94b69d29-057e-5615-9947-92f19df1ec23_image_9.jpg HTTP/1.1" 201 0
2025-12-03 06:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdc089fca-4db0-4844-a59b-0ea34365f4f5_ext_2.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dc089fca-4db0-4844-a59b-0ea34365f4f5_ext_2.jpg saved to cache
2025-12-03 06:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 94b69d29-057e-5615-9947-92f19df1ec23
2025-12-03 06:06:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f61e8110>
2025-12-03 06:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:06:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94b69d29-057e-5615-9947-92f19df1ec23/94b69d29-057e-5615-9947-92f19df1ec23_image_10.jpg HTTP/1.1" 201 0
2025-12-03 06:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdc089fca-4db0-4844-a59b-0ea34365f4f5_ext_5.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dc089fca-4db0-4844-a59b-0ea34365f4f5_ext_5.jpg saved to cache
2025-12-03 06:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 94b69d29-057e-5615-9947-92f19df1ec23
2025-12-03 06:06:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc573ca1-c331-529e-9992-76c06b7bdec8 with identifier: 1580164
2025-12-03 06:06:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc573ca1-c331-529e-9992-76c06b7bdec8 with scrape type 2
2025-12-03 06:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc573ca1-c331-529e-9992-76c06b7bdec8 with scrape type 2
2025-12-03 06:06:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: fc573ca1-c331-529e-9992-76c06b7bdec8, identifier: 1580164
2025-12-03 06:06:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: fc573ca1-c331-529e-9992-76c06b7bdec8 with identifier: 1580164
2025-12-03 06:06:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: fc573ca1-c331-529e-9992-76c06b7bdec8 with identifier: 1580164
2025-12-03 06:06:17 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 166663 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    166663
2025-12-03 06:06:17 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: fc573ca1-c331-529e-9992-76c06b7bdec8 spider: manheim.gb
2025-12-03 06:06:17 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: fc573ca1-c331-529e-9992-76c06b7bdec8 due to rule: high_mileage_for_country.json, error: 166663 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    166663
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001580164-01982640-003.pdf',
 'color': 'Black',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'fc573ca1-c331-529e-9992-76c06b7bdec8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'PE12OBY',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/GOLF?id=1580164',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF',
 'odometer': 103560,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-17',
 'seller_name': 'Big Motoring World Ltd',
 'title': 'VOLKSWAGEN GOLF 2.0 TDI BlueMotion Tech GT 2dr',
 'transmission': 'manual',
 'trim': '2.0 TDI BlueMotion Tech GT 2dr',
 'year': 2012}
2025-12-03 06:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271580164%27 HTTP/1.1" 200 None
2025-12-03 06:06:17 [manheim.gb] INFO: Saving data for 1580164: {'auction_closing_time': 1764838800.0, 'created_time': 1764584163.498681, 'last_price_update_time': 1764741977.832}
2025-12-03 06:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1580164') HTTP/1.1" 204 0
2025-12-03 06:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/CITROEN/C1?id=157293&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%23157293&indx=46> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/dc089fca-4db0-4844-a59b-0ea34365f4f5_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001877473-01989665-002.pdf)
2025-12-03 06:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/dc089fca-4db0-4844-a59b-0ea34365f4f5_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001877473-01989665-002.pdf)
2025-12-03 06:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/dc089fca-4db0-4844-a59b-0ea34365f4f5_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001877473-01989665-002.pdf)
2025-12-03 06:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/30f54bb8-6876-40ff-97d0-3b6f9a16409f_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001912686-01985791-002.pdf)
2025-12-03 06:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/30f54bb8-6876-40ff-97d0-3b6f9a16409f_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001912686-01985791-002.pdf)
2025-12-03 06:06:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:06:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f62de6d0>
2025-12-03 06:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 06:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1b26391-08cb-5b60-9737-ef0afa324128/f1b26391-08cb-5b60-9737-ef0afa324128_image_9.jpg HTTP/1.1" 201 0
2025-12-03 06:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F30f54bb8-6876-40ff-97d0-3b6f9a16409f_ext_2.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/30f54bb8-6876-40ff-97d0-3b6f9a16409f_ext_2.jpg saved to cache
2025-12-03 06:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f1b26391-08cb-5b60-9737-ef0afa324128
2025-12-03 06:06:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f5208690>
2025-12-03 06:06:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94b69d29-057e-5615-9947-92f19df1ec23/94b69d29-057e-5615-9947-92f19df1ec23_image_8.jpg HTTP/1.1" 201 0
2025-12-03 06:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdc089fca-4db0-4844-a59b-0ea34365f4f5_9.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dc089fca-4db0-4844-a59b-0ea34365f4f5_9.jpg saved to cache
2025-12-03 06:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 94b69d29-057e-5615-9947-92f19df1ec23
2025-12-03 06:06:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6574d10>
2025-12-03 06:06:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1b26391-08cb-5b60-9737-ef0afa324128/f1b26391-08cb-5b60-9737-ef0afa324128_image_6.jpg HTTP/1.1" 201 0
2025-12-03 06:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F30f54bb8-6876-40ff-97d0-3b6f9a16409f_11.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/30f54bb8-6876-40ff-97d0-3b6f9a16409f_11.jpg saved to cache
2025-12-03 06:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f1b26391-08cb-5b60-9737-ef0afa324128
2025-12-03 06:06:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f5b96b90>
2025-12-03 06:06:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 06:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1b26391-08cb-5b60-9737-ef0afa324128/f1b26391-08cb-5b60-9737-ef0afa324128_image_5.jpg HTTP/1.1" 201 0
2025-12-03 06:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F30f54bb8-6876-40ff-97d0-3b6f9a16409f_4.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/30f54bb8-6876-40ff-97d0-3b6f9a16409f_4.jpg saved to cache
2025-12-03 06:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f1b26391-08cb-5b60-9737-ef0afa324128
2025-12-03 06:06:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6575150>
2025-12-03 06:06:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 06:06:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94b69d29-057e-5615-9947-92f19df1ec23/94b69d29-057e-5615-9947-92f19df1ec23_image_7.jpg HTTP/1.1" 201 0
2025-12-03 06:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdc089fca-4db0-4844-a59b-0ea34365f4f5_10.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dc089fca-4db0-4844-a59b-0ea34365f4f5_10.jpg saved to cache
2025-12-03 06:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 94b69d29-057e-5615-9947-92f19df1ec23
2025-12-03 06:06:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/dc089fca-4db0-4844-a59b-0ea34365f4f5_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001877473-01989665-002.pdf)
2025-12-03 06:06:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/30f54bb8-6876-40ff-97d0-3b6f9a16409f_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001912686-01985791-002.pdf)
2025-12-03 06:06:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/30f54bb8-6876-40ff-97d0-3b6f9a16409f_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001912686-01985791-002.pdf)
2025-12-03 06:06:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 06:06:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f with identifier: 157293
2025-12-03 06:06:19 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f
2025-12-03 06:06:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f5bc5450>
2025-12-03 06:06:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:06:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94b69d29-057e-5615-9947-92f19df1ec23/94b69d29-057e-5615-9947-92f19df1ec23_image_5.jpg HTTP/1.1" 201 0
2025-12-03 06:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdc089fca-4db0-4844-a59b-0ea34365f4f5_4.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dc089fca-4db0-4844-a59b-0ea34365f4f5_4.jpg saved to cache
2025-12-03 06:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 94b69d29-057e-5615-9947-92f19df1ec23
2025-12-03 06:06:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f613d050>
2025-12-03 06:06:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 06:06:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94b69d29-057e-5615-9947-92f19df1ec23/94b69d29-057e-5615-9947-92f19df1ec23_image_6.jpg HTTP/1.1" 201 0
2025-12-03 06:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdc089fca-4db0-4844-a59b-0ea34365f4f5_11.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dc089fca-4db0-4844-a59b-0ea34365f4f5_11.jpg saved to cache
2025-12-03 06:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 94b69d29-057e-5615-9947-92f19df1ec23
2025-12-03 06:06:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6407a90>
2025-12-03 06:06:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:06:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94b69d29-057e-5615-9947-92f19df1ec23/94b69d29-057e-5615-9947-92f19df1ec23_image_4.jpg HTTP/1.1" 201 0
2025-12-03 06:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdc089fca-4db0-4844-a59b-0ea34365f4f5_5.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dc089fca-4db0-4844-a59b-0ea34365f4f5_5.jpg saved to cache
2025-12-03 06:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 94b69d29-057e-5615-9947-92f19df1ec23
2025-12-03 06:06:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f5bc4bd0>
2025-12-03 06:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:06:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1b26391-08cb-5b60-9737-ef0afa324128/f1b26391-08cb-5b60-9737-ef0afa324128_image_4.jpg HTTP/1.1" 201 0
2025-12-03 06:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F30f54bb8-6876-40ff-97d0-3b6f9a16409f_5.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/30f54bb8-6876-40ff-97d0-3b6f9a16409f_5.jpg saved to cache
2025-12-03 06:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f1b26391-08cb-5b60-9737-ef0afa324128
2025-12-03 06:06:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6131d90>
2025-12-03 06:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:06:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1b26391-08cb-5b60-9737-ef0afa324128/f1b26391-08cb-5b60-9737-ef0afa324128_image_3.jpg HTTP/1.1" 201 0
2025-12-03 06:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F30f54bb8-6876-40ff-97d0-3b6f9a16409f_ext_1.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/30f54bb8-6876-40ff-97d0-3b6f9a16409f_ext_1.jpg saved to cache
2025-12-03 06:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f1b26391-08cb-5b60-9737-ef0afa324128
2025-12-03 06:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/dc089fca-4db0-4844-a59b-0ea34365f4f5_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001877473-01989665-002.pdf)
2025-12-03 06:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/dc089fca-4db0-4844-a59b-0ea34365f4f5_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001877473-01989665-002.pdf)
2025-12-03 06:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/30f54bb8-6876-40ff-97d0-3b6f9a16409f_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001912686-01985791-002.pdf)
2025-12-03 06:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-008.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002255216-01981992-002.pdf)
2025-12-03 06:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c6b8d049-47d9-4be5-92e6-cb6861fc337b_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000196679-01983681-002.pdf)
2025-12-03 06:06:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6473450>
2025-12-03 06:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 06:06:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94b69d29-057e-5615-9947-92f19df1ec23/94b69d29-057e-5615-9947-92f19df1ec23_image_3.jpg HTTP/1.1" 201 0
2025-12-03 06:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdc089fca-4db0-4844-a59b-0ea34365f4f5_ext_1.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dc089fca-4db0-4844-a59b-0ea34365f4f5_ext_1.jpg saved to cache
2025-12-03 06:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 94b69d29-057e-5615-9947-92f19df1ec23
2025-12-03 06:06:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f64648d0>
2025-12-03 06:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:06:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1b26391-08cb-5b60-9737-ef0afa324128/f1b26391-08cb-5b60-9737-ef0afa324128_image_2.jpg HTTP/1.1" 201 0
2025-12-03 06:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F30f54bb8-6876-40ff-97d0-3b6f9a16409f_ext_6.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/30f54bb8-6876-40ff-97d0-3b6f9a16409f_ext_6.jpg saved to cache
2025-12-03 06:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f1b26391-08cb-5b60-9737-ef0afa324128
2025-12-03 06:06:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f5bf3410>
2025-12-03 06:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:06:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1b26391-08cb-5b60-9737-ef0afa324128/f1b26391-08cb-5b60-9737-ef0afa324128_image_1.jpg HTTP/1.1" 201 0
2025-12-03 06:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F30f54bb8-6876-40ff-97d0-3b6f9a16409f_ext_7.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/30f54bb8-6876-40ff-97d0-3b6f9a16409f_ext_7.jpg saved to cache
2025-12-03 06:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f1b26391-08cb-5b60-9737-ef0afa324128
2025-12-03 06:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/dc089fca-4db0-4844-a59b-0ea34365f4f5_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001877473-01989665-002.pdf)
2025-12-03 06:06:21 [scrapy.extensions.logstats] INFO: Crawled 112 pages (at 26 pages/min), scraped 33 items (at 6 items/min)
2025-12-03 06:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0001815539-01989158-003.pdf> (referer: None)
2025-12-03 06:06:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6490290>
2025-12-03 06:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:06:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94b69d29-057e-5615-9947-92f19df1ec23/94b69d29-057e-5615-9947-92f19df1ec23_image_1.jpg HTTP/1.1" 201 0
2025-12-03 06:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdc089fca-4db0-4844-a59b-0ea34365f4f5_ext_7.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dc089fca-4db0-4844-a59b-0ea34365f4f5_ext_7.jpg saved to cache
2025-12-03 06:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 94b69d29-057e-5615-9947-92f19df1ec23
2025-12-03 06:06:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f62dc390>
2025-12-03 06:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 06:06:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94b69d29-057e-5615-9947-92f19df1ec23/94b69d29-057e-5615-9947-92f19df1ec23_image_0.jpg HTTP/1.1" 201 0
2025-12-03 06:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdc089fca-4db0-4844-a59b-0ea34365f4f5_ext_7.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dc089fca-4db0-4844-a59b-0ea34365f4f5_ext_7.jpg saved to cache
2025-12-03 06:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 94b69d29-057e-5615-9947-92f19df1ec23
2025-12-03 06:06:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f611c390>
2025-12-03 06:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:06:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1b26391-08cb-5b60-9737-ef0afa324128/f1b26391-08cb-5b60-9737-ef0afa324128_image_0.jpg HTTP/1.1" 201 0
2025-12-03 06:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F30f54bb8-6876-40ff-97d0-3b6f9a16409f_ext_7.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/30f54bb8-6876-40ff-97d0-3b6f9a16409f_ext_7.jpg saved to cache
2025-12-03 06:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f1b26391-08cb-5b60-9737-ef0afa324128
2025-12-03 06:06:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f1b26391-08cb-5b60-9737-ef0afa324128, skipping ID generation
2025-12-03 06:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Removing item f1b26391-08cb-5b60-9737-ef0afa324128 from tracking dictionaries
2025-12-03 06:06:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f1b26391-08cb-5b60-9737-ef0afa324128 sending to next pipeline
2025-12-03 06:06:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: f1b26391-08cb-5b60-9737-ef0afa324128, identifier: 1912686
2025-12-03 06:06:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6320d10>
2025-12-03 06:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 06:06:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_1.jpg HTTP/1.1" 201 0
2025-12-03 06:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2255216-9999999-336141851-008.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-008.jpg saved to cache
2025-12-03 06:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ea671044-60e2-5537-89a1-04ede30d8044
2025-12-03 06:06:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f5209590>
2025-12-03 06:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 06:06:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_391b4f4c-6885-5c72-8cdf-5a04e9575729/391b4f4c-6885-5c72-8cdf-5a04e9575729_image_2.jpg HTTP/1.1" 201 0
2025-12-03 06:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc6b8d049-47d9-4be5-92e6-cb6861fc337b_ext_6.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c6b8d049-47d9-4be5-92e6-cb6861fc337b_ext_6.jpg saved to cache
2025-12-03 06:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 391b4f4c-6885-5c72-8cdf-5a04e9575729
2025-12-03 06:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1976170-9999999-217150707-004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001976170-01815378-004.pdf)
2025-12-03 06:06:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: f1b26391-08cb-5b60-9737-ef0afa324128 with identifier: 1912686
2025-12-03 06:06:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: f1b26391-08cb-5b60-9737-ef0afa324128 with identifier: 1912686
2025-12-03 06:06:23 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 12 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    12
2025-12-03 06:06:23 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: f1b26391-08cb-5b60-9737-ef0afa324128 spider: manheim.gb
2025-12-03 06:06:23 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: f1b26391-08cb-5b60-9737-ef0afa324128 due to rule: registration_date_old.json, error: 12 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    12
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1b26391-08cb-5b60-9737-ef0afa324128/f1b26391-08cb-5b60-9737-ef0afa324128_expert_report_file_f64907e2-886c-4dea-a693-53eda0a1c5b3.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001912686-01985791-002.pdf',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.4L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'f1b26391-08cb-5b60-9737-ef0afa324128',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'EK13XWL',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VAUXHALL/CORSA?id=1912686',
 'listing': 'auction',
 'location': 'Northampton',
 'make': 'VAUXHALL',
 'model': 'CORSA',
 'odometer': 91770,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 51,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1b26391-08cb-5b60-9737-ef0afa324128/f1b26391-08cb-5b60-9737-ef0afa324128_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 225998,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/30f54bb8-6876-40ff-97d0-3b6f9a16409f_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1b26391-08cb-5b60-9737-ef0afa324128/f1b26391-08cb-5b60-9737-ef0afa324128_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 225998,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/30f54bb8-6876-40ff-97d0-3b6f9a16409f_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1b26391-08cb-5b60-9737-ef0afa324128/f1b26391-08cb-5b60-9737-ef0afa324128_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 270649,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/30f54bb8-6876-40ff-97d0-3b6f9a16409f_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1b26391-08cb-5b60-9737-ef0afa324128/f1b26391-08cb-5b60-9737-ef0afa324128_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 228322,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/30f54bb8-6876-40ff-97d0-3b6f9a16409f_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1b26391-08cb-5b60-9737-ef0afa324128/f1b26391-08cb-5b60-9737-ef0afa324128_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 219440,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/30f54bb8-6876-40ff-97d0-3b6f9a16409f_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1b26391-08cb-5b60-9737-ef0afa324128/f1b26391-08cb-5b60-9737-ef0afa324128_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 214851,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/30f54bb8-6876-40ff-97d0-3b6f9a16409f_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1b26391-08cb-5b60-9737-ef0afa324128/f1b26391-08cb-5b60-9737-ef0afa324128_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 211232,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/30f54bb8-6876-40ff-97d0-3b6f9a16409f_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1b26391-08cb-5b60-9737-ef0afa324128/f1b26391-08cb-5b60-9737-ef0afa324128_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 215133,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/30f54bb8-6876-40ff-97d0-3b6f9a16409f_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1b26391-08cb-5b60-9737-ef0afa324128/f1b26391-08cb-5b60-9737-ef0afa324128_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 222826,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/30f54bb8-6876-40ff-97d0-3b6f9a16409f_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1b26391-08cb-5b60-9737-ef0afa324128/f1b26391-08cb-5b60-9737-ef0afa324128_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 337954,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/30f54bb8-6876-40ff-97d0-3b6f9a16409f_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1b26391-08cb-5b60-9737-ef0afa324128/f1b26391-08cb-5b60-9737-ef0afa324128_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 235622,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/30f54bb8-6876-40ff-97d0-3b6f9a16409f_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1b26391-08cb-5b60-9737-ef0afa324128/f1b26391-08cb-5b60-9737-ef0afa324128_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 233156,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/30f54bb8-6876-40ff-97d0-3b6f9a16409f_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1b26391-08cb-5b60-9737-ef0afa324128/f1b26391-08cb-5b60-9737-ef0afa324128_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 244892,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/30f54bb8-6876-40ff-97d0-3b6f9a16409f_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1b26391-08cb-5b60-9737-ef0afa324128/f1b26391-08cb-5b60-9737-ef0afa324128_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 352694,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1912686-4004919-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1b26391-08cb-5b60-9737-ef0afa324128/f1b26391-08cb-5b60-9737-ef0afa324128_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 303445,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1912686-4004919-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1b26391-08cb-5b60-9737-ef0afa324128/f1b26391-08cb-5b60-9737-ef0afa324128_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 293940,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1912686-4004919-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1b26391-08cb-5b60-9737-ef0afa324128/f1b26391-08cb-5b60-9737-ef0afa324128_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 248753,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1912686-4004919-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1b26391-08cb-5b60-9737-ef0afa324128/f1b26391-08cb-5b60-9737-ef0afa324128_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 262966,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1912686-4004919-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1b26391-08cb-5b60-9737-ef0afa324128/f1b26391-08cb-5b60-9737-ef0afa324128_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 229327,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1912686-4004919-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1b26391-08cb-5b60-9737-ef0afa324128/f1b26391-08cb-5b60-9737-ef0afa324128_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 154724,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1912686-4004919-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-27',
 'seller_name': 'Vindis Group',
 'title': 'VAUXHALL CORSA 1.4T Black Edition 3dr',
 'transmission': 'manual',
 'trim': '1.4T Black Edition 3dr',
 'year': 2013}
2025-12-03 06:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271912686%27 HTTP/1.1" 200 None
2025-12-03 06:06:23 [manheim.gb] INFO: Saving data for 1912686: {'created_time': 1764741983.44155, 'last_price_update_time': 1764741983.441564, 'auction_closing_time': 1764838800.0}
2025-12-03 06:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1912686') HTTP/1.1" 204 0
2025-12-03 06:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c6b8d049-47d9-4be5-92e6-cb6861fc337b_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000196679-01983681-002.pdf)
2025-12-03 06:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002255216-01981992-002.pdf)
2025-12-03 06:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c6b8d049-47d9-4be5-92e6-cb6861fc337b_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000196679-01983681-002.pdf)
2025-12-03 06:06:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f7b1b290>
2025-12-03 06:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:06:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94b69d29-057e-5615-9947-92f19df1ec23/94b69d29-057e-5615-9947-92f19df1ec23_image_2.jpg HTTP/1.1" 201 0
2025-12-03 06:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdc089fca-4db0-4844-a59b-0ea34365f4f5_ext_6.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dc089fca-4db0-4844-a59b-0ea34365f4f5_ext_6.jpg saved to cache
2025-12-03 06:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 94b69d29-057e-5615-9947-92f19df1ec23
2025-12-03 06:06:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 94b69d29-057e-5615-9947-92f19df1ec23, skipping ID generation
2025-12-03 06:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 94b69d29-057e-5615-9947-92f19df1ec23 from tracking dictionaries
2025-12-03 06:06:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 94b69d29-057e-5615-9947-92f19df1ec23 sending to next pipeline
2025-12-03 06:06:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 94b69d29-057e-5615-9947-92f19df1ec23, identifier: 1877473
2025-12-03 06:06:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6289bd0>
2025-12-03 06:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 06:06:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a45157ed-0b57-550e-b71f-216ca1e78b3c/a45157ed-0b57-550e-b71f-216ca1e78b3c_expert_report_file_ef79e2f3-2fcc-4675-a7f5-606eba7314d9.pdf HTTP/1.1" 201 0
2025-12-03 06:06:24 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item a45157ed-0b57-550e-b71f-216ca1e78b3c
2025-12-03 06:06:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a45157ed-0b57-550e-b71f-216ca1e78b3c, skipping ID generation
2025-12-03 06:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item a45157ed-0b57-550e-b71f-216ca1e78b3c
2025-12-03 06:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F17706434-3e82-4e0f-9fea-bb84328067c3_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/17706434-3e82-4e0f-9fea-bb84328067c3_ext_7.jpg not downloaded yet
2025-12-03 06:06:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f5217550>
2025-12-03 06:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:06:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8ec3d9f-037e-5080-8a18-a670d1eb7b38/b8ec3d9f-037e-5080-8a18-a670d1eb7b38_image_0.jpg HTTP/1.1" 201 0
2025-12-03 06:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1976170-9999999-217150707-004.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1976170-9999999-217150707-004.jpg saved to cache
2025-12-03 06:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b8ec3d9f-037e-5080-8a18-a670d1eb7b38
2025-12-03 06:06:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 94b69d29-057e-5615-9947-92f19df1ec23 with identifier: 1877473
2025-12-03 06:06:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-03 06:06:24 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=BRONZE HTTP/1.1" 200 None
2025-12-03 06:06:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-03 06:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-03 06:06:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 94b69d29-057e-5615-9947-92f19df1ec23 with identifier: 1877473
2025-12-03 06:06:24 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 142882 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    142882
2025-12-03 06:06:24 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 94b69d29-057e-5615-9947-92f19df1ec23 spider: manheim.gb
2025-12-03 06:06:24 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 94b69d29-057e-5615-9947-92f19df1ec23 due to rule: high_mileage_for_make.json, error: 142882 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    142882
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94b69d29-057e-5615-9947-92f19df1ec23/94b69d29-057e-5615-9947-92f19df1ec23_expert_report_file_c2efaee9-f08e-4364-863f-14ccefdcbe83.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001877473-01989665-002.pdf',
 'color': 'BRONZE',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': '2025-12-10T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '94b69d29-057e-5615-9947-92f19df1ec23',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'KV18FSN',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/PEUGEOT/3008?id=1877473',
 'listing': 'auction',
 'location': 'Plymouth',
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 88783,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 26,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94b69d29-057e-5615-9947-92f19df1ec23/94b69d29-057e-5615-9947-92f19df1ec23_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 238356,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dc089fca-4db0-4844-a59b-0ea34365f4f5_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94b69d29-057e-5615-9947-92f19df1ec23/94b69d29-057e-5615-9947-92f19df1ec23_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 238356,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dc089fca-4db0-4844-a59b-0ea34365f4f5_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94b69d29-057e-5615-9947-92f19df1ec23/94b69d29-057e-5615-9947-92f19df1ec23_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 302394,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dc089fca-4db0-4844-a59b-0ea34365f4f5_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94b69d29-057e-5615-9947-92f19df1ec23/94b69d29-057e-5615-9947-92f19df1ec23_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 238059,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dc089fca-4db0-4844-a59b-0ea34365f4f5_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94b69d29-057e-5615-9947-92f19df1ec23/94b69d29-057e-5615-9947-92f19df1ec23_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 233199,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dc089fca-4db0-4844-a59b-0ea34365f4f5_5.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94b69d29-057e-5615-9947-92f19df1ec23/94b69d29-057e-5615-9947-92f19df1ec23_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 234835,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dc089fca-4db0-4844-a59b-0ea34365f4f5_4.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94b69d29-057e-5615-9947-92f19df1ec23/94b69d29-057e-5615-9947-92f19df1ec23_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 227052,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dc089fca-4db0-4844-a59b-0ea34365f4f5_11.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94b69d29-057e-5615-9947-92f19df1ec23/94b69d29-057e-5615-9947-92f19df1ec23_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 219366,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dc089fca-4db0-4844-a59b-0ea34365f4f5_10.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94b69d29-057e-5615-9947-92f19df1ec23/94b69d29-057e-5615-9947-92f19df1ec23_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 235219,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dc089fca-4db0-4844-a59b-0ea34365f4f5_9.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94b69d29-057e-5615-9947-92f19df1ec23/94b69d29-057e-5615-9947-92f19df1ec23_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 326205,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dc089fca-4db0-4844-a59b-0ea34365f4f5_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94b69d29-057e-5615-9947-92f19df1ec23/94b69d29-057e-5615-9947-92f19df1ec23_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 304999,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dc089fca-4db0-4844-a59b-0ea34365f4f5_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94b69d29-057e-5615-9947-92f19df1ec23/94b69d29-057e-5615-9947-92f19df1ec23_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 287966,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dc089fca-4db0-4844-a59b-0ea34365f4f5_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94b69d29-057e-5615-9947-92f19df1ec23/94b69d29-057e-5615-9947-92f19df1ec23_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 295873,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dc089fca-4db0-4844-a59b-0ea34365f4f5_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94b69d29-057e-5615-9947-92f19df1ec23/94b69d29-057e-5615-9947-92f19df1ec23_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 349611,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1877473-4005363-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94b69d29-057e-5615-9947-92f19df1ec23/94b69d29-057e-5615-9947-92f19df1ec23_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 255818,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1877473-4005363-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94b69d29-057e-5615-9947-92f19df1ec23/94b69d29-057e-5615-9947-92f19df1ec23_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 373337,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1877473-4005363-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94b69d29-057e-5615-9947-92f19df1ec23/94b69d29-057e-5615-9947-92f19df1ec23_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 157996,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1877473-4005363-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94b69d29-057e-5615-9947-92f19df1ec23/94b69d29-057e-5615-9947-92f19df1ec23_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 156441,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1877473-4005363-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94b69d29-057e-5615-9947-92f19df1ec23/94b69d29-057e-5615-9947-92f19df1ec23_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 300134,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1877473-4005363-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94b69d29-057e-5615-9947-92f19df1ec23/94b69d29-057e-5615-9947-92f19df1ec23_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 187500,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1877473-4005363-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-27',
 'seller_name': 'Vospers Group',
 'title': 'PEUGEOT 3008 1.6 BlueHDi 120 Allure 5dr',
 'transmission': 'manual',
 'trim': '1.6 BlueHDi 120 Allure 5dr',
 'year': 2018}
2025-12-03 06:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271877473%27 HTTP/1.1" 200 None
2025-12-03 06:06:24 [manheim.gb] INFO: Saving data for 1877473: {'created_time': 1764741984.979696, 'last_price_update_time': 1764741984.979709, 'auction_closing_time': 1765357200.0}
2025-12-03 06:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1877473') HTTP/1.1" 204 0
2025-12-03 06:06:25 [scrapy.core.engine] DEBUG: Crawled (404) <GET https://images.manheim.co.uk/images/units/zoom/i360-ext-0000-88482313-007.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001976170-01815378-004.pdf)
2025-12-03 06:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F17706434-3e82-4e0f-9fea-bb84328067c3_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/17706434-3e82-4e0f-9fea-bb84328067c3_ext_7.jpg not downloaded yet
2025-12-03 06:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F17706434-3e82-4e0f-9fea-bb84328067c3_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/17706434-3e82-4e0f-9fea-bb84328067c3_ext_6.jpg not downloaded yet
2025-12-03 06:06:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f64736d0>
2025-12-03 06:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 06:06:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_391b4f4c-6885-5c72-8cdf-5a04e9575729/391b4f4c-6885-5c72-8cdf-5a04e9575729_image_1.jpg HTTP/1.1" 201 0
2025-12-03 06:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc6b8d049-47d9-4be5-92e6-cb6861fc337b_ext_7.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c6b8d049-47d9-4be5-92e6-cb6861fc337b_ext_7.jpg saved to cache
2025-12-03 06:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 391b4f4c-6885-5c72-8cdf-5a04e9575729
2025-12-03 06:06:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f605c790>
2025-12-03 06:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:06:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_0.jpg HTTP/1.1" 201 0
2025-12-03 06:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F2255216-9999999-336141851-004.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-004.jpg saved to cache
2025-12-03 06:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ea671044-60e2-5537-89a1-04ede30d8044
2025-12-03 06:06:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ea671044-60e2-5537-89a1-04ede30d8044, skipping ID generation
2025-12-03 06:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ea671044-60e2-5537-89a1-04ede30d8044 from tracking dictionaries
2025-12-03 06:06:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ea671044-60e2-5537-89a1-04ede30d8044 sending to next pipeline
2025-12-03 06:06:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: ea671044-60e2-5537-89a1-04ede30d8044, identifier: 2255216
2025-12-03 06:06:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f65a16d0>
2025-12-03 06:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:06:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_391b4f4c-6885-5c72-8cdf-5a04e9575729/391b4f4c-6885-5c72-8cdf-5a04e9575729_image_0.jpg HTTP/1.1" 201 0
2025-12-03 06:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc6b8d049-47d9-4be5-92e6-cb6861fc337b_ext_7.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c6b8d049-47d9-4be5-92e6-cb6861fc337b_ext_7.jpg saved to cache
2025-12-03 06:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 391b4f4c-6885-5c72-8cdf-5a04e9575729
2025-12-03 06:06:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 391b4f4c-6885-5c72-8cdf-5a04e9575729, skipping ID generation
2025-12-03 06:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 391b4f4c-6885-5c72-8cdf-5a04e9575729 from tracking dictionaries
2025-12-03 06:06:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 391b4f4c-6885-5c72-8cdf-5a04e9575729 sending to next pipeline
2025-12-03 06:06:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 391b4f4c-6885-5c72-8cdf-5a04e9575729, identifier: 196679
2025-12-03 06:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F17706434-3e82-4e0f-9fea-bb84328067c3_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/17706434-3e82-4e0f-9fea-bb84328067c3_ext_1.jpg not downloaded yet
2025-12-03 06:06:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: ea671044-60e2-5537-89a1-04ede30d8044 with identifier: 2255216
2025-12-03 06:06:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: ea671044-60e2-5537-89a1-04ede30d8044 with identifier: 2255216
2025-12-03 06:06:26 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'silver', 'original_photo_count': 45, 'seller_name': 'lookers', 'price_includes_vat': False, 'title': 'ford s-max 2.0 tdci titanium 5dr [140] auto', 'price': 0, 'currency': 'gbp', 'make': 'ford', 'model': 's-max', 'transmission': 'automatic', 'engine': '2.0l', 'fuel_type': 'diesel', 'odometer': 126199, 'odometer_reading_unit': 'mi', 'registration_date': '2009-12-02', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/ford/s-max?id=2255216', 'location': 'washington', 'origin_country_code': 'gb', 'trim': '2.0 tdci titanium 5dr [140] auto', 'license_plate': 'nd59jmx', 'year': 2009, 'listing': 'auction', 'c_o_2_emission_value': 189, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002255216-01981992-002.pdf', 'expiration_date': '2025-12-03t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': 'ea671044-60e2-5537-89a1-04ede30d8044', 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_expert_report_file_c12282da-97a3-4776-a94b-3b2b60ea6a85.pdf', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_0.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-004.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 231590}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_1.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-008.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 257610}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_2.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-001.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 208840}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_3.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-002.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 241325}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_4.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-003.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 221789}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_5.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-005.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 213350}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_6.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-006.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 236719}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_7.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-007.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 237415}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_8.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-009.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 279177}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_9.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-010.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 202221}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_10.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-011.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 193282}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_11.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-012.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 264524}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_12.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2255216-4005331-13.jpg', 'Width': 1500, 'Height': 843, 'Extension': 'jpg', 'FileSizeInBytes': 474373}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_13.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2255216-4005331-1000.jpg', 'Width': 1500, 'Height': 843, 'Extension': 'jpg', 'FileSizeInBytes': 257691}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_14.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2255216-4005331-1001.jpg', 'Width': 562, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 244986}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_15.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2255216-4005331-1002.jpg', 'Width': 1500, 'Height': 843, 'Extension': 'jpg', 'FileSizeInBytes': 188218}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_16.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2255216-4005331-1003.jpg', 'Width': 1500, 'Height': 843, 'Extension': 'jpg', 'FileSizeInBytes': 339373}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_17.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2255216-4005331-1004.jpg', 'Width': 1500, 'Height': 843, 'Extension': 'jpg', 'FileSizeInBytes': 301969}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_18.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2255216-4005331-1005.jpg', 'Width': 1500, 'Height': 843, 'Extension': 'jpg', 'FileSizeInBytes': 299413}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_19.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2255216-4005331-1006.jpg', 'Width': 1500, 'Height': 843, 'Extension': 'jpg', 'FileSizeInBytes': 298095}], 'current_year_diff': 16, 'age_in_months': 192, 'make_model': 'ford s-max', 'sanitized_make': 'ford', 'odometer_in_km': 203097}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 192,
     'auction_title': '',
     'c_o_2_emission_value': 189,
     'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_expert_report_file_c12282da-97a3-4776-a94b-3b2b60ea6a85.pdf',
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002255216-01981992-002.pdf',
     'color': 'silver',
     'currency': 'gbp',
     'current_year_diff': 16,
     'engine': '2.0l',
     'expiration_date': '2025-12-03t09:00:00z',
     'fuel_type': 'diesel',
     'id': 'ea671044-60e2-5537-89a1-04ede30d8044',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'nd59jmx',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/ford/s-max?id=2255216',
     'listing': 'auction',
     'location': 'washington',
     'make': 'ford',
     'make_model': 'ford s-max',
     'model': 's-max',
     'odometer': 126199,
     'odometer_in_km': 203097,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 45,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 231590,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-004.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 257610,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-008.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 208840,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-001.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 241325,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-002.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 221789,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-003.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 213350,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-005.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 236719,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-006.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 237415,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-007.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 279177,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-009.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 202221,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-010.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 193282,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-011.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 264524,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-012.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 474373,
                 'Height': 843,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2255216-4005331-13.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 257691,
                 'Height': 843,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2255216-4005331-1000.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 244986,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2255216-4005331-1001.jpg',
                 'Width': 562},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_15.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 188218,
                 'Height': 843,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2255216-4005331-1002.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_16.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 339373,
                 'Height': 843,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2255216-4005331-1003.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_17.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 301969,
                 'Height': 843,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2255216-4005331-1004.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_18.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 299413,
                 'Height': 843,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2255216-4005331-1005.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_19.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 298095,
                 'Height': 843,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2255216-4005331-1006.jpg',
                 'Width': 1500}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2009-12-02',
     'sanitized_make': 'ford',
     'seller_name': 'lookers',
     'title': 'ford s-max 2.0 tdci titanium 5dr [140] auto',
     'transmission': 'automatic',
     'trim': '2.0 tdci titanium 5dr [140] auto',
     'year': 2009}
2025-12-03 06:06:26 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: ea671044-60e2-5537-89a1-04ede30d8044 spider: manheim.gb
2025-12-03 06:06:26 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: ea671044-60e2-5537-89a1-04ede30d8044 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'silver', 'original_photo_count': 45, 'seller_name': 'lookers', 'price_includes_vat': False, 'title': 'ford s-max 2.0 tdci titanium 5dr [140] auto', 'price': 0, 'currency': 'gbp', 'make': 'ford', 'model': 's-max', 'transmission': 'automatic', 'engine': '2.0l', 'fuel_type': 'diesel', 'odometer': 126199, 'odometer_reading_unit': 'mi', 'registration_date': '2009-12-02', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/ford/s-max?id=2255216', 'location': 'washington', 'origin_country_code': 'gb', 'trim': '2.0 tdci titanium 5dr [140] auto', 'license_plate': 'nd59jmx', 'year': 2009, 'listing': 'auction', 'c_o_2_emission_value': 189, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002255216-01981992-002.pdf', 'expiration_date': '2025-12-03t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': 'ea671044-60e2-5537-89a1-04ede30d8044', 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_expert_report_file_c12282da-97a3-4776-a94b-3b2b60ea6a85.pdf', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_0.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-004.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 231590}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_1.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-008.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 257610}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_2.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-001.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 208840}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_3.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-002.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 241325}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_4.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-003.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 221789}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_5.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-005.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 213350}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_6.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-006.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 236719}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_7.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-007.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 237415}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_8.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-009.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 279177}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_9.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-010.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 202221}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_10.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-011.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 193282}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_11.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-012.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 264524}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_12.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2255216-4005331-13.jpg', 'Width': 1500, 'Height': 843, 'Extension': 'jpg', 'FileSizeInBytes': 474373}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_13.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2255216-4005331-1000.jpg', 'Width': 1500, 'Height': 843, 'Extension': 'jpg', 'FileSizeInBytes': 257691}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_14.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2255216-4005331-1001.jpg', 'Width': 562, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 244986}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_15.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2255216-4005331-1002.jpg', 'Width': 1500, 'Height': 843, 'Extension': 'jpg', 'FileSizeInBytes': 188218}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_16.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2255216-4005331-1003.jpg', 'Width': 1500, 'Height': 843, 'Extension': 'jpg', 'FileSizeInBytes': 339373}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_17.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2255216-4005331-1004.jpg', 'Width': 1500, 'Height': 843, 'Extension': 'jpg', 'FileSizeInBytes': 301969}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_18.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2255216-4005331-1005.jpg', 'Width': 1500, 'Height': 843, 'Extension': 'jpg', 'FileSizeInBytes': 299413}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_19.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2255216-4005331-1006.jpg', 'Width': 1500, 'Height': 843, 'Extension': 'jpg', 'FileSizeInBytes': 298095}], 'current_year_diff': 16, 'age_in_months': 192, 'make_model': 'ford s-max', 'sanitized_make': 'ford', 'odometer_in_km': 203097}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 192,
     'auction_title': '',
     'c_o_2_emission_value': 189,
     'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_expert_report_file_c12282da-97a3-4776-a94b-3b2b60ea6a85.pdf',
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002255216-01981992-002.pdf',
     'color': 'silver',
     'currency': 'gbp',
     'current_year_diff': 16,
     'engine': '2.0l',
     'expiration_date': '2025-12-03t09:00:00z',
     'fuel_type': 'diesel',
     'id': 'ea671044-60e2-5537-89a1-04ede30d8044',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'nd59jmx',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/ford/s-max?id=2255216',
     'listing': 'auction',
     'location': 'washington',
     'make': 'ford',
     'make_model': 'ford s-max',
     'model': 's-max',
     'odometer': 126199,
     'odometer_in_km': 203097,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 45,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 231590,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-004.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 257610,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-008.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 208840,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-001.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 241325,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-002.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 221789,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-003.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 213350,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-005.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 236719,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-006.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 237415,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-007.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 279177,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-009.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 202221,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-010.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 193282,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-011.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 264524,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-012.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 474373,
                 'Height': 843,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2255216-4005331-13.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 257691,
                 'Height': 843,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2255216-4005331-1000.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 244986,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2255216-4005331-1001.jpg',
                 'Width': 562},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_15.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 188218,
                 'Height': 843,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2255216-4005331-1002.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_16.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 339373,
                 'Height': 843,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2255216-4005331-1003.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_17.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 301969,
                 'Height': 843,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2255216-4005331-1004.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_18.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 299413,
                 'Height': 843,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2255216-4005331-1005.jpg',
                 'Width': 1500},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_19.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 298095,
                 'Height': 843,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2255216-4005331-1006.jpg',
                 'Width': 1500}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2009-12-02',
     'sanitized_make': 'ford',
     'seller_name': 'lookers',
     'title': 'ford s-max 2.0 tdci titanium 5dr [140] auto',
     'transmission': 'automatic',
     'trim': '2.0 tdci titanium 5dr [140] auto',
     'year': 2009}
{'auction_title': '',
 'c_o_2_emission_value': 189,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_expert_report_file_c12282da-97a3-4776-a94b-3b2b60ea6a85.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002255216-01981992-002.pdf',
 'color': 'SILVER',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': '2025-12-03T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'ea671044-60e2-5537-89a1-04ede30d8044',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'ND59JMX',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FORD/S-MAX?id=2255216',
 'listing': 'auction',
 'location': 'Washington',
 'make': 'FORD',
 'model': 'S-MAX',
 'odometer': 126199,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 45,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 231590,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257610,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-008.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 208840,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 241325,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 221789,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 213350,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-005.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 236719,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-006.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 237415,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-007.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 279177,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-009.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 202221,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-010.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 193282,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-011.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 264524,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/2255216-9999999-336141851-012.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 474373,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2255216-4005331-13.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257691,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2255216-4005331-1000.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 244986,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2255216-4005331-1001.jpg',
             'Width': 562},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 188218,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2255216-4005331-1002.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 339373,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2255216-4005331-1003.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 301969,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2255216-4005331-1004.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 299413,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2255216-4005331-1005.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea671044-60e2-5537-89a1-04ede30d8044/ea671044-60e2-5537-89a1-04ede30d8044_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 298095,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2255216-4005331-1006.jpg',
             'Width': 1500}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-12-02',
 'seller_name': 'Lookers',
 'title': 'FORD S-MAX 2.0 TDCi Titanium 5dr [140] Auto',
 'transmission': 'automatic',
 'trim': '2.0 TDCi Titanium 5dr [140] Auto',
 'year': 2009}
2025-12-03 06:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272255216%27 HTTP/1.1" 200 None
2025-12-03 06:06:26 [manheim.gb] INFO: Saving data for 2255216: {'created_time': 1764741986.503656, 'last_price_update_time': 1764741986.503667, 'auction_closing_time': 1764752400.0}
2025-12-03 06:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2255216') HTTP/1.1" 204 0
2025-12-03 06:06:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 391b4f4c-6885-5c72-8cdf-5a04e9575729 with identifier: 196679
2025-12-03 06:06:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 391b4f4c-6885-5c72-8cdf-5a04e9575729 with identifier: 196679
2025-12-03 06:06:26 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 156889 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    156889
2025-12-03 06:06:26 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 391b4f4c-6885-5c72-8cdf-5a04e9575729 spider: manheim.gb
2025-12-03 06:06:26 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 391b4f4c-6885-5c72-8cdf-5a04e9575729 due to rule: high_mileage_for_country.json, error: 156889 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    156889
{'auction_title': '',
 'c_o_2_emission_value': 197,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_391b4f4c-6885-5c72-8cdf-5a04e9575729/391b4f4c-6885-5c72-8cdf-5a04e9575729_expert_report_file_c3f0ea3c-9a1a-4df2-bd54-aa53ba259b41.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0000196679-01983681-002.pdf',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '2.5L',
 'expiration_date': '2025-12-03T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '391b4f4c-6885-5c72-8cdf-5a04e9575729',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'MH08CPV',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/BMW/Z4?id=196679',
 'listing': 'auction',
 'location': 'Leeds',
 'make': 'BMW',
 'model': 'Z4',
 'odometer': 97487,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 35,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_391b4f4c-6885-5c72-8cdf-5a04e9575729/391b4f4c-6885-5c72-8cdf-5a04e9575729_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 196821,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c6b8d049-47d9-4be5-92e6-cb6861fc337b_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_391b4f4c-6885-5c72-8cdf-5a04e9575729/391b4f4c-6885-5c72-8cdf-5a04e9575729_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 196821,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c6b8d049-47d9-4be5-92e6-cb6861fc337b_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_391b4f4c-6885-5c72-8cdf-5a04e9575729/391b4f4c-6885-5c72-8cdf-5a04e9575729_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 203713,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c6b8d049-47d9-4be5-92e6-cb6861fc337b_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_391b4f4c-6885-5c72-8cdf-5a04e9575729/391b4f4c-6885-5c72-8cdf-5a04e9575729_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 215145,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c6b8d049-47d9-4be5-92e6-cb6861fc337b_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_391b4f4c-6885-5c72-8cdf-5a04e9575729/391b4f4c-6885-5c72-8cdf-5a04e9575729_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 180694,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c6b8d049-47d9-4be5-92e6-cb6861fc337b_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_391b4f4c-6885-5c72-8cdf-5a04e9575729/391b4f4c-6885-5c72-8cdf-5a04e9575729_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 191894,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c6b8d049-47d9-4be5-92e6-cb6861fc337b_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_391b4f4c-6885-5c72-8cdf-5a04e9575729/391b4f4c-6885-5c72-8cdf-5a04e9575729_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 179742,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c6b8d049-47d9-4be5-92e6-cb6861fc337b_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_391b4f4c-6885-5c72-8cdf-5a04e9575729/391b4f4c-6885-5c72-8cdf-5a04e9575729_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 188789,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c6b8d049-47d9-4be5-92e6-cb6861fc337b_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_391b4f4c-6885-5c72-8cdf-5a04e9575729/391b4f4c-6885-5c72-8cdf-5a04e9575729_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 199339,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c6b8d049-47d9-4be5-92e6-cb6861fc337b_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_391b4f4c-6885-5c72-8cdf-5a04e9575729/391b4f4c-6885-5c72-8cdf-5a04e9575729_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 204739,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c6b8d049-47d9-4be5-92e6-cb6861fc337b_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_391b4f4c-6885-5c72-8cdf-5a04e9575729/391b4f4c-6885-5c72-8cdf-5a04e9575729_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 187537,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c6b8d049-47d9-4be5-92e6-cb6861fc337b_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_391b4f4c-6885-5c72-8cdf-5a04e9575729/391b4f4c-6885-5c72-8cdf-5a04e9575729_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 176002,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c6b8d049-47d9-4be5-92e6-cb6861fc337b_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_391b4f4c-6885-5c72-8cdf-5a04e9575729/391b4f4c-6885-5c72-8cdf-5a04e9575729_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 286643,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c6b8d049-47d9-4be5-92e6-cb6861fc337b_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_391b4f4c-6885-5c72-8cdf-5a04e9575729/391b4f4c-6885-5c72-8cdf-5a04e9575729_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 303989,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-196679-4003916-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_391b4f4c-6885-5c72-8cdf-5a04e9575729/391b4f4c-6885-5c72-8cdf-5a04e9575729_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 450735,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-196679-4003916-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_391b4f4c-6885-5c72-8cdf-5a04e9575729/391b4f4c-6885-5c72-8cdf-5a04e9575729_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 230297,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-196679-4003916-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_391b4f4c-6885-5c72-8cdf-5a04e9575729/391b4f4c-6885-5c72-8cdf-5a04e9575729_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 270257,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-196679-4003916-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_391b4f4c-6885-5c72-8cdf-5a04e9575729/391b4f4c-6885-5c72-8cdf-5a04e9575729_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 306463,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-196679-4003916-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_391b4f4c-6885-5c72-8cdf-5a04e9575729/391b4f4c-6885-5c72-8cdf-5a04e9575729_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 407322,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-196679-4003916-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_391b4f4c-6885-5c72-8cdf-5a04e9575729/391b4f4c-6885-5c72-8cdf-5a04e9575729_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 303949,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-196679-4003916-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-03-17',
 'seller_name': 'Perrys',
 'title': 'BMW Z4 2.5i SE 2dr',
 'transmission': 'manual',
 'trim': '2.5i SE 2dr',
 'year': 2008}
2025-12-03 06:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27196679%27 HTTP/1.1" 200 None
2025-12-03 06:06:26 [manheim.gb] INFO: Saving data for 196679: {'created_time': 1764741986.764407, 'last_price_update_time': 1764741986.764419, 'auction_closing_time': 1764752400.0}
2025-12-03 06:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='196679') HTTP/1.1" 204 0
2025-12-03 06:06:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b8ec3d9f-037e-5080-8a18-a670d1eb7b38, skipping ID generation
2025-12-03 06:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b8ec3d9f-037e-5080-8a18-a670d1eb7b38 from tracking dictionaries
2025-12-03 06:06:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b8ec3d9f-037e-5080-8a18-a670d1eb7b38 sending to next pipeline
2025-12-03 06:06:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: b8ec3d9f-037e-5080-8a18-a670d1eb7b38, identifier: 1976170
2025-12-03 06:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F17706434-3e82-4e0f-9fea-bb84328067c3_5.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/17706434-3e82-4e0f-9fea-bb84328067c3_5.jpg not downloaded yet
2025-12-03 06:06:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: b8ec3d9f-037e-5080-8a18-a670d1eb7b38 with identifier: 1976170
2025-12-03 06:06:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: b8ec3d9f-037e-5080-8a18-a670d1eb7b38 with identifier: 1976170
2025-12-03 06:06:27 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: b8ec3d9f-037e-5080-8a18-a670d1eb7b38 with identifier: 1976170 to the API
2025-12-03 06:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 06:06:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 06:06:27 [scrapy.core.scraper] DEBUG: Scraped from <404 https://images.manheim.co.uk/images/units/zoom/i360-ext-0000-88482313-007.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8ec3d9f-037e-5080-8a18-a670d1eb7b38/b8ec3d9f-037e-5080-8a18-a670d1eb7b38_expert_report_file_29e070a7-c9a3-4a55-ad95-7d63567860f6.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001976170-01815378-004.pdf',
 'color': 'SILVER',
 'currency': 'GBP',
 'engine': '2.9L',
 'expiration_date': '2025-12-05T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'b8ec3d9f-037e-5080-8a18-a670d1eb7b38',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'ML18RKX',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/S%20CLASS?id=1976170',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'MERCEDES-BENZ',
 'model': 'S CLASS',
 'odometer': 40257,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 34,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8ec3d9f-037e-5080-8a18-a670d1eb7b38/b8ec3d9f-037e-5080-8a18-a670d1eb7b38_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 625105,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1976170-9999999-217150707-004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8ec3d9f-037e-5080-8a18-a670d1eb7b38/b8ec3d9f-037e-5080-8a18-a670d1eb7b38_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107846,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1976170-9999999-217150707-008.jpg',
             'Width': 1379},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8ec3d9f-037e-5080-8a18-a670d1eb7b38/b8ec3d9f-037e-5080-8a18-a670d1eb7b38_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66157,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1976170-9999999-217150707-001.jpg',
             'Width': 1379},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8ec3d9f-037e-5080-8a18-a670d1eb7b38/b8ec3d9f-037e-5080-8a18-a670d1eb7b38_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 420324,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1976170-9999999-217150707-002.jpg',
             'Width': 749},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8ec3d9f-037e-5080-8a18-a670d1eb7b38/b8ec3d9f-037e-5080-8a18-a670d1eb7b38_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 608939,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1976170-9999999-217150707-003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8ec3d9f-037e-5080-8a18-a670d1eb7b38/b8ec3d9f-037e-5080-8a18-a670d1eb7b38_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 492629,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1976170-9999999-217150707-005.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8ec3d9f-037e-5080-8a18-a670d1eb7b38/b8ec3d9f-037e-5080-8a18-a670d1eb7b38_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74744,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1976170-9999999-217150707-006.jpg',
             'Width': 1379},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8ec3d9f-037e-5080-8a18-a670d1eb7b38/b8ec3d9f-037e-5080-8a18-a670d1eb7b38_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 383008,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1976170-9999999-217150707-007.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8ec3d9f-037e-5080-8a18-a670d1eb7b38/b8ec3d9f-037e-5080-8a18-a670d1eb7b38_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107846,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1976170-9999999-217150707-009.jpg',
             'Width': 1379},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8ec3d9f-037e-5080-8a18-a670d1eb7b38/b8ec3d9f-037e-5080-8a18-a670d1eb7b38_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90820,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1976170-9999999-217150707-010.jpg',
             'Width': 1379},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8ec3d9f-037e-5080-8a18-a670d1eb7b38/b8ec3d9f-037e-5080-8a18-a670d1eb7b38_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90820,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1976170-9999999-217150707-011.jpg',
             'Width': 1379},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8ec3d9f-037e-5080-8a18-a670d1eb7b38/b8ec3d9f-037e-5080-8a18-a670d1eb7b38_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76385,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1976170-9999999-217150707-012.jpg',
             'Width': 1379},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8ec3d9f-037e-5080-8a18-a670d1eb7b38/b8ec3d9f-037e-5080-8a18-a670d1eb7b38_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 499915,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1976170-3871875-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8ec3d9f-037e-5080-8a18-a670d1eb7b38/b8ec3d9f-037e-5080-8a18-a670d1eb7b38_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 248149,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1976170-3871875-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8ec3d9f-037e-5080-8a18-a670d1eb7b38/b8ec3d9f-037e-5080-8a18-a670d1eb7b38_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 495508,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1976170-3871875-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8ec3d9f-037e-5080-8a18-a670d1eb7b38/b8ec3d9f-037e-5080-8a18-a670d1eb7b38_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 249701,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1976170-3871875-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8ec3d9f-037e-5080-8a18-a670d1eb7b38/b8ec3d9f-037e-5080-8a18-a670d1eb7b38_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 211829,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1976170-3871875-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8ec3d9f-037e-5080-8a18-a670d1eb7b38/b8ec3d9f-037e-5080-8a18-a670d1eb7b38_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 212668,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1976170-3871875-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8ec3d9f-037e-5080-8a18-a670d1eb7b38/b8ec3d9f-037e-5080-8a18-a670d1eb7b38_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 409408,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1976170-3871875-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-31',
 'seller_name': 'FCA Group',
 'title': 'MERCEDES-BENZ S CLASS S350d L AMG Line 4dr 9G-Tronic',
 'transmission': 'automatic',
 'trim': 'S350d L AMG Line 4dr 9G-Tronic',
 'year': 2018}
2025-12-03 06:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271976170%27 HTTP/1.1" 200 None
2025-12-03 06:06:27 [manheim.gb] INFO: Saving data for 1976170: {'created_time': 1764741987.269152, 'last_price_update_time': 1764741987.269163, 'auction_closing_time': 1764925200.0}
2025-12-03 06:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1976170') HTTP/1.1" 204 0
2025-12-03 06:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/17706434-3e82-4e0f-9fea-bb84328067c3_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001815539-01989158-003.pdf)
2025-12-03 06:06:27 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item b8ec3d9f-037e-5080-8a18-a670d1eb7b38 due to Ignoring non-200 response
2025-12-03 06:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/17706434-3e82-4e0f-9fea-bb84328067c3_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001815539-01989158-003.pdf)
2025-12-03 06:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F17706434-3e82-4e0f-9fea-bb84328067c3_4.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/17706434-3e82-4e0f-9fea-bb84328067c3_4.jpg not downloaded yet
2025-12-03 06:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F17706434-3e82-4e0f-9fea-bb84328067c3_11.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/17706434-3e82-4e0f-9fea-bb84328067c3_11.jpg not downloaded yet
2025-12-03 06:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/17706434-3e82-4e0f-9fea-bb84328067c3_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001815539-01989158-003.pdf)
2025-12-03 06:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F17706434-3e82-4e0f-9fea-bb84328067c3_10.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/17706434-3e82-4e0f-9fea-bb84328067c3_10.jpg not downloaded yet
2025-12-03 06:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F17706434-3e82-4e0f-9fea-bb84328067c3_9.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/17706434-3e82-4e0f-9fea-bb84328067c3_9.jpg not downloaded yet
2025-12-03 06:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F17706434-3e82-4e0f-9fea-bb84328067c3_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/17706434-3e82-4e0f-9fea-bb84328067c3_ext_2.jpg not downloaded yet
2025-12-03 06:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F17706434-3e82-4e0f-9fea-bb84328067c3_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/17706434-3e82-4e0f-9fea-bb84328067c3_ext_5.jpg not downloaded yet
2025-12-03 06:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F17706434-3e82-4e0f-9fea-bb84328067c3_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/17706434-3e82-4e0f-9fea-bb84328067c3_ext_3.jpg not downloaded yet
2025-12-03 06:06:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f65f36d0>
2025-12-03 06:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 06:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a45157ed-0b57-550e-b71f-216ca1e78b3c/a45157ed-0b57-550e-b71f-216ca1e78b3c_image_0.jpg HTTP/1.1" 201 0
2025-12-03 06:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F17706434-3e82-4e0f-9fea-bb84328067c3_ext_7.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/17706434-3e82-4e0f-9fea-bb84328067c3_ext_7.jpg saved to cache
2025-12-03 06:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a45157ed-0b57-550e-b71f-216ca1e78b3c
2025-12-03 06:06:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f639ec90>
2025-12-03 06:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a45157ed-0b57-550e-b71f-216ca1e78b3c/a45157ed-0b57-550e-b71f-216ca1e78b3c_image_1.jpg HTTP/1.1" 201 0
2025-12-03 06:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F17706434-3e82-4e0f-9fea-bb84328067c3_ext_7.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/17706434-3e82-4e0f-9fea-bb84328067c3_ext_7.jpg saved to cache
2025-12-03 06:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a45157ed-0b57-550e-b71f-216ca1e78b3c
2025-12-03 06:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0000157293-01983966-003.pdf> (referer: None)
2025-12-03 06:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F17706434-3e82-4e0f-9fea-bb84328067c3_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/17706434-3e82-4e0f-9fea-bb84328067c3_ext_4.jpg not downloaded yet
2025-12-03 06:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/17706434-3e82-4e0f-9fea-bb84328067c3_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001815539-01989158-003.pdf)
2025-12-03 06:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1815539-4005001-13.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1815539-4005001-13.jpg not downloaded yet
2025-12-03 06:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/17706434-3e82-4e0f-9fea-bb84328067c3_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001815539-01989158-003.pdf)
2025-12-03 06:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/17706434-3e82-4e0f-9fea-bb84328067c3_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001815539-01989158-003.pdf)
2025-12-03 06:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/17706434-3e82-4e0f-9fea-bb84328067c3_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001815539-01989158-003.pdf)
2025-12-03 06:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/17706434-3e82-4e0f-9fea-bb84328067c3_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001815539-01989158-003.pdf)
2025-12-03 06:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/17706434-3e82-4e0f-9fea-bb84328067c3_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001815539-01989158-003.pdf)
2025-12-03 06:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1815539-4005001-1000.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1815539-4005001-1000.jpg not downloaded yet
2025-12-03 06:06:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6473710>
2025-12-03 06:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:06:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a45157ed-0b57-550e-b71f-216ca1e78b3c/a45157ed-0b57-550e-b71f-216ca1e78b3c_image_2.jpg HTTP/1.1" 201 0
2025-12-03 06:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F17706434-3e82-4e0f-9fea-bb84328067c3_ext_6.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/17706434-3e82-4e0f-9fea-bb84328067c3_ext_6.jpg saved to cache
2025-12-03 06:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a45157ed-0b57-550e-b71f-216ca1e78b3c
2025-12-03 06:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/17706434-3e82-4e0f-9fea-bb84328067c3_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001815539-01989158-003.pdf)
2025-12-03 06:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1815539-4005001-1001.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1815539-4005001-1001.jpg not downloaded yet
2025-12-03 06:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1815539-4005001-1002.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1815539-4005001-1002.jpg not downloaded yet
2025-12-03 06:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/17706434-3e82-4e0f-9fea-bb84328067c3_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001815539-01989158-003.pdf)
2025-12-03 06:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/17706434-3e82-4e0f-9fea-bb84328067c3_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001815539-01989158-003.pdf)
2025-12-03 06:06:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f5b8bbd0>
2025-12-03 06:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:06:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f/dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f_expert_report_file_5e2cd622-ffe3-4fe9-ad73-14e9f991d1aa.pdf HTTP/1.1" 201 0
2025-12-03 06:06:28 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f
2025-12-03 06:06:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f, skipping ID generation
2025-12-03 06:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f
2025-12-03 06:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F157293-9999999-332085417-004.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/157293-9999999-332085417-004.jpg not downloaded yet
2025-12-03 06:06:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f622bcd0>
2025-12-03 06:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:06:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a45157ed-0b57-550e-b71f-216ca1e78b3c/a45157ed-0b57-550e-b71f-216ca1e78b3c_image_3.jpg HTTP/1.1" 201 0
2025-12-03 06:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F17706434-3e82-4e0f-9fea-bb84328067c3_ext_1.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/17706434-3e82-4e0f-9fea-bb84328067c3_ext_1.jpg saved to cache
2025-12-03 06:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a45157ed-0b57-550e-b71f-216ca1e78b3c
2025-12-03 06:06:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6445610>
2025-12-03 06:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:06:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a45157ed-0b57-550e-b71f-216ca1e78b3c/a45157ed-0b57-550e-b71f-216ca1e78b3c_image_4.jpg HTTP/1.1" 201 0
2025-12-03 06:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F17706434-3e82-4e0f-9fea-bb84328067c3_5.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/17706434-3e82-4e0f-9fea-bb84328067c3_5.jpg saved to cache
2025-12-03 06:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a45157ed-0b57-550e-b71f-216ca1e78b3c
2025-12-03 06:06:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f5b8a5d0>
2025-12-03 06:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:06:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a45157ed-0b57-550e-b71f-216ca1e78b3c/a45157ed-0b57-550e-b71f-216ca1e78b3c_image_5.jpg HTTP/1.1" 201 0
2025-12-03 06:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F17706434-3e82-4e0f-9fea-bb84328067c3_4.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/17706434-3e82-4e0f-9fea-bb84328067c3_4.jpg saved to cache
2025-12-03 06:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a45157ed-0b57-550e-b71f-216ca1e78b3c
2025-12-03 06:06:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f64d2cd0>
2025-12-03 06:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 06:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a45157ed-0b57-550e-b71f-216ca1e78b3c/a45157ed-0b57-550e-b71f-216ca1e78b3c_image_6.jpg HTTP/1.1" 201 0
2025-12-03 06:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F17706434-3e82-4e0f-9fea-bb84328067c3_11.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/17706434-3e82-4e0f-9fea-bb84328067c3_11.jpg saved to cache
2025-12-03 06:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a45157ed-0b57-550e-b71f-216ca1e78b3c
2025-12-03 06:06:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f622a910>
2025-12-03 06:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a45157ed-0b57-550e-b71f-216ca1e78b3c/a45157ed-0b57-550e-b71f-216ca1e78b3c_image_7.jpg HTTP/1.1" 201 0
2025-12-03 06:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F17706434-3e82-4e0f-9fea-bb84328067c3_10.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/17706434-3e82-4e0f-9fea-bb84328067c3_10.jpg saved to cache
2025-12-03 06:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a45157ed-0b57-550e-b71f-216ca1e78b3c
2025-12-03 06:06:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f63b0290>
2025-12-03 06:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 06:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a45157ed-0b57-550e-b71f-216ca1e78b3c/a45157ed-0b57-550e-b71f-216ca1e78b3c_image_9.jpg HTTP/1.1" 201 0
2025-12-03 06:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F17706434-3e82-4e0f-9fea-bb84328067c3_ext_2.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/17706434-3e82-4e0f-9fea-bb84328067c3_ext_2.jpg saved to cache
2025-12-03 06:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a45157ed-0b57-550e-b71f-216ca1e78b3c
2025-12-03 06:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/17706434-3e82-4e0f-9fea-bb84328067c3_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001815539-01989158-003.pdf)
2025-12-03 06:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1815539-4005001-1003.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1815539-4005001-1003.jpg not downloaded yet
2025-12-03 06:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F157293-9999999-332085417-008.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/157293-9999999-332085417-008.jpg not downloaded yet
2025-12-03 06:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1815539-4005001-1004.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1815539-4005001-1004.jpg not downloaded yet
2025-12-03 06:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F157293-9999999-332085417-001.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/157293-9999999-332085417-001.jpg not downloaded yet
2025-12-03 06:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1815539-4005001-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001815539-01989158-003.pdf)
2025-12-03 06:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1815539-4005001-1005.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1815539-4005001-1005.jpg not downloaded yet
2025-12-03 06:06:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6133810>
2025-12-03 06:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:06:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a45157ed-0b57-550e-b71f-216ca1e78b3c/a45157ed-0b57-550e-b71f-216ca1e78b3c_image_8.jpg HTTP/1.1" 201 0
2025-12-03 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F17706434-3e82-4e0f-9fea-bb84328067c3_9.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/17706434-3e82-4e0f-9fea-bb84328067c3_9.jpg saved to cache
2025-12-03 06:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a45157ed-0b57-550e-b71f-216ca1e78b3c
2025-12-03 06:06:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f5b507d0>
2025-12-03 06:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:06:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a45157ed-0b57-550e-b71f-216ca1e78b3c/a45157ed-0b57-550e-b71f-216ca1e78b3c_image_10.jpg HTTP/1.1" 201 0
2025-12-03 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F17706434-3e82-4e0f-9fea-bb84328067c3_ext_5.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/17706434-3e82-4e0f-9fea-bb84328067c3_ext_5.jpg saved to cache
2025-12-03 06:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item a45157ed-0b57-550e-b71f-216ca1e78b3c
2025-12-03 06:06:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f5b81950>
2025-12-03 06:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:06:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a45157ed-0b57-550e-b71f-216ca1e78b3c/a45157ed-0b57-550e-b71f-216ca1e78b3c_image_12.jpg HTTP/1.1" 201 0
2025-12-03 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F17706434-3e82-4e0f-9fea-bb84328067c3_ext_4.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/17706434-3e82-4e0f-9fea-bb84328067c3_ext_4.jpg saved to cache
2025-12-03 06:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item a45157ed-0b57-550e-b71f-216ca1e78b3c
2025-12-03 06:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1815539-4005001-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001815539-01989158-003.pdf)
2025-12-03 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F157293-9999999-332085417-002.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/157293-9999999-332085417-002.jpg not downloaded yet
2025-12-03 06:06:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6493b50>
2025-12-03 06:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 06:06:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a45157ed-0b57-550e-b71f-216ca1e78b3c/a45157ed-0b57-550e-b71f-216ca1e78b3c_image_11.jpg HTTP/1.1" 201 0
2025-12-03 06:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F17706434-3e82-4e0f-9fea-bb84328067c3_ext_3.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/17706434-3e82-4e0f-9fea-bb84328067c3_ext_3.jpg saved to cache
2025-12-03 06:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item a45157ed-0b57-550e-b71f-216ca1e78b3c
2025-12-03 06:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1815539-4005001-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001815539-01989158-003.pdf)
2025-12-03 06:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1815539-4005001-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001815539-01989158-003.pdf)
2025-12-03 06:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F157293-9999999-332085417-003.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/157293-9999999-332085417-003.jpg not downloaded yet
2025-12-03 06:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/157293-9999999-332085417-004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000157293-01983966-003.pdf)
2025-12-03 06:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F157293-9999999-332085417-005.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/157293-9999999-332085417-005.jpg not downloaded yet
2025-12-03 06:06:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f5b72350>
2025-12-03 06:06:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:06:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a45157ed-0b57-550e-b71f-216ca1e78b3c/a45157ed-0b57-550e-b71f-216ca1e78b3c_image_14.jpg HTTP/1.1" 201 0
2025-12-03 06:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1815539-4005001-1000.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1815539-4005001-1000.jpg saved to cache
2025-12-03 06:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item a45157ed-0b57-550e-b71f-216ca1e78b3c
2025-12-03 06:06:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f627ba90>
2025-12-03 06:06:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:06:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a45157ed-0b57-550e-b71f-216ca1e78b3c/a45157ed-0b57-550e-b71f-216ca1e78b3c_image_13.jpg HTTP/1.1" 201 0
2025-12-03 06:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1815539-4005001-13.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1815539-4005001-13.jpg saved to cache
2025-12-03 06:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item a45157ed-0b57-550e-b71f-216ca1e78b3c
2025-12-03 06:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1815539-4005001-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001815539-01989158-003.pdf)
2025-12-03 06:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/157293-9999999-332085417-008.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000157293-01983966-003.pdf)
2025-12-03 06:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F157293-9999999-332085417-006.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/157293-9999999-332085417-006.jpg not downloaded yet
2025-12-03 06:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1815539-4005001-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001815539-01989158-003.pdf)
2025-12-03 06:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F157293-9999999-332085417-007.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/157293-9999999-332085417-007.jpg not downloaded yet
2025-12-03 06:06:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6022610>
2025-12-03 06:06:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 06:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a45157ed-0b57-550e-b71f-216ca1e78b3c/a45157ed-0b57-550e-b71f-216ca1e78b3c_image_16.jpg HTTP/1.1" 201 0
2025-12-03 06:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1815539-4005001-1002.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1815539-4005001-1002.jpg saved to cache
2025-12-03 06:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item a45157ed-0b57-550e-b71f-216ca1e78b3c
2025-12-03 06:06:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6446b90>
2025-12-03 06:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a45157ed-0b57-550e-b71f-216ca1e78b3c/a45157ed-0b57-550e-b71f-216ca1e78b3c_image_17.jpg HTTP/1.1" 201 0
2025-12-03 06:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1815539-4005001-1003.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1815539-4005001-1003.jpg saved to cache
2025-12-03 06:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item a45157ed-0b57-550e-b71f-216ca1e78b3c
2025-12-03 06:06:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f630de90>
2025-12-03 06:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f/dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f_image_0.jpg HTTP/1.1" 201 0
2025-12-03 06:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F157293-9999999-332085417-004.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/157293-9999999-332085417-004.jpg saved to cache
2025-12-03 06:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f
2025-12-03 06:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/157293-9999999-332085417-001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000157293-01983966-003.pdf)
2025-12-03 06:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1815539-4005001-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001815539-01989158-003.pdf)
2025-12-03 06:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/157293-9999999-332085417-002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000157293-01983966-003.pdf)
2025-12-03 06:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F157293-9999999-332085417-009.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/157293-9999999-332085417-009.jpg not downloaded yet
2025-12-03 06:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F157293-9999999-332085417-010.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/157293-9999999-332085417-010.jpg not downloaded yet
2025-12-03 06:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/157293-9999999-332085417-003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000157293-01983966-003.pdf)
2025-12-03 06:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/157293-9999999-332085417-005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000157293-01983966-003.pdf)
2025-12-03 06:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F157293-9999999-332085417-011.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/157293-9999999-332085417-011.jpg not downloaded yet
2025-12-03 06:06:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f65afc50>
2025-12-03 06:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a45157ed-0b57-550e-b71f-216ca1e78b3c/a45157ed-0b57-550e-b71f-216ca1e78b3c_image_15.jpg HTTP/1.1" 201 0
2025-12-03 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1815539-4005001-1001.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1815539-4005001-1001.jpg saved to cache
2025-12-03 06:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item a45157ed-0b57-550e-b71f-216ca1e78b3c
2025-12-03 06:06:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f602cf10>
2025-12-03 06:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 06:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f/dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f_image_1.jpg HTTP/1.1" 201 0
2025-12-03 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F157293-9999999-332085417-008.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/157293-9999999-332085417-008.jpg saved to cache
2025-12-03 06:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f
2025-12-03 06:06:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f5b80f10>
2025-12-03 06:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a45157ed-0b57-550e-b71f-216ca1e78b3c/a45157ed-0b57-550e-b71f-216ca1e78b3c_image_18.jpg HTTP/1.1" 201 0
2025-12-03 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1815539-4005001-1004.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1815539-4005001-1004.jpg saved to cache
2025-12-03 06:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item a45157ed-0b57-550e-b71f-216ca1e78b3c
2025-12-03 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F157293-9999999-332085417-012.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/157293-9999999-332085417-012.jpg not downloaded yet
2025-12-03 06:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/157293-9999999-332085417-006.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000157293-01983966-003.pdf)
2025-12-03 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-157293-4001059-13.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-157293-4001059-13.jpg not downloaded yet
2025-12-03 06:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/157293-9999999-332085417-007.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000157293-01983966-003.pdf)
2025-12-03 06:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/157293-9999999-332085417-009.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000157293-01983966-003.pdf)
2025-12-03 06:06:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6174b10>
2025-12-03 06:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f/dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f_image_2.jpg HTTP/1.1" 201 0
2025-12-03 06:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F157293-9999999-332085417-001.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/157293-9999999-332085417-001.jpg saved to cache
2025-12-03 06:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f
2025-12-03 06:06:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f65f0550>
2025-12-03 06:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a45157ed-0b57-550e-b71f-216ca1e78b3c/a45157ed-0b57-550e-b71f-216ca1e78b3c_image_19.jpg HTTP/1.1" 201 0
2025-12-03 06:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1815539-4005001-1005.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1815539-4005001-1005.jpg saved to cache
2025-12-03 06:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item a45157ed-0b57-550e-b71f-216ca1e78b3c
2025-12-03 06:06:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a45157ed-0b57-550e-b71f-216ca1e78b3c, skipping ID generation
2025-12-03 06:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a45157ed-0b57-550e-b71f-216ca1e78b3c from tracking dictionaries
2025-12-03 06:06:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a45157ed-0b57-550e-b71f-216ca1e78b3c sending to next pipeline
2025-12-03 06:06:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: a45157ed-0b57-550e-b71f-216ca1e78b3c, identifier: 1815539
2025-12-03 06:06:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6031310>
2025-12-03 06:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f/dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f_image_3.jpg HTTP/1.1" 201 0
2025-12-03 06:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F157293-9999999-332085417-002.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/157293-9999999-332085417-002.jpg saved to cache
2025-12-03 06:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f
2025-12-03 06:06:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6279590>
2025-12-03 06:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 06:06:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f/dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f_image_4.jpg HTTP/1.1" 201 0
2025-12-03 06:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F157293-9999999-332085417-003.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/157293-9999999-332085417-003.jpg saved to cache
2025-12-03 06:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f
2025-12-03 06:06:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f61f7450>
2025-12-03 06:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:06:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f/dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f_image_5.jpg HTTP/1.1" 201 0
2025-12-03 06:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F157293-9999999-332085417-005.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/157293-9999999-332085417-005.jpg saved to cache
2025-12-03 06:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f
2025-12-03 06:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-157293-4001059-1000.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-157293-4001059-1000.jpg not downloaded yet
2025-12-03 06:06:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: a45157ed-0b57-550e-b71f-216ca1e78b3c with identifier: 1815539
2025-12-03 06:06:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: a45157ed-0b57-550e-b71f-216ca1e78b3c with identifier: 1815539
2025-12-03 06:06:36 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: a45157ed-0b57-550e-b71f-216ca1e78b3c with identifier: 1815539 to the API
2025-12-03 06:06:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 06:06:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 06:06:36 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/insp-0001-1815539-4005001-1005.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a45157ed-0b57-550e-b71f-216ca1e78b3c/a45157ed-0b57-550e-b71f-216ca1e78b3c_expert_report_file_ef79e2f3-2fcc-4675-a7f5-606eba7314d9.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001815539-01989158-003.pdf',
 'color': 'White',
 'currency': 'GBP',
 'engine': '0.9L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'a45157ed-0b57-550e-b71f-216ca1e78b3c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'EA17OMF',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/RENAULT/CAPTUR?id=1815539',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'RENAULT',
 'model': 'CAPTUR',
 'odometer': 35301,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a45157ed-0b57-550e-b71f-216ca1e78b3c/a45157ed-0b57-550e-b71f-216ca1e78b3c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 169135,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/17706434-3e82-4e0f-9fea-bb84328067c3_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a45157ed-0b57-550e-b71f-216ca1e78b3c/a45157ed-0b57-550e-b71f-216ca1e78b3c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 169135,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/17706434-3e82-4e0f-9fea-bb84328067c3_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a45157ed-0b57-550e-b71f-216ca1e78b3c/a45157ed-0b57-550e-b71f-216ca1e78b3c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 268599,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/17706434-3e82-4e0f-9fea-bb84328067c3_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a45157ed-0b57-550e-b71f-216ca1e78b3c/a45157ed-0b57-550e-b71f-216ca1e78b3c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 126491,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/17706434-3e82-4e0f-9fea-bb84328067c3_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a45157ed-0b57-550e-b71f-216ca1e78b3c/a45157ed-0b57-550e-b71f-216ca1e78b3c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 164333,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/17706434-3e82-4e0f-9fea-bb84328067c3_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a45157ed-0b57-550e-b71f-216ca1e78b3c/a45157ed-0b57-550e-b71f-216ca1e78b3c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 155799,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/17706434-3e82-4e0f-9fea-bb84328067c3_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a45157ed-0b57-550e-b71f-216ca1e78b3c/a45157ed-0b57-550e-b71f-216ca1e78b3c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 161202,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/17706434-3e82-4e0f-9fea-bb84328067c3_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a45157ed-0b57-550e-b71f-216ca1e78b3c/a45157ed-0b57-550e-b71f-216ca1e78b3c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 148701,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/17706434-3e82-4e0f-9fea-bb84328067c3_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a45157ed-0b57-550e-b71f-216ca1e78b3c/a45157ed-0b57-550e-b71f-216ca1e78b3c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 164609,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/17706434-3e82-4e0f-9fea-bb84328067c3_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a45157ed-0b57-550e-b71f-216ca1e78b3c/a45157ed-0b57-550e-b71f-216ca1e78b3c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 240136,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/17706434-3e82-4e0f-9fea-bb84328067c3_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a45157ed-0b57-550e-b71f-216ca1e78b3c/a45157ed-0b57-550e-b71f-216ca1e78b3c_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 236862,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/17706434-3e82-4e0f-9fea-bb84328067c3_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a45157ed-0b57-550e-b71f-216ca1e78b3c/a45157ed-0b57-550e-b71f-216ca1e78b3c_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 279723,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/17706434-3e82-4e0f-9fea-bb84328067c3_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a45157ed-0b57-550e-b71f-216ca1e78b3c/a45157ed-0b57-550e-b71f-216ca1e78b3c_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 250795,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/17706434-3e82-4e0f-9fea-bb84328067c3_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a45157ed-0b57-550e-b71f-216ca1e78b3c/a45157ed-0b57-550e-b71f-216ca1e78b3c_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 305234,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1815539-4005001-13.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a45157ed-0b57-550e-b71f-216ca1e78b3c/a45157ed-0b57-550e-b71f-216ca1e78b3c_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 227318,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1815539-4005001-1000.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a45157ed-0b57-550e-b71f-216ca1e78b3c/a45157ed-0b57-550e-b71f-216ca1e78b3c_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 322641,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1815539-4005001-1001.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a45157ed-0b57-550e-b71f-216ca1e78b3c/a45157ed-0b57-550e-b71f-216ca1e78b3c_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 124798,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1815539-4005001-1002.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a45157ed-0b57-550e-b71f-216ca1e78b3c/a45157ed-0b57-550e-b71f-216ca1e78b3c_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113118,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1815539-4005001-1003.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a45157ed-0b57-550e-b71f-216ca1e78b3c/a45157ed-0b57-550e-b71f-216ca1e78b3c_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 330520,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1815539-4005001-1004.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a45157ed-0b57-550e-b71f-216ca1e78b3c/a45157ed-0b57-550e-b71f-216ca1e78b3c_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 310679,
             'Height': 843,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1815539-4005001-1005.jpg',
             'Width': 1500}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-30',
 'seller_name': 'Big Motoring World Ltd',
 'title': 'RENAULT CAPTUR 0.9 TCE 90 Dynamique S Nav 5dr',
 'transmission': 'manual',
 'trim': '0.9 TCE 90 Dynamique S Nav 5dr',
 'year': 2017}
2025-12-03 06:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271815539%27 HTTP/1.1" 200 None
2025-12-03 06:06:37 [manheim.gb] INFO: Saving data for 1815539: {'created_time': 1764741997.038529, 'last_price_update_time': 1764741997.038541, 'auction_closing_time': 1764838800.0}
2025-12-03 06:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1815539') HTTP/1.1" 204 0
2025-12-03 06:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-157293-4001059-1001.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-157293-4001059-1001.jpg not downloaded yet
2025-12-03 06:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/157293-9999999-332085417-010.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000157293-01983966-003.pdf)
2025-12-03 06:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/157293-9999999-332085417-011.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000157293-01983966-003.pdf)
2025-12-03 06:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/157293-9999999-332085417-012.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000157293-01983966-003.pdf)
2025-12-03 06:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-157293-4001059-1002.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-157293-4001059-1002.jpg not downloaded yet
2025-12-03 06:06:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6014790>
2025-12-03 06:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:06:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f/dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f_image_6.jpg HTTP/1.1" 201 0
2025-12-03 06:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F157293-9999999-332085417-006.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/157293-9999999-332085417-006.jpg saved to cache
2025-12-03 06:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f
2025-12-03 06:06:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f61ea490>
2025-12-03 06:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:06:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f/dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f_image_7.jpg HTTP/1.1" 201 0
2025-12-03 06:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F157293-9999999-332085417-007.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/157293-9999999-332085417-007.jpg saved to cache
2025-12-03 06:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f
2025-12-03 06:06:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6592c10>
2025-12-03 06:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:06:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f/dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f_image_8.jpg HTTP/1.1" 201 0
2025-12-03 06:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F157293-9999999-332085417-009.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/157293-9999999-332085417-009.jpg saved to cache
2025-12-03 06:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f
2025-12-03 06:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-157293-4001059-1003.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-157293-4001059-1003.jpg not downloaded yet
2025-12-03 06:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-157293-4001059-1004.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-157293-4001059-1004.jpg not downloaded yet
2025-12-03 06:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-157293-4001059-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000157293-01983966-003.pdf)
2025-12-03 06:06:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f645c450>
2025-12-03 06:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 06:06:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f/dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f_image_9.jpg HTTP/1.1" 201 0
2025-12-03 06:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F157293-9999999-332085417-010.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/157293-9999999-332085417-010.jpg saved to cache
2025-12-03 06:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f
2025-12-03 06:06:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f64aed10>
2025-12-03 06:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:06:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f/dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f_image_10.jpg HTTP/1.1" 201 0
2025-12-03 06:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F157293-9999999-332085417-011.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/157293-9999999-332085417-011.jpg saved to cache
2025-12-03 06:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f
2025-12-03 06:06:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f61eb790>
2025-12-03 06:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:06:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f/dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f_image_11.jpg HTTP/1.1" 201 0
2025-12-03 06:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F157293-9999999-332085417-012.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/157293-9999999-332085417-012.jpg saved to cache
2025-12-03 06:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f
2025-12-03 06:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-157293-4001059-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000157293-01983966-003.pdf)
2025-12-03 06:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-157293-4001059-1005.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-157293-4001059-1005.jpg not downloaded yet
2025-12-03 06:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-157293-4001059-1006.jpg%27 HTTP/1.1" 200 None
2025-12-03 06:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-157293-4001059-1006.jpg not downloaded yet
2025-12-03 06:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-157293-4001059-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000157293-01983966-003.pdf)
2025-12-03 06:06:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f520f610>
2025-12-03 06:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:06:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f/dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f_image_13.jpg HTTP/1.1" 201 0
2025-12-03 06:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-157293-4001059-1000.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-157293-4001059-1000.jpg saved to cache
2025-12-03 06:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f
2025-12-03 06:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-157293-4001059-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000157293-01983966-003.pdf)
2025-12-03 06:06:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f645eb10>
2025-12-03 06:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 06:06:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f/dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f_image_12.jpg HTTP/1.1" 201 0
2025-12-03 06:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-157293-4001059-13.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-157293-4001059-13.jpg saved to cache
2025-12-03 06:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f
2025-12-03 06:06:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f6323810>
2025-12-03 06:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:06:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f/dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f_image_14.jpg HTTP/1.1" 201 0
2025-12-03 06:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-157293-4001059-1001.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-157293-4001059-1001.jpg saved to cache
2025-12-03 06:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f
2025-12-03 06:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-157293-4001059-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000157293-01983966-003.pdf)
2025-12-03 06:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-157293-4001059-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000157293-01983966-003.pdf)
2025-12-03 06:06:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f627b950>
2025-12-03 06:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:06:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f/dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f_image_15.jpg HTTP/1.1" 201 0
2025-12-03 06:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-157293-4001059-1002.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-157293-4001059-1002.jpg saved to cache
2025-12-03 06:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f
2025-12-03 06:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-157293-4001059-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000157293-01983966-003.pdf)
2025-12-03 06:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-157293-4001059-1006.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000157293-01983966-003.pdf)
2025-12-03 06:06:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f52d8190>
2025-12-03 06:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 06:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f/dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f_image_16.jpg HTTP/1.1" 201 0
2025-12-03 06:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-157293-4001059-1003.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-157293-4001059-1003.jpg saved to cache
2025-12-03 06:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f
2025-12-03 06:06:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f5b700d0>
2025-12-03 06:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 06:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f/dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f_image_17.jpg HTTP/1.1" 201 0
2025-12-03 06:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-157293-4001059-1004.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-157293-4001059-1004.jpg saved to cache
2025-12-03 06:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f
2025-12-03 06:06:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f62b8090>
2025-12-03 06:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 06:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f/dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f_image_18.jpg HTTP/1.1" 201 0
2025-12-03 06:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-157293-4001059-1005.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-157293-4001059-1005.jpg saved to cache
2025-12-03 06:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f
2025-12-03 06:06:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 06:06:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 06:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 06:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f56f602cf10>
2025-12-03 06:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 06:06:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 06:06:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 06:06:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 06:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 06:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 06:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f/dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f_image_19.jpg HTTP/1.1" 201 0
2025-12-03 06:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-157293-4001059-1006.jpg') HTTP/1.1" 204 0
2025-12-03 06:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-157293-4001059-1006.jpg saved to cache
2025-12-03 06:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f
2025-12-03 06:06:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f, skipping ID generation
2025-12-03 06:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Removing item dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f from tracking dictionaries
2025-12-03 06:06:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f sending to next pipeline
2025-12-03 06:06:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f, identifier: 157293
2025-12-03 06:06:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f with identifier: 157293
2025-12-03 06:06:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f with identifier: 157293
2025-12-03 06:06:41 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 11 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    11
2025-12-03 06:06:41 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f spider: manheim.gb
2025-12-03 06:06:41 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f due to rule: registration_date_old.json, error: 11 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    11
{'auction_title': '',
 'c_o_2_emission_value': 95,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f/dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f_expert_report_file_5e2cd622-ffe3-4fe9-ad73-14e9f991d1aa.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0000157293-01983966-003.pdf',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '1.0L',
 'expiration_date': '2025-12-03T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'AK64MDN',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/CITROEN/C1?id=157293',
 'listing': 'auction',
 'location': 'Washington',
 'make': 'CITROEN',
 'model': 'C1',
 'odometer': 65718,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 25,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f/dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 239137,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/157293-9999999-332085417-004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f/dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 256202,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/157293-9999999-332085417-008.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f/dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 267224,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/157293-9999999-332085417-001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f/dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 274890,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/157293-9999999-332085417-002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f/dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 233963,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/157293-9999999-332085417-003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f/dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 254989,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/157293-9999999-332085417-005.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f/dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 195013,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/157293-9999999-332085417-006.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f/dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 221482,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/157293-9999999-332085417-007.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f/dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 251766,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/157293-9999999-332085417-009.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f/dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 197969,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/157293-9999999-332085417-010.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f/dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 210291,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/157293-9999999-332085417-011.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f/dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 161024,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/157293-9999999-332085417-012.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f/dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 313996,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-157293-4001059-13.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f/dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 215769,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-157293-4001059-1000.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f/dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 159386,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-157293-4001059-1001.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f/dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 283916,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-157293-4001059-1002.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f/dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 323846,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-157293-4001059-1003.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f/dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 362607,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-157293-4001059-1004.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f/dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 278562,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-157293-4001059-1005.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f/dbbfd0dd-7cc7-5e5d-b76a-d9fd7a75373f_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 404305,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-157293-4001059-1006.jpg',
             'Width': 1500}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-27',
 'seller_name': 'Lookers',
 'title': 'CITROEN C1 1.0 VTi Flair 5dr',
 'transmission': 'manual',
 'trim': '1.0 VTi Flair 5dr',
 'year': 2014}
2025-12-03 06:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27157293%27 HTTP/1.1" 200 None
2025-12-03 06:06:41 [manheim.gb] INFO: Saving data for 157293: {'created_time': 1764742001.767162, 'last_price_update_time': 1764742001.767175, 'auction_closing_time': 1764752400.0}
2025-12-03 06:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='157293') HTTP/1.1" 204 0
2025-12-03 06:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/BMW/3SERIES?id=1564349&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231564349&indx=45> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:06:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7b4d8b4-f51c-5a50-a36b-21ec74e869f9 with identifier: 1564349
2025-12-03 06:06:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7b4d8b4-f51c-5a50-a36b-21ec74e869f9 with scrape type 2
2025-12-03 06:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7b4d8b4-f51c-5a50-a36b-21ec74e869f9 with scrape type 2
2025-12-03 06:06:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: f7b4d8b4-f51c-5a50-a36b-21ec74e869f9, identifier: 1564349
2025-12-03 06:06:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: f7b4d8b4-f51c-5a50-a36b-21ec74e869f9 with identifier: 1564349
2025-12-03 06:06:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: f7b4d8b4-f51c-5a50-a36b-21ec74e869f9 with identifier: 1564349
2025-12-03 06:06:48 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 186210 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    186210
2025-12-03 06:06:48 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: f7b4d8b4-f51c-5a50-a36b-21ec74e869f9 spider: manheim.gb
2025-12-03 06:06:48 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: f7b4d8b4-f51c-5a50-a36b-21ec74e869f9 due to rule: high_mileage_for_country.json, error: 186210 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    186210
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001564349-01975633-004.pdf',
 'color': 'BLUE',
 'currency': 'GBP',
 'engine': '3.0L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'f7b4d8b4-f51c-5a50-a36b-21ec74e869f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'KRZ7767',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/BMW/3%20SERIES?id=1564349',
 'listing': 'directbuy',
 'location': 'Leeds',
 'make': 'BMW',
 'model': '3 SERIES',
 'odometer': 115706,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-25',
 'seller_name': 'Motor Dough',
 'title': 'BMW 3 SERIES 335d xDrive M Sport 5dr Step Auto [Business Media]',
 'transmission': 'automatic',
 'trim': '335d xDrive M Sport 5dr Step Auto [Business Media]',
 'year': 2016}
2025-12-03 06:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271564349%27 HTTP/1.1" 200 None
2025-12-03 06:06:49 [manheim.gb] INFO: Saving data for 1564349: {'auction_closing_time': 1764838800.0, 'created_time': 1764584139.011789, 'last_price_update_time': 1764742009.006136}
2025-12-03 06:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1564349') HTTP/1.1" 204 0
2025-12-03 06:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/FORD/FOCUS?id=1563459&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231563459&indx=44> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 06:07:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b91ba86d-bc73-5696-96a9-f412028ff431 with identifier: 1563459
2025-12-03 06:07:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b91ba86d-bc73-5696-96a9-f412028ff431 with scrape type 2
2025-12-03 06:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b91ba86d-bc73-5696-96a9-f412028ff431 with scrape type 2
2025-12-03 06:07:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: b91ba86d-bc73-5696-96a9-f412028ff431, identifier: 1563459
2025-12-03 06:07:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: b91ba86d-bc73-5696-96a9-f412028ff431 with identifier: 1563459
2025-12-03 06:07:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: b91ba86d-bc73-5696-96a9-f412028ff431 with identifier: 1563459
2025-12-03 06:07:08 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: b91ba86d-bc73-5696-96a9-f412028ff431 with identifier: 1563459 to the API
2025-12-03 06:07:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 06:07:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 06:07:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/FORD/FOCUS?id=1563459&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231563459&indx=44>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001563459-01985804-003.pdf',
 'color': 'Silver',
 'currency': 'GBP',
 'engine': '1.5L',
 'expiration_date': '2025-12-05T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'b91ba86d-bc73-5696-96a9-f412028ff431',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'BW17UEY',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FORD/FOCUS?id=1563459',
 'listing': 'auction',
 'location': 'Birmingham',
 'make': 'FORD',
 'model': 'FOCUS',
 'odometer': 68158,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-12',
 'seller_name': 'Perrys',
 'title': 'FORD FOCUS 1.5 TDCi 120 Zetec Edition 5dr',
 'transmission': 'manual',
 'trim': '1.5 TDCi 120 Zetec Edition 5dr',
 'year': 2017}
2025-12-03 06:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271563459%27 HTTP/1.1" 200 None
2025-12-03 06:07:08 [manheim.gb] INFO: Saving data for 1563459: {'auction_closing_time': 1764925200.0, 'created_time': 1764584148.940929, 'last_price_update_time': 1764742028.283144}
2025-12-03 06:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1563459') HTTP/1.1" 204 0
2025-12-03 06:07:08 [scrapy.core.engine] INFO: Closing spider (finished)
2025-12-03 06:07:08 [manheim.gb] INFO: manheim.gb Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0}
2025-12-03 06:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272948457%27 HTTP/1.1" 200 None
2025-12-03 06:07:08 [manheim.gb] INFO: Saving data for 2948457: {'created_time': 1764742028.431845}
2025-12-03 06:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2948457') HTTP/1.1" 204 0
2025-12-03 06:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 06:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20last_price_update_time%20lt%201764310028 HTTP/1.1" 200 None
2025-12-03 06:07:08 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (36 items) in: file:///var/lib/scrapyd/items/sourcing_v2/manheim.gb/task_37_2025-12-03T06_00_02.jl
2025-12-03 06:07:08 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 729102,
 'downloader/request_count': 544,
 'downloader/request_method_count/GET': 542,
 'downloader/request_method_count/POST': 2,
 'downloader/response_bytes': 198161327,
 'downloader/response_count': 544,
 'downloader/response_status_count/200': 542,
 'downloader/response_status_count/404': 2,
 'elapsed_time_seconds': 407.756411,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2025, 12, 3, 6, 7, 8, 528140, tzinfo=datetime.timezone.utc),
 'item_dropped_count': 49,
 'item_dropped_reasons_count/DropItem': 49,
 'item_scraped_count': 36,
 'log_count/DEBUG': 5652,
 'log_count/ERROR': 15,
 'log_count/INFO': 5214,
 'memusage/max': 199987200,
 'memusage/startup': 127119360,
 'photo_download_count': 433,
 'playwright/context_count': 1,
 'playwright/context_count/max_concurrent': 1,
 'playwright/context_count/persistent/False': 1,
 'playwright/context_count/remote/False': 1,
 'playwright/page_count': 1,
 'playwright/page_count/max_concurrent': 1,
 'playwright/request_count': 85,
 'playwright/request_count/aborted': 47,
 'playwright/request_count/method/GET': 82,
 'playwright/request_count/method/POST': 3,
 'playwright/request_count/navigation': 4,
 'playwright/request_count/resource_type/document': 4,
 'playwright/request_count/resource_type/font': 8,
 'playwright/request_count/resource_type/image': 41,
 'playwright/request_count/resource_type/script': 22,
 'playwright/request_count/resource_type/stylesheet': 8,
 'playwright/request_count/resource_type/xhr': 2,
 'playwright/response_count': 38,
 'playwright/response_count/method/GET': 35,
 'playwright/response_count/method/POST': 3,
 'playwright/response_count/resource_type/document': 4,
 'playwright/response_count/resource_type/font': 8,
 'playwright/response_count/resource_type/script': 16,
 'playwright/response_count/resource_type/stylesheet': 8,
 'playwright/response_count/resource_type/xhr': 2,
 'request_depth_max': 5,
 'response_received_count': 111,
 'scheduler/dequeued': 544,
 'scheduler/dequeued/memory': 544,
 'scheduler/enqueued': 544,
 'scheduler/enqueued/memory': 544,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 88,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 28.640703110950366,
 'scrapy-zyte-api/mean_response_seconds': 28.8678042295082,
 'scrapy-zyte-api/processed': 88,
 'scrapy-zyte-api/request_args/actions': 86,
 'scrapy-zyte-api/request_args/browserHtml': 86,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 2,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 88,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 88,
 'scrapy-zyte-api/request_args/httpRequestBody': 2,
 'scrapy-zyte-api/request_args/httpRequestMethod': 2,
 'scrapy-zyte-api/request_args/httpResponseBody': 2,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 2,
 'scrapy-zyte-api/request_args/requestHeaders': 86,
 'scrapy-zyte-api/request_args/sessionContext': 86,
 'scrapy-zyte-api/request_args/url': 88,
 'scrapy-zyte-api/status_codes/200': 88,
 'scrapy-zyte-api/success': 88,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'spider_exceptions/HttpError': 1,
 'spider_exceptions/ValueError': 1,
 'start_time': datetime.datetime(2025, 12, 3, 6, 0, 20, 771729, tzinfo=datetime.timezone.utc)}
2025-12-03 06:07:08 [scrapy.core.engine] INFO: Spider closed (finished)