2025-12-03 10:00:15 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2025-12-03 10:00:15 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2025-12-03 10:00:15 [manheim.gb] INFO: Starting spider manheim.gb
2025-12-03 10:00:15 [scrapy.addons] INFO: Enabled addons:
[]
2025-12-03 10:00:15 [asyncio] DEBUG: Using selector: EpollSelector
2025-12-03 10:00:15 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2025-12-03 10:00:15 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2025-12-03 10:00:15 [scrapy.extensions.telnet] INFO: Telnet Password: bfeea653dc9b9d44
2025-12-03 10:00:15 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2025-12-03 10:00:15 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/manheim.gb/task_37_2025-12-03T10_00_03.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2025-12-03 10:00:15 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2025-12-03 10:00:15 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2025-12-03 10:00:15 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2025-12-03 10:00:15 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2025-12-03 10:00:15 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2025-12-03 10:00:15 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2025-12-03 10:00:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:00:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 10:00:15 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2025-12-03 10:00:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2025-12-03 10:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:00:15 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2025-12-03 10:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2025-12-03 10:00:15 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2025-12-03 10:00:15 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: low_mileage_for_country.json
2025-12-03 10:00:15 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage.json
2025-12-03 10:00:15 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2025-12-03 10:00:15 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2025-12-03 10:00:15 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2025-12-03 10:00:15 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2025-12-03 10:00:15 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2025-12-03 10:00:15 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2025-12-03 10:00:15 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2025-12-03 10:00:15 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2025-12-03 10:00:15 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: cars_too_new_for_country.json
2025-12-03 10:00:15 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_price_for_currency.json
2025-12-03 10:00:15 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2025-12-03 10:00:15 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2025-12-03 10:00:15 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2025-12-03 10:00:15 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2025-12-03 10:00:15 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage_for_country.json
2025-12-03 10:00:15 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2025-12-03 10:00:15 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2025-12-03 10:00:15 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2025-12-03 10:00:15 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2025-12-03 10:00:15 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2025-12-03 10:00:15 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: registration_date_old.json
2025-12-03 10:00:15 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage_for_make.json
2025-12-03 10:00:15 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2025-12-03 10:00:15 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2025-12-03 10:00:15 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2025-12-03 10:00:15 [scrapy.core.engine] INFO: Spider opened
2025-12-03 10:00:15 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2025-12-03 10:00:15 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6024
2025-12-03 10:00:15 [scrapy-playwright] INFO: Starting download handler
2025-12-03 10:00:15 [scrapy-playwright] INFO: Starting download handler
2025-12-03 10:00:20 [scrapy-playwright] INFO: Launching browser firefox
2025-12-03 10:00:21 [scrapy-playwright] INFO: Browser firefox launched
2025-12-03 10:00:21 [scrapy-playwright] DEBUG: Browser context started: 'default' (persistent=False, remote=False)
2025-12-03 10:00:22 [scrapy-playwright] DEBUG: [Context=default] New page created, page count is 1 (1 for all contexts)
2025-12-03 10:00:22 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/> (resource type: document)
2025-12-03 10:00:22 [scrapy-playwright] DEBUG: [Context=default] Response: <407 https://www.manheim.co.uk/>
2025-12-03 10:00:22 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/> (resource type: document)
2025-12-03 10:00:24 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/>
2025-12-03 10:00:24 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/bundle?v=HcGNblHj64wK-Istb_0SemQAL-rwtK13kDPW8q3LCIo1> (resource type: stylesheet, referrer: https://www.manheim.co.uk/)
2025-12-03 10:00:24 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/bundles/delete/scripts/homepage?v=CIpuZXIp0V7i0j1sjTB9sUemSg9-D9w8k891UP0sReI1> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-03 10:00:24 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/top_navigationlogo.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-03 10:00:24 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/top_navigationlogo.ashx?la=en>
2025-12-03 10:00:24 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/homepage_new.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-03 10:00:24 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/homepage_new.ashx?la=en>
2025-12-03 10:00:24 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/auction-centre-pages/auction-centre-c114-treated--hero.ashx?la=en&mw=960> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-03 10:00:24 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/auction-centre-pages/auction-centre-c114-treated--hero.ashx?la=en&mw=960>
2025-12-03 10:00:24 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/new-website-images-2021/vehicle-solutions/vs-3.ashx?la=en&mw=960> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-03 10:00:24 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/new-website-images-2021/vehicle-solutions/vs-3.ashx?la=en&mw=960>
2025-12-03 10:00:24 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/inspections-and-collections/inspections-and-collections-b87-treated---hero.ashx?la=en&mw=960> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-03 10:00:24 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimvehiclesearchpage2.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-03 10:00:24 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/inspections-and-collections/inspections-and-collections-b87-treated---hero.ashx?la=en&mw=960>
2025-12-03 10:00:24 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimvehiclesearchpage2.ashx?la=en>
2025-12-03 10:00:24 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/Scripts/Manheim/tellnumberchange.js> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-03 10:00:24 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/Scripts/Manheim/RemoveSignUpBanner.js> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-03 10:00:24 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/bundle?v=HcGNblHj64wK-Istb_0SemQAL-rwtK13kDPW8q3LCIo1>
2025-12-03 10:00:24 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/jquery-ui-1.13.2.min.css> (resource type: stylesheet, referrer: https://www.manheim.co.uk/assets/css/bundle?v=HcGNblHj64wK-Istb_0SemQAL-rwtK13kDPW8q3LCIo1)
2025-12-03 10:00:24 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/core-blessed1.min.css> (resource type: stylesheet, referrer: https://www.manheim.co.uk/assets/css/bundle?v=HcGNblHj64wK-Istb_0SemQAL-rwtK13kDPW8q3LCIo1)
2025-12-03 10:00:24 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/bundles/delete/scripts/homepage?v=CIpuZXIp0V7i0j1sjTB9sUemSg9-D9w8k891UP0sReI1>
2025-12-03 10:00:24 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/Scripts/Manheim/tellnumberchange.js>
2025-12-03 10:00:24 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/Scripts/Manheim/RemoveSignUpBanner.js>
2025-12-03 10:00:24 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/jquery-ui-1.13.2.min.css>
2025-12-03 10:00:24 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/core-blessed1.min.css>
2025-12-03 10:00:24 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Light.woff> (resource type: font, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-03 10:00:24 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/top_navigationlogo.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-03 10:00:24 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/top_navigationlogo.ashx?la=en>
2025-12-03 10:00:24 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/homepage_new.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-03 10:00:24 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/homepage_new.ashx?la=en>
2025-12-03 10:00:24 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/auction-centre-pages/auction-centre-c114-treated--hero.ashx?la=en&mw=960> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-03 10:00:24 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/auction-centre-pages/auction-centre-c114-treated--hero.ashx?la=en&mw=960>
2025-12-03 10:00:24 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/new-website-images-2021/vehicle-solutions/vs-3.ashx?la=en&mw=960> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-03 10:00:24 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/new-website-images-2021/vehicle-solutions/vs-3.ashx?la=en&mw=960>
2025-12-03 10:00:24 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/inspections-and-collections/inspections-and-collections-b87-treated---hero.ashx?la=en&mw=960> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-03 10:00:24 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/inspections-and-collections/inspections-and-collections-b87-treated---hero.ashx?la=en&mw=960>
2025-12-03 10:00:24 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimvehiclesearchpage2.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-03 10:00:24 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimvehiclesearchpage2.ashx?la=en>
2025-12-03 10:00:24 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.googletagmanager.com/gtm.js?id=GTM-KZS96H> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-03 10:00:24 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.googletagmanager.com/gtm.js?id=GTM-KZS96H>
2025-12-03 10:00:24 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/images/filters/dot_pattern.png> (resource type: image, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-03 10:00:24 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/assets/images/filters/dot_pattern.png>
2025-12-03 10:00:24 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/images/branding/dropdown.png> (resource type: image, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-03 10:00:24 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/assets/images/branding/dropdown.png>
2025-12-03 10:00:24 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Regular.woff> (resource type: font, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-03 10:00:24 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Bold.woff> (resource type: font, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-03 10:00:24 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/fonts/Manheim-Icons/Manheim-Icons.woff> (resource type: font, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-03 10:00:25 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Light.woff>
2025-12-03 10:00:25 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://www.manheim.co.uk/Account/IsCookieExist> (resource type: xhr, referrer: https://www.manheim.co.uk/)
2025-12-03 10:00:25 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/buying-options/buying-options-c153-treated--hero.ashx?la=en&mw=1920> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-03 10:00:25 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/buying-options/buying-options-c153-treated--hero.ashx?la=en&mw=1920>
2025-12-03 10:00:25 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/manheimcolchester10.ashx?la=en&mw=1920> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-03 10:00:25 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/manheimcolchester10.ashx?la=en&mw=1920>
2025-12-03 10:00:25 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/auction-centre-pages/auction-centre-8665-treated--hero.ashx?la=en&mw=1920> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-03 10:00:25 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/auction-centre-pages/auction-centre-8665-treated--hero.ashx?la=en&mw=1920>
2025-12-03 10:00:25 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Regular.woff>
2025-12-03 10:00:25 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Bold.woff>
2025-12-03 10:00:25 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/fonts/Manheim-Icons/Manheim-Icons.woff>
2025-12-03 10:00:25 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://js-agent.newrelic.com/nr-spa-1.303.0.min.js> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-03 10:00:25 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://js-agent.newrelic.com/nr-spa-1.303.0.min.js>
2025-12-03 10:00:25 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://pi.pardot.com/pd.js> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-03 10:00:25 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/Account/IsCookieExist>
2025-12-03 10:00:25 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://js-agent.newrelic.com/nr-spa-1.303.0.min.js> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-03 10:00:25 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://js-agent.newrelic.com/nr-spa-1.303.0.min.js>
2025-12-03 10:00:27 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://pi.pardot.com/pd.js>
2025-12-03 10:00:27 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://pi.pardot.com/analytics?ver=3&visitor_id=&visitor_id_sign=&pi_opt_in=&campaign_id=24684&account_id=38592&title=Manheim%20%7C%20Auctions%2C%20Vehicle%20Solutions%20%26%20Remarketing&url=https%3A%2F%2Fwww.manheim.co.uk%2F&referrer=> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-03 10:00:28 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://pi.pardot.com/analytics?ver=3&visitor_id=&visitor_id_sign=&pi_opt_in=&campaign_id=24684&account_id=38592&title=Manheim%20%7C%20Auctions%2C%20Vehicle%20Solutions%20%26%20Remarketing&url=https%3A%2F%2Fwww.manheim.co.uk%2F&referrer=>
2025-12-03 10:00:28 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://brands.coxauto.co.uk/analytics?conly=true&visitor_id=918689418&visitor_id_sign=db7c41298ee700418b5258db5d3ccad48c64ad081e3698abddb6fe6c0b17b7a46c66b426e2836f7ae4b4b734b7b521195b7fde4e&pi_opt_in=&campaign_id=24684&account_id=38592&title=Manheim%20%7C%20Auctions%2C%20Vehicle%20Solutions%20%26%20Remarketing&url=https%3A%2F%2Fwww.manheim.co.uk%2F&referrer=> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-03 10:00:29 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://brands.coxauto.co.uk/analytics?conly=true&visitor_id=918689418&visitor_id_sign=db7c41298ee700418b5258db5d3ccad48c64ad081e3698abddb6fe6c0b17b7a46c66b426e2836f7ae4b4b734b7b521195b7fde4e&pi_opt_in=&campaign_id=24684&account_id=38592&title=Manheim%20%7C%20Auctions%2C%20Vehicle%20Solutions%20%26%20Remarketing&url=https%3A%2F%2Fwww.manheim.co.uk%2F&referrer=>
2025-12-03 10:00:35 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://www.manheim.co.uk/account/login> (resource type: document, referrer: https://www.manheim.co.uk/)
2025-12-03 10:00:36 [scrapy-playwright] DEBUG: [Context=default] Response: <302 https://www.manheim.co.uk/account/login> (location: /mymanheim/dashboard)
2025-12-03 10:00:36 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/mymanheim/dashboard> (resource type: document, referrer: https://www.manheim.co.uk/)
2025-12-03 10:00:37 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/mymanheim/dashboard>
2025-12-03 10:00:37 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/bundle?v=HcGNblHj64wK-Istb_0SemQAL-rwtK13kDPW8q3LCIo1> (resource type: stylesheet, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-03 10:00:37 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/bundles/delete/scripts/postlogin?v=Bwe963dGqUB3Sdny8E3tKSL2gV9GDgLwX1g6Gq6KF-A1> (resource type: script, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-03 10:00:37 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/SignalR/Hubs> (resource type: script, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-03 10:00:37 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimwhitecoxautomotive3.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-03 10:00:38 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimwhitecoxautomotive3.ashx?la=en>
2025-12-03 10:00:38 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/Scripts/jquery-ui-1.12.1.js> (resource type: script, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-03 10:00:38 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/Content/myManheim.css> (resource type: stylesheet, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-03 10:00:38 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/bundles/simulcast?v=P7s0oLmuXc3p3WQNs8URnZ4NaK3K6qkWLOwf0uOs5gw1> (resource type: script, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-03 10:00:38 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/Content/dashboards.css> (resource type: stylesheet, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-03 10:00:38 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/new-manheim-booking.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-03 10:00:38 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/new-manheim-booking.ashx?la=en>
2025-12-03 10:00:38 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/blog/2025/gavel_2025.ashx?h=176&la=en&w=210&crop=1> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-03 10:00:38 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/blog/2025/gavel_2025.ashx?h=176&la=en&w=210&crop=1>
2025-12-03 10:00:38 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/img_6251.ashx?h=176&la=en&w=210&crop=1> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-03 10:00:38 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/img_6251.ashx?h=176&la=en&w=210&crop=1>
2025-12-03 10:00:38 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/movex/payg1.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-03 10:00:38 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/movex/payg1.ashx?la=en>
2025-12-03 10:00:38 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/v3--design11918banner535x191px-(1).ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-03 10:00:38 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/v3--design11918banner535x191px-(1).ashx?la=en>
2025-12-03 10:00:38 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/campaigns/nama/nama-lcv-location-banner.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-03 10:00:38 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/campaigns/nama/nama-lcv-location-banner.ashx?la=en>
2025-12-03 10:00:38 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/movex/why_pay_more.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-03 10:00:38 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/movex/why_pay_more.ashx?la=en>
2025-12-03 10:00:38 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/banners-and-adverts/products-services/simulcast_banner.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-03 10:00:38 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/banners-and-adverts/products-services/simulcast_banner.ashx?la=en>
2025-12-03 10:00:38 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimlogofooter2.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-03 10:00:38 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimlogofooter2.ashx?la=en>
2025-12-03 10:00:38 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimvehiclesearchpage2.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-03 10:00:38 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimvehiclesearchpage2.ashx?la=en>
2025-12-03 10:00:38 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/Scripts/Manheim/tellnumberchange.js> (resource type: script, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-03 10:00:38 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/Scripts/Manheim/RemoveSignUpBanner.js> (resource type: script, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-03 10:00:38 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/bundle?v=HcGNblHj64wK-Istb_0SemQAL-rwtK13kDPW8q3LCIo1>
2025-12-03 10:00:38 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/jquery-ui-1.13.2.min.css> (resource type: stylesheet, referrer: https://www.manheim.co.uk/assets/css/bundle?v=HcGNblHj64wK-Istb_0SemQAL-rwtK13kDPW8q3LCIo1)
2025-12-03 10:00:38 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/core-blessed1.min.css> (resource type: stylesheet, referrer: https://www.manheim.co.uk/assets/css/bundle?v=HcGNblHj64wK-Istb_0SemQAL-rwtK13kDPW8q3LCIo1)
2025-12-03 10:00:38 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/bundles/delete/scripts/postlogin?v=Bwe963dGqUB3Sdny8E3tKSL2gV9GDgLwX1g6Gq6KF-A1>
2025-12-03 10:00:38 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/SignalR/Hubs>
2025-12-03 10:00:38 [scrapy-playwright] DEBUG: [Context=default] Response: <302 https://www.manheim.co.uk/Scripts/jquery-ui-1.12.1.js> (location: https://www.manheim.co.uk/404)
2025-12-03 10:00:38 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/bundles/simulcast?v=P7s0oLmuXc3p3WQNs8URnZ4NaK3K6qkWLOwf0uOs5gw1>
2025-12-03 10:00:38 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/Content/myManheim.css>
2025-12-03 10:00:38 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/Content/dashboards.css>
2025-12-03 10:00:38 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/Scripts/Manheim/tellnumberchange.js>
2025-12-03 10:00:38 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/404> (resource type: script, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-03 10:00:38 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/Scripts/Manheim/RemoveSignUpBanner.js>
2025-12-03 10:00:38 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/jquery-ui-1.13.2.min.css>
2025-12-03 10:00:38 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/core-blessed1.min.css>
2025-12-03 10:00:38 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Light.woff> (resource type: font, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-03 10:00:38 [scrapy-playwright] DEBUG: [Context=default] Response: <404 https://www.manheim.co.uk/404>
2025-12-03 10:00:38 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimwhitecoxautomotive3.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-03 10:00:38 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Regular.woff> (resource type: font, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-03 10:00:38 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimwhitecoxautomotive3.ashx?la=en>
2025-12-03 10:00:38 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/fonts/Manheim-Icons/Manheim-Icons.woff> (resource type: font, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-03 10:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.googletagmanager.com/gtm.js?id=GTM-KZS96H> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-03 10:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/new-manheim-booking.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-03 10:00:39 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.googletagmanager.com/gtm.js?id=GTM-KZS96H>
2025-12-03 10:00:39 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/new-manheim-booking.ashx?la=en>
2025-12-03 10:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/blog/2025/gavel_2025.ashx?h=176&la=en&w=210&crop=1> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-03 10:00:39 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/blog/2025/gavel_2025.ashx?h=176&la=en&w=210&crop=1>
2025-12-03 10:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/img_6251.ashx?h=176&la=en&w=210&crop=1> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-03 10:00:39 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/img_6251.ashx?h=176&la=en&w=210&crop=1>
2025-12-03 10:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/movex/payg1.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-03 10:00:39 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/movex/payg1.ashx?la=en>
2025-12-03 10:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/v3--design11918banner535x191px-(1).ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-03 10:00:39 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/v3--design11918banner535x191px-(1).ashx?la=en>
2025-12-03 10:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/campaigns/nama/nama-lcv-location-banner.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-03 10:00:39 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/campaigns/nama/nama-lcv-location-banner.ashx?la=en>
2025-12-03 10:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/movex/why_pay_more.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-03 10:00:39 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/movex/why_pay_more.ashx?la=en>
2025-12-03 10:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/banners-and-adverts/products-services/simulcast_banner.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-03 10:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimlogofooter2.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-03 10:00:39 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/banners-and-adverts/products-services/simulcast_banner.ashx?la=en>
2025-12-03 10:00:39 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimlogofooter2.ashx?la=en>
2025-12-03 10:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimvehiclesearchpage2.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-03 10:00:39 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimvehiclesearchpage2.ashx?la=en>
2025-12-03 10:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/images/branding/dropdown.png> (resource type: image, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-03 10:00:39 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/assets/images/branding/dropdown.png>
2025-12-03 10:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Bold.woff> (resource type: font, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-03 10:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/images/thickbox/loadingAnimation.gif> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-03 10:00:39 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/assets/images/thickbox/loadingAnimation.gif>
2025-12-03 10:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://www.manheim.co.uk/Account/IsCookieExist> (resource type: xhr, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-03 10:00:39 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Light.woff>
2025-12-03 10:00:39 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Regular.woff>
2025-12-03 10:00:39 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/fonts/Manheim-Icons/Manheim-Icons.woff>
2025-12-03 10:00:39 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Bold.woff>
2025-12-03 10:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://js-agent.newrelic.com/nr-spa-1.303.0.min.js> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-03 10:00:39 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://js-agent.newrelic.com/nr-spa-1.303.0.min.js>
2025-12-03 10:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://pi.pardot.com/pd.js> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-03 10:00:39 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/Account/IsCookieExist>
2025-12-03 10:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://js-agent.newrelic.com/nr-spa-1.303.0.min.js> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-03 10:00:39 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://js-agent.newrelic.com/nr-spa-1.303.0.min.js>
2025-12-03 10:00:40 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://pi.pardot.com/pd.js>
2025-12-03 10:00:40 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://pi.pardot.com/analytics?ver=3&visitor_id=918689418&visitor_id_sign=db7c41298ee700418b5258db5d3ccad48c64ad081e3698abddb6fe6c0b17b7a46c66b426e2836f7ae4b4b734b7b521195b7fde4e&pi_opt_in=&campaign_id=24684&account_id=38592&title=Dashboard%20%7C%20Manheim&url=https%3A%2F%2Fwww.manheim.co.uk%2Fmymanheim%2Fdashboard&referrer=https%3A%2F%2Fwww.manheim.co.uk%2F> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-03 10:00:40 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://pi.pardot.com/analytics?ver=3&visitor_id=918689418&visitor_id_sign=db7c41298ee700418b5258db5d3ccad48c64ad081e3698abddb6fe6c0b17b7a46c66b426e2836f7ae4b4b734b7b521195b7fde4e&pi_opt_in=&campaign_id=24684&account_id=38592&title=Dashboard%20%7C%20Manheim&url=https%3A%2F%2Fwww.manheim.co.uk%2Fmymanheim%2Fdashboard&referrer=https%3A%2F%2Fwww.manheim.co.uk%2F>
2025-12-03 10:00:40 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://brands.coxauto.co.uk/analytics?conly=true&visitor_id=918689418&visitor_id_sign=db7c41298ee700418b5258db5d3ccad48c64ad081e3698abddb6fe6c0b17b7a46c66b426e2836f7ae4b4b734b7b521195b7fde4e&pi_opt_in=&campaign_id=24684&account_id=38592&title=Dashboard%20%7C%20Manheim&url=https%3A%2F%2Fwww.manheim.co.uk%2Fmymanheim%2Fdashboard&referrer=https%3A%2F%2Fwww.manheim.co.uk%2F> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-03 10:00:41 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://brands.coxauto.co.uk/analytics?conly=true&visitor_id=918689418&visitor_id_sign=db7c41298ee700418b5258db5d3ccad48c64ad081e3698abddb6fe6c0b17b7a46c66b426e2836f7ae4b4b734b7b521195b7fde4e&pi_opt_in=&campaign_id=24684&account_id=38592&title=Dashboard%20%7C%20Manheim&url=https%3A%2F%2Fwww.manheim.co.uk%2Fmymanheim%2Fdashboard&referrer=https%3A%2F%2Fwww.manheim.co.uk%2F>
2025-12-03 10:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk> (referer: None) ['playwright']
2025-12-03 10:00:44 [manheim.gb] INFO: Cookies from Playwright: [{'name': 'ASP.NET_SessionId', 'value': 'bogzmncckk5c3rwadi53zoeg', 'domain': 'www.manheim.co.uk', 'path': '/', 'expires': -1, 'httpOnly': True, 'secure': True, 'sameSite': 'Lax'}, {'name': '__RequestVerificationToken', 'value': 'kCBsEpZRHwmoMuGtm4ChdB_EmsPt_BUjsOcTpMw0AZEYZjkUxnEN1kh9K9Cv5y1ShsW2l_e-0w_o_VrrzMt-9EFxjcM1', 'domain': 'www.manheim.co.uk', 'path': '/', 'expires': -1, 'httpOnly': True, 'secure': True, 'sameSite': 'None'}, {'name': 'cb-enabled', 'value': 'enabled', 'domain': 'www.manheim.co.uk', 'path': '/', 'expires': 1796292024, 'httpOnly': False, 'secure': False, 'sameSite': 'None'}, {'name': 'remarketing-web', 'value': '526158BCFF403C314C4615F3B8E2B4C8A8945DC4C65DBED5216E430650B10188C7EC77B413DDDE6F71C1C6D7CD762E654D388D77ED7BF8A67153686200E9E568367074BC6E89BF916899337F9BA6682A00776B5B30A7F6C68FCCC8F8D9B5CFF08BF4E93193A2EAD89B01268934B3556D29B3079A', 'domain': 'www.manheim.co.uk', 'path': '/', 'expires': -1, 'httpOnly': True, 'secure': True, 'sameSite': 'None'}, {'name': 'visitor_id37592', 'value': '918689418', 'domain': 'www.manheim.co.uk', 'path': '/', 'expires': 1796292040, 'httpOnly': False, 'secure': False, 'sameSite': 'None'}, {'name': 'visitor_id37592-hash', 'value': 'db7c41298ee700418b5258db5d3ccad48c64ad081e3698abddb6fe6c0b17b7a46c66b426e2836f7ae4b4b734b7b521195b7fde4e', 'domain': 'www.manheim.co.uk', 'path': '/', 'expires': 1796292040, 'httpOnly': False, 'secure': False, 'sameSite': 'None'}, {'name': 'visitor_id37592', 'value': '918689418', 'domain': 'brands.coxauto.co.uk', 'path': '/', 'expires': 1796292041, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}, {'name': 'visitor_id37592-hash', 'value': 'db7c41298ee700418b5258db5d3ccad48c64ad081e3698abddb6fe6c0b17b7a46c66b426e2836f7ae4b4b734b7b521195b7fde4e', 'domain': 'brands.coxauto.co.uk', 'path': '/', 'expires': 1796292041, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}, {'name': 'visitor_id37592', 'value': '918689418', 'domain': '.pardot.com', 'path': '/', 'expires': 1796292040, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}, {'name': 'visitor_id37592-hash', 'value': 'db7c41298ee700418b5258db5d3ccad48c64ad081e3698abddb6fe6c0b17b7a46c66b426e2836f7ae4b4b734b7b521195b7fde4e', 'domain': '.pardot.com', 'path': '/', 'expires': 1796292040, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}, {'name': 'lpv37592', 'value': 'aHR0cHM6Ly93d3cubWFuaGVpbS5jby51ay9teW1hbmhlaW0vZGFzaGJvYXJk', 'domain': 'pi.pardot.com', 'path': '/', 'expires': 1764757840, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}]
2025-12-03 10:00:44 [manheim.gb] INFO: Scrapy-formatted cookies: [{'name': 'ASP.NET_SessionId', 'value': 'bogzmncckk5c3rwadi53zoeg', 'domain': 'www.manheim.co.uk', 'path': '/'}, {'name': '__RequestVerificationToken', 'value': 'kCBsEpZRHwmoMuGtm4ChdB_EmsPt_BUjsOcTpMw0AZEYZjkUxnEN1kh9K9Cv5y1ShsW2l_e-0w_o_VrrzMt-9EFxjcM1', 'domain': 'www.manheim.co.uk', 'path': '/'}, {'name': 'cb-enabled', 'value': 'enabled', 'domain': 'www.manheim.co.uk', 'path': '/'}, {'name': 'remarketing-web', 'value': '526158BCFF403C314C4615F3B8E2B4C8A8945DC4C65DBED5216E430650B10188C7EC77B413DDDE6F71C1C6D7CD762E654D388D77ED7BF8A67153686200E9E568367074BC6E89BF916899337F9BA6682A00776B5B30A7F6C68FCCC8F8D9B5CFF08BF4E93193A2EAD89B01268934B3556D29B3079A', 'domain': 'www.manheim.co.uk', 'path': '/'}, {'name': 'visitor_id37592', 'value': '918689418', 'domain': 'www.manheim.co.uk', 'path': '/'}, {'name': 'visitor_id37592-hash', 'value': 'db7c41298ee700418b5258db5d3ccad48c64ad081e3698abddb6fe6c0b17b7a46c66b426e2836f7ae4b4b734b7b521195b7fde4e', 'domain': 'www.manheim.co.uk', 'path': '/'}, {'name': 'visitor_id37592', 'value': '918689418', 'domain': 'brands.coxauto.co.uk', 'path': '/'}, {'name': 'visitor_id37592-hash', 'value': 'db7c41298ee700418b5258db5d3ccad48c64ad081e3698abddb6fe6c0b17b7a46c66b426e2836f7ae4b4b734b7b521195b7fde4e', 'domain': 'brands.coxauto.co.uk', 'path': '/'}, {'name': 'visitor_id37592', 'value': '918689418', 'domain': '.pardot.com', 'path': '/'}, {'name': 'visitor_id37592-hash', 'value': 'db7c41298ee700418b5258db5d3ccad48c64ad081e3698abddb6fe6c0b17b7a46c66b426e2836f7ae4b4b734b7b521195b7fde4e', 'domain': '.pardot.com', 'path': '/'}, {'name': 'lpv37592', 'value': 'aHR0cHM6Ly93d3cubWFuaGVpbS5jby51ay9teW1hbmhlaW0vZGFzaGJvYXJk', 'domain': 'pi.pardot.com', 'path': '/'}]
2025-12-03 10:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /SpiderData(PartitionKey='Manheim',RowKey='cookies') HTTP/1.1" 204 0
2025-12-03 10:00:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 10:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/refine> (referer: https://www.manheim.co.uk/search) ['zyte-api']
2025-12-03 10:00:46 [manheim.gb] INFO: Found listing with ID: 1019262
2025-12-03 10:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271019262%27 HTTP/1.1" 200 None
2025-12-03 10:00:46 [manheim.gb] INFO: Scrape type for 1019262: 0
2025-12-03 10:00:46 [manheim.gb] INFO: Found listing with ID: 1074269
2025-12-03 10:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271074269%27 HTTP/1.1" 200 None
2025-12-03 10:00:46 [manheim.gb] INFO: Scrape type for 1074269: 0
2025-12-03 10:00:46 [manheim.gb] INFO: Found listing with ID: 1078284
2025-12-03 10:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271078284%27 HTTP/1.1" 200 None
2025-12-03 10:00:46 [manheim.gb] INFO: Scrape type for 1078284: 0
2025-12-03 10:00:46 [manheim.gb] INFO: Found listing with ID: 1089633
2025-12-03 10:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271089633%27 HTTP/1.1" 200 None
2025-12-03 10:00:46 [manheim.gb] INFO: Scrape type for 1089633: 2
2025-12-03 10:00:46 [manheim.gb] INFO: Found listing with ID: 1101758
2025-12-03 10:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271101758%27 HTTP/1.1" 200 None
2025-12-03 10:00:46 [manheim.gb] INFO: Scrape type for 1101758: 0
2025-12-03 10:00:46 [manheim.gb] INFO: Found listing with ID: 1104811
2025-12-03 10:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271104811%27 HTTP/1.1" 200 None
2025-12-03 10:00:46 [manheim.gb] INFO: Scrape type for 1104811: 2
2025-12-03 10:00:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 10:00:46 [manheim.gb] INFO: Found listing with ID: 1153610
2025-12-03 10:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271153610%27 HTTP/1.1" 200 None
2025-12-03 10:00:46 [manheim.gb] INFO: Scrape type for 1153610: 0
2025-12-03 10:00:46 [manheim.gb] INFO: Found listing with ID: 1162585
2025-12-03 10:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271162585%27 HTTP/1.1" 200 None
2025-12-03 10:00:46 [manheim.gb] INFO: Scrape type for 1162585: 0
2025-12-03 10:00:46 [manheim.gb] INFO: Found listing with ID: 1173100
2025-12-03 10:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271173100%27 HTTP/1.1" 200 None
2025-12-03 10:00:46 [manheim.gb] INFO: Scrape type for 1173100: 2
2025-12-03 10:00:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 10:00:46 [manheim.gb] INFO: Found listing with ID: 1191100
2025-12-03 10:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271191100%27 HTTP/1.1" 200 None
2025-12-03 10:00:46 [manheim.gb] INFO: Scrape type for 1191100: 2
2025-12-03 10:00:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 10:00:46 [manheim.gb] INFO: Found listing with ID: 1195824
2025-12-03 10:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271195824%27 HTTP/1.1" 200 None
2025-12-03 10:00:46 [manheim.gb] INFO: Scrape type for 1195824: 0
2025-12-03 10:00:46 [manheim.gb] INFO: Found listing with ID: 124569
2025-12-03 10:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27124569%27 HTTP/1.1" 200 None
2025-12-03 10:00:46 [manheim.gb] INFO: Scrape type for 124569: 0
2025-12-03 10:00:46 [manheim.gb] INFO: Found listing with ID: 1257174
2025-12-03 10:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271257174%27 HTTP/1.1" 200 None
2025-12-03 10:00:46 [manheim.gb] INFO: Scrape type for 1257174: 1
2025-12-03 10:00:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 10:00:46 [manheim.gb] INFO: Found listing with ID: 1281726
2025-12-03 10:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271281726%27 HTTP/1.1" 200 None
2025-12-03 10:00:46 [manheim.gb] INFO: Scrape type for 1281726: 0
2025-12-03 10:00:46 [manheim.gb] INFO: Found listing with ID: 1297328
2025-12-03 10:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271297328%27 HTTP/1.1" 200 None
2025-12-03 10:00:46 [manheim.gb] INFO: Scrape type for 1297328: 1
2025-12-03 10:00:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 10:00:46 [manheim.gb] INFO: Found listing with ID: 1306828
2025-12-03 10:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271306828%27 HTTP/1.1" 200 None
2025-12-03 10:00:46 [manheim.gb] INFO: Scrape type for 1306828: 0
2025-12-03 10:00:46 [manheim.gb] INFO: Found listing with ID: 1314291
2025-12-03 10:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271314291%27 HTTP/1.1" 200 None
2025-12-03 10:00:46 [manheim.gb] INFO: Scrape type for 1314291: 0
2025-12-03 10:00:46 [manheim.gb] INFO: Found listing with ID: 1376686
2025-12-03 10:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271376686%27 HTTP/1.1" 200 None
2025-12-03 10:00:46 [manheim.gb] INFO: Scrape type for 1376686: 0
2025-12-03 10:00:46 [manheim.gb] INFO: Found listing with ID: 1403363
2025-12-03 10:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271403363%27 HTTP/1.1" 200 None
2025-12-03 10:00:46 [manheim.gb] INFO: Scrape type for 1403363: 0
2025-12-03 10:00:46 [manheim.gb] INFO: Found listing with ID: 1405448
2025-12-03 10:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271405448%27 HTTP/1.1" 200 None
2025-12-03 10:00:47 [manheim.gb] INFO: Scrape type for 1405448: 0
2025-12-03 10:00:47 [manheim.gb] INFO: Found listing with ID: 1418917
2025-12-03 10:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271418917%27 HTTP/1.1" 200 None
2025-12-03 10:00:47 [manheim.gb] INFO: Scrape type for 1418917: 0
2025-12-03 10:00:47 [manheim.gb] INFO: Found listing with ID: 1473959
2025-12-03 10:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271473959%27 HTTP/1.1" 200 None
2025-12-03 10:00:47 [manheim.gb] INFO: Scrape type for 1473959: 0
2025-12-03 10:00:47 [manheim.gb] INFO: Found listing with ID: 1479833
2025-12-03 10:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271479833%27 HTTP/1.1" 200 None
2025-12-03 10:00:47 [manheim.gb] INFO: Scrape type for 1479833: 0
2025-12-03 10:00:47 [manheim.gb] INFO: Found listing with ID: 1484153
2025-12-03 10:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271484153%27 HTTP/1.1" 200 None
2025-12-03 10:00:47 [manheim.gb] INFO: Scrape type for 1484153: 0
2025-12-03 10:00:47 [manheim.gb] INFO: Found listing with ID: 1490428
2025-12-03 10:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271490428%27 HTTP/1.1" 200 None
2025-12-03 10:00:47 [manheim.gb] INFO: Scrape type for 1490428: 0
2025-12-03 10:00:47 [manheim.gb] INFO: Found listing with ID: 149524
2025-12-03 10:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27149524%27 HTTP/1.1" 200 None
2025-12-03 10:00:47 [manheim.gb] INFO: Scrape type for 149524: 0
2025-12-03 10:00:47 [manheim.gb] INFO: Found listing with ID: 1501704
2025-12-03 10:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271501704%27 HTTP/1.1" 200 None
2025-12-03 10:00:47 [manheim.gb] INFO: Scrape type for 1501704: 0
2025-12-03 10:00:47 [manheim.gb] INFO: Found listing with ID: 1541191
2025-12-03 10:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271541191%27 HTTP/1.1" 200 None
2025-12-03 10:00:47 [manheim.gb] INFO: Scrape type for 1541191: 0
2025-12-03 10:00:47 [manheim.gb] INFO: Found listing with ID: 1546758
2025-12-03 10:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271546758%27 HTTP/1.1" 200 None
2025-12-03 10:00:47 [manheim.gb] INFO: Scrape type for 1546758: 2
2025-12-03 10:00:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 10:00:47 [manheim.gb] INFO: Found listing with ID: 1554861
2025-12-03 10:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271554861%27 HTTP/1.1" 200 None
2025-12-03 10:00:47 [manheim.gb] INFO: Scrape type for 1554861: 0
2025-12-03 10:00:47 [manheim.gb] INFO: Found listing with ID: 1563459
2025-12-03 10:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271563459%27 HTTP/1.1" 200 None
2025-12-03 10:00:47 [manheim.gb] INFO: Scrape type for 1563459: 0
2025-12-03 10:00:47 [manheim.gb] INFO: Found listing with ID: 1564349
2025-12-03 10:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271564349%27 HTTP/1.1" 200 None
2025-12-03 10:00:47 [manheim.gb] INFO: Scrape type for 1564349: 0
2025-12-03 10:00:47 [manheim.gb] INFO: Found listing with ID: 157293
2025-12-03 10:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27157293%27 HTTP/1.1" 200 None
2025-12-03 10:00:47 [manheim.gb] INFO: Scrape type for 157293: 0
2025-12-03 10:00:47 [manheim.gb] INFO: Found listing with ID: 1580164
2025-12-03 10:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271580164%27 HTTP/1.1" 200 None
2025-12-03 10:00:47 [manheim.gb] INFO: Scrape type for 1580164: 0
2025-12-03 10:00:47 [manheim.gb] INFO: Found listing with ID: 1639320
2025-12-03 10:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271639320%27 HTTP/1.1" 200 None
2025-12-03 10:00:47 [manheim.gb] INFO: Scrape type for 1639320: 2
2025-12-03 10:00:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 10:00:47 [manheim.gb] INFO: Found listing with ID: 1671760
2025-12-03 10:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271671760%27 HTTP/1.1" 200 None
2025-12-03 10:00:47 [manheim.gb] INFO: Scrape type for 1671760: 0
2025-12-03 10:00:47 [manheim.gb] INFO: Found listing with ID: 1701386
2025-12-03 10:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271701386%27 HTTP/1.1" 200 None
2025-12-03 10:00:47 [manheim.gb] INFO: Scrape type for 1701386: 2
2025-12-03 10:00:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 10:00:47 [manheim.gb] INFO: Found listing with ID: 1736358
2025-12-03 10:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271736358%27 HTTP/1.1" 200 None
2025-12-03 10:00:47 [manheim.gb] INFO: Scrape type for 1736358: 2
2025-12-03 10:00:47 [manheim.gb] INFO: Found listing with ID: 1762778
2025-12-03 10:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271762778%27 HTTP/1.1" 200 None
2025-12-03 10:00:47 [manheim.gb] INFO: Scrape type for 1762778: 2
2025-12-03 10:00:47 [manheim.gb] INFO: Found listing with ID: 1783769
2025-12-03 10:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271783769%27 HTTP/1.1" 200 None
2025-12-03 10:00:47 [manheim.gb] INFO: Scrape type for 1783769: 0
2025-12-03 10:00:47 [manheim.gb] INFO: Found listing with ID: 1787313
2025-12-03 10:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271787313%27 HTTP/1.1" 200 None
2025-12-03 10:00:47 [manheim.gb] INFO: Scrape type for 1787313: 0
2025-12-03 10:00:47 [manheim.gb] INFO: Found listing with ID: 1798612
2025-12-03 10:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271798612%27 HTTP/1.1" 200 None
2025-12-03 10:00:47 [manheim.gb] INFO: Scrape type for 1798612: 2
2025-12-03 10:00:47 [manheim.gb] INFO: Found listing with ID: 1815539
2025-12-03 10:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271815539%27 HTTP/1.1" 200 None
2025-12-03 10:00:47 [manheim.gb] INFO: Scrape type for 1815539: 0
2025-12-03 10:00:47 [manheim.gb] INFO: Found listing with ID: 1825401
2025-12-03 10:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271825401%27 HTTP/1.1" 200 None
2025-12-03 10:00:47 [manheim.gb] INFO: Scrape type for 1825401: 0
2025-12-03 10:00:47 [manheim.gb] INFO: Found listing with ID: 1835329
2025-12-03 10:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271835329%27 HTTP/1.1" 200 None
2025-12-03 10:00:47 [manheim.gb] INFO: Scrape type for 1835329: 0
2025-12-03 10:00:47 [manheim.gb] INFO: Found listing with ID: 1856076
2025-12-03 10:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271856076%27 HTTP/1.1" 200 None
2025-12-03 10:00:47 [manheim.gb] INFO: Scrape type for 1856076: 0
2025-12-03 10:00:47 [manheim.gb] INFO: Found listing with ID: 1859294
2025-12-03 10:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271859294%27 HTTP/1.1" 200 None
2025-12-03 10:00:47 [manheim.gb] INFO: Scrape type for 1859294: 0
2025-12-03 10:00:47 [manheim.gb] INFO: Found listing with ID: 1877473
2025-12-03 10:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271877473%27 HTTP/1.1" 200 None
2025-12-03 10:00:47 [manheim.gb] INFO: Scrape type for 1877473: 0
2025-12-03 10:00:47 [manheim.gb] INFO: Found listing with ID: 1905242
2025-12-03 10:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271905242%27 HTTP/1.1" 200 None
2025-12-03 10:00:47 [manheim.gb] INFO: Scrape type for 1905242: 0
2025-12-03 10:00:47 [manheim.gb] INFO: Found listing with ID: 1912686
2025-12-03 10:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271912686%27 HTTP/1.1" 200 None
2025-12-03 10:00:47 [manheim.gb] INFO: Scrape type for 1912686: 0
2025-12-03 10:00:47 [manheim.gb] INFO: Found listing with ID: 1940647
2025-12-03 10:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271940647%27 HTTP/1.1" 200 None
2025-12-03 10:00:47 [manheim.gb] INFO: Scrape type for 1940647: 0
2025-12-03 10:00:47 [manheim.gb] INFO: Found listing with ID: 1950952
2025-12-03 10:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271950952%27 HTTP/1.1" 200 None
2025-12-03 10:00:47 [manheim.gb] INFO: Scrape type for 1950952: 0
2025-12-03 10:00:47 [manheim.gb] INFO: Found listing with ID: 1962040
2025-12-03 10:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271962040%27 HTTP/1.1" 200 None
2025-12-03 10:00:47 [manheim.gb] INFO: Scrape type for 1962040: 0
2025-12-03 10:00:47 [manheim.gb] INFO: Found listing with ID: 196679
2025-12-03 10:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27196679%27 HTTP/1.1" 200 None
2025-12-03 10:00:47 [manheim.gb] INFO: Scrape type for 196679: 0
2025-12-03 10:00:47 [manheim.gb] INFO: Found listing with ID: 1976170
2025-12-03 10:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271976170%27 HTTP/1.1" 200 None
2025-12-03 10:00:47 [manheim.gb] INFO: Scrape type for 1976170: 0
2025-12-03 10:00:47 [manheim.gb] INFO: Found listing with ID: 1989795
2025-12-03 10:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271989795%27 HTTP/1.1" 200 None
2025-12-03 10:00:47 [manheim.gb] INFO: Scrape type for 1989795: 0
2025-12-03 10:00:47 [manheim.gb] INFO: Found listing with ID: 1995165
2025-12-03 10:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271995165%27 HTTP/1.1" 200 None
2025-12-03 10:00:48 [manheim.gb] INFO: Scrape type for 1995165: 2
2025-12-03 10:00:48 [manheim.gb] INFO: Found listing with ID: 2014140
2025-12-03 10:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272014140%27 HTTP/1.1" 200 None
2025-12-03 10:00:48 [manheim.gb] INFO: Scrape type for 2014140: 2
2025-12-03 10:00:48 [manheim.gb] INFO: Found listing with ID: 2022887
2025-12-03 10:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272022887%27 HTTP/1.1" 200 None
2025-12-03 10:00:48 [manheim.gb] INFO: Scrape type for 2022887: 0
2025-12-03 10:00:48 [manheim.gb] INFO: Found listing with ID: 2044428
2025-12-03 10:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272044428%27 HTTP/1.1" 200 None
2025-12-03 10:00:48 [manheim.gb] INFO: Scrape type for 2044428: 2
2025-12-03 10:00:48 [manheim.gb] INFO: Found listing with ID: 2057516
2025-12-03 10:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272057516%27 HTTP/1.1" 200 None
2025-12-03 10:00:48 [manheim.gb] INFO: Scrape type for 2057516: 2
2025-12-03 10:00:48 [manheim.gb] INFO: Found listing with ID: 2058572
2025-12-03 10:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272058572%27 HTTP/1.1" 200 None
2025-12-03 10:00:48 [manheim.gb] INFO: Scrape type for 2058572: 2
2025-12-03 10:00:48 [manheim.gb] INFO: Found listing with ID: 2093385
2025-12-03 10:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272093385%27 HTTP/1.1" 200 None
2025-12-03 10:00:48 [manheim.gb] INFO: Scrape type for 2093385: 0
2025-12-03 10:00:48 [manheim.gb] INFO: Found listing with ID: 2143943
2025-12-03 10:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272143943%27 HTTP/1.1" 200 None
2025-12-03 10:00:48 [manheim.gb] INFO: Scrape type for 2143943: 0
2025-12-03 10:00:48 [manheim.gb] INFO: Found listing with ID: 216223
2025-12-03 10:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27216223%27 HTTP/1.1" 200 None
2025-12-03 10:00:48 [manheim.gb] INFO: Scrape type for 216223: 0
2025-12-03 10:00:48 [manheim.gb] INFO: Found listing with ID: 2175705
2025-12-03 10:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272175705%27 HTTP/1.1" 200 None
2025-12-03 10:00:48 [manheim.gb] INFO: Scrape type for 2175705: 0
2025-12-03 10:00:48 [manheim.gb] INFO: Found listing with ID: 2186514
2025-12-03 10:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272186514%27 HTTP/1.1" 200 None
2025-12-03 10:00:48 [manheim.gb] INFO: Scrape type for 2186514: 0
2025-12-03 10:00:48 [manheim.gb] INFO: Found listing with ID: 2192411
2025-12-03 10:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272192411%27 HTTP/1.1" 200 None
2025-12-03 10:00:48 [manheim.gb] INFO: Scrape type for 2192411: 0
2025-12-03 10:00:48 [manheim.gb] INFO: Found listing with ID: 2195912
2025-12-03 10:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272195912%27 HTTP/1.1" 200 None
2025-12-03 10:00:48 [manheim.gb] INFO: Scrape type for 2195912: 0
2025-12-03 10:01:15 [scrapy.extensions.logstats] INFO: Crawled 2 pages (at 2 pages/min), scraped 0 items (at 0 items/min)
2025-12-03 10:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/FORD/FIESTA?id=1089633&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231089633&indx=5> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 10:01:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 10:01:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a04e308-c753-5b7d-89c8-d047b0e6ac8b with identifier: 1089633
2025-12-03 10:01:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a04e308-c753-5b7d-89c8-d047b0e6ac8b with scrape type 2
2025-12-03 10:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a04e308-c753-5b7d-89c8-d047b0e6ac8b with scrape type 2
2025-12-03 10:01:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 0a04e308-c753-5b7d-89c8-d047b0e6ac8b, identifier: 1089633
2025-12-03 10:01:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 0a04e308-c753-5b7d-89c8-d047b0e6ac8b with identifier: 1089633
2025-12-03 10:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-03 10:01:16 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=GREY HTTP/1.1" 200 None
2025-12-03 10:01:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-03 10:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-03 10:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-03 10:01:16 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Petrol HTTP/1.1" 200 None
2025-12-03 10:01:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-03 10:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-03 10:01:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 0a04e308-c753-5b7d-89c8-d047b0e6ac8b with identifier: 1089633
2025-12-03 10:01:16 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: 0a04e308-c753-5b7d-89c8-d047b0e6ac8b with expiration date: 2025-12-03T09:00:00Z
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001089633-01989199-003.pdf',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '1.0L',
 'expiration_date': '2025-12-03T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '0a04e308-c753-5b7d-89c8-d047b0e6ac8b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'YR65VKG',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FORD/FIESTA?id=1089633',
 'listing': 'auction',
 'location': 'Birmingham',
 'make': 'FORD',
 'model': 'FIESTA',
 'odometer': 41791,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-11',
 'seller_name': 'Available Car',
 'title': 'FORD FIESTA 1.0 Titanium 5dr',
 'transmission': 'manual',
 'trim': '1.0 Titanium 5dr',
 'year': 2015}
2025-12-03 10:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271089633%27 HTTP/1.1" 200 None
2025-12-03 10:01:16 [manheim.gb] INFO: Saving data for 1089633: {'auction_closing_time': 1764752400.0, 'created_time': 1764662609.92542, 'last_price_update_time': 1764756076.854537}
2025-12-03 10:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1089633') HTTP/1.1" 204 0
2025-12-03 10:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/CITROEN/C1?id=1297328&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231297328&indx=20> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 10:01:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 10:01:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f26da7e4-b5b3-56d4-a53a-3407e101d96f with identifier: 1297328
2025-12-03 10:01:17 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item f26da7e4-b5b3-56d4-a53a-3407e101d96f
2025-12-03 10:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/MINI/CLUBMAN?id=1104811&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231104811&indx=8> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 10:01:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 10:01:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5da26166-d7d0-5af2-a580-8a7fdcc24325 with identifier: 1104811
2025-12-03 10:01:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5da26166-d7d0-5af2-a580-8a7fdcc24325 with scrape type 2
2025-12-03 10:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5da26166-d7d0-5af2-a580-8a7fdcc24325 with scrape type 2
2025-12-03 10:01:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 5da26166-d7d0-5af2-a580-8a7fdcc24325, identifier: 1104811
2025-12-03 10:01:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 5da26166-d7d0-5af2-a580-8a7fdcc24325 with identifier: 1104811
2025-12-03 10:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-03 10:01:18 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=WHITE HTTP/1.1" 200 None
2025-12-03 10:01:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-03 10:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-03 10:01:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 5da26166-d7d0-5af2-a580-8a7fdcc24325 with identifier: 1104811
2025-12-03 10:01:18 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 16 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    16
2025-12-03 10:01:18 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: 5da26166-d7d0-5af2-a580-8a7fdcc24325 spider: manheim.gb
2025-12-03 10:01:18 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 5da26166-d7d0-5af2-a580-8a7fdcc24325 due to rule: registration_date_old.json, error: 16 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    16
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001104811-01988733-003.pdf',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '1.4L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '5da26166-d7d0-5af2-a580-8a7fdcc24325',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'MJ59YWR',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MINI/CLUBMAN?id=1104811',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'MINI',
 'model': 'CLUBMAN',
 'odometer': 65791,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-11-27',
 'seller_name': 'Big Motoring World Ltd',
 'title': 'MINI CLUBMAN 1.4 One 5dr',
 'transmission': 'manual',
 'trim': '1.4 One 5dr',
 'year': 2009}
2025-12-03 10:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271104811%27 HTTP/1.1" 200 None
2025-12-03 10:01:18 [manheim.gb] INFO: Saving data for 1104811: {'auction_closing_time': 1764838800.0, 'created_time': 1764662551.824944, 'last_price_update_time': 1764756078.935735}
2025-12-03 10:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1104811') HTTP/1.1" 204 0
2025-12-03 10:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0001297328-01988935-001.pdf> (referer: None)
2025-12-03 10:01:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:01:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:01:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:01:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa277288810>
2025-12-03 10:01:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:01:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 10:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:01:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f26da7e4-b5b3-56d4-a53a-3407e101d96f/f26da7e4-b5b3-56d4-a53a-3407e101d96f_expert_report_file_f0312039-d034-4354-9134-ffdeebca9c55.pdf HTTP/1.1" 201 0
2025-12-03 10:01:19 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item f26da7e4-b5b3-56d4-a53a-3407e101d96f
2025-12-03 10:01:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f26da7e4-b5b3-56d4-a53a-3407e101d96f, skipping ID generation
2025-12-03 10:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item f26da7e4-b5b3-56d4-a53a-3407e101d96f
2025-12-03 10:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_ext_7.jpg not downloaded yet
2025-12-03 10:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_ext_7.jpg not downloaded yet
2025-12-03 10:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_ext_6.jpg not downloaded yet
2025-12-03 10:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_ext_1.jpg not downloaded yet
2025-12-03 10:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_5.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_5.jpg not downloaded yet
2025-12-03 10:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_4.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_4.jpg not downloaded yet
2025-12-03 10:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_11.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_11.jpg not downloaded yet
2025-12-03 10:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_10.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_10.jpg not downloaded yet
2025-12-03 10:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_9.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_9.jpg not downloaded yet
2025-12-03 10:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_ext_2.jpg not downloaded yet
2025-12-03 10:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_ext_5.jpg not downloaded yet
2025-12-03 10:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_ext_3.jpg not downloaded yet
2025-12-03 10:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_ext_4.jpg not downloaded yet
2025-12-03 10:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1297328-4005989-13.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1297328-4005989-13.jpg not downloaded yet
2025-12-03 10:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1297328-4005989-1000.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1297328-4005989-1000.jpg not downloaded yet
2025-12-03 10:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001297328-01988935-001.pdf)
2025-12-03 10:01:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:01:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa276ad38d0>
2025-12-03 10:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:01:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 10:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f26da7e4-b5b3-56d4-a53a-3407e101d96f/f26da7e4-b5b3-56d4-a53a-3407e101d96f_image_0.jpg HTTP/1.1" 201 0
2025-12-03 10:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_ext_7.jpg') HTTP/1.1" 204 0
2025-12-03 10:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_ext_7.jpg saved to cache
2025-12-03 10:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f26da7e4-b5b3-56d4-a53a-3407e101d96f
2025-12-03 10:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/CITROEN/C4PICASSO?id=1257174&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231257174&indx=18> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 10:01:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 10:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1297328-4005989-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001297328-01988935-001.pdf)
2025-12-03 10:01:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fdfa72ea-2e3a-5643-a0c1-88303f72987e with identifier: 1257174
2025-12-03 10:01:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fdfa72ea-2e3a-5643-a0c1-88303f72987e with scrape type 1
2025-12-03 10:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item fdfa72ea-2e3a-5643-a0c1-88303f72987e
2025-12-03 10:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6c249875-b24d-48c6-8254-1027b65063aa_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6c249875-b24d-48c6-8254-1027b65063aa_ext_7.jpg not downloaded yet
2025-12-03 10:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6c249875-b24d-48c6-8254-1027b65063aa_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6c249875-b24d-48c6-8254-1027b65063aa_ext_7.jpg not downloaded yet
2025-12-03 10:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6c249875-b24d-48c6-8254-1027b65063aa_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6c249875-b24d-48c6-8254-1027b65063aa_ext_6.jpg not downloaded yet
2025-12-03 10:01:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:01:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa276f3e210>
2025-12-03 10:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:01:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 10:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:01:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f26da7e4-b5b3-56d4-a53a-3407e101d96f/f26da7e4-b5b3-56d4-a53a-3407e101d96f_image_14.jpg HTTP/1.1" 201 0
2025-12-03 10:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1297328-4005989-1000.jpg') HTTP/1.1" 204 0
2025-12-03 10:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1297328-4005989-1000.jpg saved to cache
2025-12-03 10:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item f26da7e4-b5b3-56d4-a53a-3407e101d96f
2025-12-03 10:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001297328-01988935-001.pdf)
2025-12-03 10:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6c249875-b24d-48c6-8254-1027b65063aa_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6c249875-b24d-48c6-8254-1027b65063aa_ext_1.jpg not downloaded yet
2025-12-03 10:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6c249875-b24d-48c6-8254-1027b65063aa_5.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6c249875-b24d-48c6-8254-1027b65063aa_5.jpg not downloaded yet
2025-12-03 10:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6c249875-b24d-48c6-8254-1027b65063aa_4.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6c249875-b24d-48c6-8254-1027b65063aa_4.jpg not downloaded yet
2025-12-03 10:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6c249875-b24d-48c6-8254-1027b65063aa_11.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6c249875-b24d-48c6-8254-1027b65063aa_11.jpg not downloaded yet
2025-12-03 10:01:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:01:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa276134510>
2025-12-03 10:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:01:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 10:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f26da7e4-b5b3-56d4-a53a-3407e101d96f/f26da7e4-b5b3-56d4-a53a-3407e101d96f_image_12.jpg HTTP/1.1" 201 0
2025-12-03 10:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_ext_4.jpg') HTTP/1.1" 204 0
2025-12-03 10:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_ext_4.jpg saved to cache
2025-12-03 10:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item f26da7e4-b5b3-56d4-a53a-3407e101d96f
2025-12-03 10:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1297328-4005989-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001297328-01988935-001.pdf)
2025-12-03 10:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6c249875-b24d-48c6-8254-1027b65063aa_10.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6c249875-b24d-48c6-8254-1027b65063aa_10.jpg not downloaded yet
2025-12-03 10:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/6c249875-b24d-48c6-8254-1027b65063aa_ext_6.jpg> (referer: None)
2025-12-03 10:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6c249875-b24d-48c6-8254-1027b65063aa_9.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6c249875-b24d-48c6-8254-1027b65063aa_9.jpg not downloaded yet
2025-12-03 10:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6c249875-b24d-48c6-8254-1027b65063aa_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6c249875-b24d-48c6-8254-1027b65063aa_ext_2.jpg not downloaded yet
2025-12-03 10:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6c249875-b24d-48c6-8254-1027b65063aa_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6c249875-b24d-48c6-8254-1027b65063aa_ext_5.jpg not downloaded yet
2025-12-03 10:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6c249875-b24d-48c6-8254-1027b65063aa_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6c249875-b24d-48c6-8254-1027b65063aa_ext_3.jpg not downloaded yet
2025-12-03 10:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6c249875-b24d-48c6-8254-1027b65063aa_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6c249875-b24d-48c6-8254-1027b65063aa_ext_4.jpg not downloaded yet
2025-12-03 10:01:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:01:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa2770d6690>
2025-12-03 10:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:01:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 10:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f26da7e4-b5b3-56d4-a53a-3407e101d96f/f26da7e4-b5b3-56d4-a53a-3407e101d96f_image_13.jpg HTTP/1.1" 201 0
2025-12-03 10:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1297328-4005989-13.jpg') HTTP/1.1" 204 0
2025-12-03 10:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1297328-4005989-13.jpg saved to cache
2025-12-03 10:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item f26da7e4-b5b3-56d4-a53a-3407e101d96f
2025-12-03 10:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1257174-4005920-13.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1257174-4005920-13.jpg not downloaded yet
2025-12-03 10:01:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:01:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa276a893d0>
2025-12-03 10:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:01:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 10:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdfa72ea-2e3a-5643-a0c1-88303f72987e/fdfa72ea-2e3a-5643-a0c1-88303f72987e_image_2.jpg HTTP/1.1" 201 0
2025-12-03 10:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6c249875-b24d-48c6-8254-1027b65063aa_ext_6.jpg') HTTP/1.1" 204 0
2025-12-03 10:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6c249875-b24d-48c6-8254-1027b65063aa_ext_6.jpg saved to cache
2025-12-03 10:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fdfa72ea-2e3a-5643-a0c1-88303f72987e
2025-12-03 10:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1257174-4005920-1000.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1257174-4005920-1000.jpg not downloaded yet
2025-12-03 10:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/CCLASS?id=1639320&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231639320&indx=50> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 10:01:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 10:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/6c249875-b24d-48c6-8254-1027b65063aa_10.jpg> (referer: None)
2025-12-03 10:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/6c249875-b24d-48c6-8254-1027b65063aa_11.jpg> (referer: None)
2025-12-03 10:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1257174-4005920-1001.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1257174-4005920-1001.jpg not downloaded yet
2025-12-03 10:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1257174-4005920-1002.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1257174-4005920-1002.jpg not downloaded yet
2025-12-03 10:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1257174-4005920-1003.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1257174-4005920-1003.jpg not downloaded yet
2025-12-03 10:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1257174-4005920-1004.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1257174-4005920-1004.jpg not downloaded yet
2025-12-03 10:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1257174-4005920-1005.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1257174-4005920-1005.jpg not downloaded yet
2025-12-03 10:01:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fac14423-7150-5962-9e93-8a140a5c8aa8 with identifier: 1639320
2025-12-03 10:01:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fac14423-7150-5962-9e93-8a140a5c8aa8 with scrape type 2
2025-12-03 10:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fac14423-7150-5962-9e93-8a140a5c8aa8 with scrape type 2
2025-12-03 10:01:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: fac14423-7150-5962-9e93-8a140a5c8aa8, identifier: 1639320
2025-12-03 10:01:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: fac14423-7150-5962-9e93-8a140a5c8aa8 with identifier: 1639320
2025-12-03 10:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-03 10:01:23 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=SILVER HTTP/1.1" 200 None
2025-12-03 10:01:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-03 10:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-03 10:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-03 10:01:24 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Petrol%2FHybrid HTTP/1.1" 200 None
2025-12-03 10:01:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-03 10:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-03 10:01:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: fac14423-7150-5962-9e93-8a140a5c8aa8 with identifier: 1639320
2025-12-03 10:01:24 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: fac14423-7150-5962-9e93-8a140a5c8aa8 with expiration date: 2025-12-03T09:00:00Z
{'auction_title': '',
 'c_o_2_emission_value': 53,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001639320-01980795-005.pdf',
 'color': 'SILVER',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': '2025-12-03T09:00:00Z',
 'fuel_type': 'Petrol/Hybrid',
 'id': 'fac14423-7150-5962-9e93-8a140a5c8aa8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'PJ18VJP',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/C%20CLASS?id=1639320',
 'listing': 'auction',
 'location': 'Birmingham',
 'make': 'MERCEDES-BENZ',
 'model': 'C CLASS',
 'odometer': 137658,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-29',
 'seller_name': 'Sturgess Motor Group',
 'title': 'MERCEDES-BENZ C CLASS C350e Sport Premium 5dr Auto',
 'transmission': 'automatic',
 'trim': 'C350e Sport Premium 5dr Auto',
 'year': 2018}
2025-12-03 10:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271639320%27 HTTP/1.1" 200 None
2025-12-03 10:01:24 [manheim.gb] INFO: Saving data for 1639320: {'auction_closing_time': 1764752400.0, 'created_time': 1764662520.918475, 'last_price_update_time': 1764756084.250848}
2025-12-03 10:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1639320') HTTP/1.1" 204 0
2025-12-03 10:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1257174-4005920-1000.jpg> (referer: None)
2025-12-03 10:01:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:01:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa2761389d0>
2025-12-03 10:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:01:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 10:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdfa72ea-2e3a-5643-a0c1-88303f72987e/fdfa72ea-2e3a-5643-a0c1-88303f72987e_image_7.jpg HTTP/1.1" 201 0
2025-12-03 10:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6c249875-b24d-48c6-8254-1027b65063aa_10.jpg') HTTP/1.1" 204 0
2025-12-03 10:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6c249875-b24d-48c6-8254-1027b65063aa_10.jpg saved to cache
2025-12-03 10:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fdfa72ea-2e3a-5643-a0c1-88303f72987e
2025-12-03 10:01:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:01:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa276ac3f10>
2025-12-03 10:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:01:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 10:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdfa72ea-2e3a-5643-a0c1-88303f72987e/fdfa72ea-2e3a-5643-a0c1-88303f72987e_image_6.jpg HTTP/1.1" 201 0
2025-12-03 10:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6c249875-b24d-48c6-8254-1027b65063aa_11.jpg') HTTP/1.1" 204 0
2025-12-03 10:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6c249875-b24d-48c6-8254-1027b65063aa_11.jpg saved to cache
2025-12-03 10:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fdfa72ea-2e3a-5643-a0c1-88303f72987e
2025-12-03 10:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1257174-4005920-13.jpg> (referer: None)
2025-12-03 10:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/6c249875-b24d-48c6-8254-1027b65063aa_ext_4.jpg> (referer: None)
2025-12-03 10:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/MINI/PACEMAN?id=1173100&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231173100&indx=13> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 10:01:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 10:01:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:01:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa2761079d0>
2025-12-03 10:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:01:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 10:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdfa72ea-2e3a-5643-a0c1-88303f72987e/fdfa72ea-2e3a-5643-a0c1-88303f72987e_image_14.jpg HTTP/1.1" 201 0
2025-12-03 10:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1257174-4005920-1000.jpg') HTTP/1.1" 204 0
2025-12-03 10:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1257174-4005920-1000.jpg saved to cache
2025-12-03 10:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item fdfa72ea-2e3a-5643-a0c1-88303f72987e
2025-12-03 10:01:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:01:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa276aead90>
2025-12-03 10:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:01:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 10:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdfa72ea-2e3a-5643-a0c1-88303f72987e/fdfa72ea-2e3a-5643-a0c1-88303f72987e_image_13.jpg HTTP/1.1" 201 0
2025-12-03 10:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1257174-4005920-13.jpg') HTTP/1.1" 204 0
2025-12-03 10:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1257174-4005920-13.jpg saved to cache
2025-12-03 10:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item fdfa72ea-2e3a-5643-a0c1-88303f72987e
2025-12-03 10:01:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:01:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa275808390>
2025-12-03 10:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:01:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 10:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdfa72ea-2e3a-5643-a0c1-88303f72987e/fdfa72ea-2e3a-5643-a0c1-88303f72987e_image_12.jpg HTTP/1.1" 201 0
2025-12-03 10:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6c249875-b24d-48c6-8254-1027b65063aa_ext_4.jpg') HTTP/1.1" 204 0
2025-12-03 10:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6c249875-b24d-48c6-8254-1027b65063aa_ext_4.jpg saved to cache
2025-12-03 10:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item fdfa72ea-2e3a-5643-a0c1-88303f72987e
2025-12-03 10:01:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6 with identifier: 1173100
2025-12-03 10:01:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6 with scrape type 2
2025-12-03 10:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6 with scrape type 2
2025-12-03 10:01:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6, identifier: 1173100
2025-12-03 10:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1257174-4005920-1005.jpg> (referer: None)
2025-12-03 10:01:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6 with identifier: 1173100
2025-12-03 10:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-03 10:01:26 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Black HTTP/1.1" 200 None
2025-12-03 10:01:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-03 10:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-03 10:01:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6 with identifier: 1173100
2025-12-03 10:01:26 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 11 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    11
2025-12-03 10:01:26 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: 2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6 spider: manheim.gb
2025-12-03 10:01:27 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6 due to rule: registration_date_old.json, error: 11 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    11
{'auction_title': '',
 'c_o_2_emission_value': 157,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001173100-01984307-002.pdf',
 'color': 'Black',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'MM63XLX',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MINI/PACEMAN?id=1173100',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'MINI',
 'model': 'PACEMAN',
 'odometer': 84152,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-17',
 'seller_name': 'Lookers',
 'title': 'MINI PACEMAN 1.6 Cooper S ALL4 3dr',
 'transmission': 'manual',
 'trim': '1.6 Cooper S ALL4 3dr',
 'year': 2014}
2025-12-03 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271173100%27 HTTP/1.1" 200 None
2025-12-03 10:01:27 [manheim.gb] INFO: Saving data for 1173100: {'auction_closing_time': 1764838800.0, 'created_time': 1764662515.710827, 'last_price_update_time': 1764756087.03905}
2025-12-03 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1173100') HTTP/1.1" 204 0
2025-12-03 10:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1257174-4005920-1004.jpg> (referer: None)
2025-12-03 10:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1257174-4005920-1003.jpg> (referer: None)
2025-12-03 10:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/PEUGEOT/2008?id=1191100&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231191100&indx=14> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 10:01:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 10:01:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:01:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa276af5950>
2025-12-03 10:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:01:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 10:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdfa72ea-2e3a-5643-a0c1-88303f72987e/fdfa72ea-2e3a-5643-a0c1-88303f72987e_image_19.jpg HTTP/1.1" 201 0
2025-12-03 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1257174-4005920-1005.jpg') HTTP/1.1" 204 0
2025-12-03 10:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1257174-4005920-1005.jpg saved to cache
2025-12-03 10:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item fdfa72ea-2e3a-5643-a0c1-88303f72987e
2025-12-03 10:01:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:01:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa2761b3f50>
2025-12-03 10:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:01:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 10:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdfa72ea-2e3a-5643-a0c1-88303f72987e/fdfa72ea-2e3a-5643-a0c1-88303f72987e_image_18.jpg HTTP/1.1" 201 0
2025-12-03 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1257174-4005920-1004.jpg') HTTP/1.1" 204 0
2025-12-03 10:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1257174-4005920-1004.jpg saved to cache
2025-12-03 10:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item fdfa72ea-2e3a-5643-a0c1-88303f72987e
2025-12-03 10:01:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:01:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa277183fd0>
2025-12-03 10:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:01:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 10:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdfa72ea-2e3a-5643-a0c1-88303f72987e/fdfa72ea-2e3a-5643-a0c1-88303f72987e_image_17.jpg HTTP/1.1" 201 0
2025-12-03 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1257174-4005920-1003.jpg') HTTP/1.1" 204 0
2025-12-03 10:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1257174-4005920-1003.jpg saved to cache
2025-12-03 10:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item fdfa72ea-2e3a-5643-a0c1-88303f72987e
2025-12-03 10:01:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c09971d2-0f86-5121-95df-3a46bf4d998a with identifier: 1191100
2025-12-03 10:01:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c09971d2-0f86-5121-95df-3a46bf4d998a with scrape type 2
2025-12-03 10:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c09971d2-0f86-5121-95df-3a46bf4d998a with scrape type 2
2025-12-03 10:01:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: c09971d2-0f86-5121-95df-3a46bf4d998a, identifier: 1191100
2025-12-03 10:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/6c249875-b24d-48c6-8254-1027b65063aa_ext_3.jpg> (referer: None)
2025-12-03 10:01:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: c09971d2-0f86-5121-95df-3a46bf4d998a with identifier: 1191100
2025-12-03 10:01:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: c09971d2-0f86-5121-95df-3a46bf4d998a with identifier: 1191100
2025-12-03 10:01:28 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: c09971d2-0f86-5121-95df-3a46bf4d998a with identifier: 1191100 to the API
2025-12-03 10:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 10:01:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 10:01:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/PEUGEOT/2008?id=1191100&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231191100&indx=14>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001191100-01960557-005.pdf',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'c09971d2-0f86-5121-95df-3a46bf4d998a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'YN66YKL',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/PEUGEOT/2008?id=1191100',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 73214,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-02',
 'seller_name': 'Startline Motor Finance',
 'title': 'PEUGEOT 2008 1.2 PureTech Allure 5dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech Allure 5dr',
 'year': 2016}
2025-12-03 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271191100%27 HTTP/1.1" 200 None
2025-12-03 10:01:28 [manheim.gb] INFO: Saving data for 1191100: {'auction_closing_time': 1764838800.0, 'created_time': 1762459321.585089, 'last_price_update_time': 1764756088.465746}
2025-12-03 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1191100') HTTP/1.1" 204 0
2025-12-03 10:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1257174-4005920-1001.jpg> (referer: None)
2025-12-03 10:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1257174-4005920-1002.jpg> (referer: None)
2025-12-03 10:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/6c249875-b24d-48c6-8254-1027b65063aa_ext_5.jpg> (referer: None)
2025-12-03 10:01:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:01:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa276135550>
2025-12-03 10:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:01:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 10:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdfa72ea-2e3a-5643-a0c1-88303f72987e/fdfa72ea-2e3a-5643-a0c1-88303f72987e_image_11.jpg HTTP/1.1" 201 0
2025-12-03 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6c249875-b24d-48c6-8254-1027b65063aa_ext_3.jpg') HTTP/1.1" 204 0
2025-12-03 10:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6c249875-b24d-48c6-8254-1027b65063aa_ext_3.jpg saved to cache
2025-12-03 10:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item fdfa72ea-2e3a-5643-a0c1-88303f72987e
2025-12-03 10:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/6c249875-b24d-48c6-8254-1027b65063aa_9.jpg> (referer: None)
2025-12-03 10:01:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:01:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa276ad5790>
2025-12-03 10:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:01:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 10:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdfa72ea-2e3a-5643-a0c1-88303f72987e/fdfa72ea-2e3a-5643-a0c1-88303f72987e_image_15.jpg HTTP/1.1" 201 0
2025-12-03 10:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1257174-4005920-1001.jpg') HTTP/1.1" 204 0
2025-12-03 10:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1257174-4005920-1001.jpg saved to cache
2025-12-03 10:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item fdfa72ea-2e3a-5643-a0c1-88303f72987e
2025-12-03 10:01:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:01:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa276145410>
2025-12-03 10:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:01:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 10:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdfa72ea-2e3a-5643-a0c1-88303f72987e/fdfa72ea-2e3a-5643-a0c1-88303f72987e_image_16.jpg HTTP/1.1" 201 0
2025-12-03 10:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1257174-4005920-1002.jpg') HTTP/1.1" 204 0
2025-12-03 10:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1257174-4005920-1002.jpg saved to cache
2025-12-03 10:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item fdfa72ea-2e3a-5643-a0c1-88303f72987e
2025-12-03 10:01:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:01:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa2761e6ad0>
2025-12-03 10:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:01:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 10:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdfa72ea-2e3a-5643-a0c1-88303f72987e/fdfa72ea-2e3a-5643-a0c1-88303f72987e_image_10.jpg HTTP/1.1" 201 0
2025-12-03 10:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6c249875-b24d-48c6-8254-1027b65063aa_ext_5.jpg') HTTP/1.1" 204 0
2025-12-03 10:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6c249875-b24d-48c6-8254-1027b65063aa_ext_5.jpg saved to cache
2025-12-03 10:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item fdfa72ea-2e3a-5643-a0c1-88303f72987e
2025-12-03 10:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/6c249875-b24d-48c6-8254-1027b65063aa_ext_2.jpg> (referer: None)
2025-12-03 10:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/6c249875-b24d-48c6-8254-1027b65063aa_4.jpg> (referer: None)
2025-12-03 10:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/6c249875-b24d-48c6-8254-1027b65063aa_ext_1.jpg> (referer: None)
2025-12-03 10:01:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:01:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa276133fd0>
2025-12-03 10:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:01:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 10:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdfa72ea-2e3a-5643-a0c1-88303f72987e/fdfa72ea-2e3a-5643-a0c1-88303f72987e_image_8.jpg HTTP/1.1" 201 0
2025-12-03 10:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6c249875-b24d-48c6-8254-1027b65063aa_9.jpg') HTTP/1.1" 204 0
2025-12-03 10:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6c249875-b24d-48c6-8254-1027b65063aa_9.jpg saved to cache
2025-12-03 10:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fdfa72ea-2e3a-5643-a0c1-88303f72987e
2025-12-03 10:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/6c249875-b24d-48c6-8254-1027b65063aa_5.jpg> (referer: None)
2025-12-03 10:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/6c249875-b24d-48c6-8254-1027b65063aa_ext_7.jpg> (referer: None)
2025-12-03 10:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/6c249875-b24d-48c6-8254-1027b65063aa_ext_7.jpg> (referer: None)
2025-12-03 10:01:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:01:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa2761e93d0>
2025-12-03 10:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:01:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 10:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdfa72ea-2e3a-5643-a0c1-88303f72987e/fdfa72ea-2e3a-5643-a0c1-88303f72987e_image_9.jpg HTTP/1.1" 201 0
2025-12-03 10:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6c249875-b24d-48c6-8254-1027b65063aa_ext_2.jpg') HTTP/1.1" 204 0
2025-12-03 10:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6c249875-b24d-48c6-8254-1027b65063aa_ext_2.jpg saved to cache
2025-12-03 10:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fdfa72ea-2e3a-5643-a0c1-88303f72987e
2025-12-03 10:01:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:01:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa2758206d0>
2025-12-03 10:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:01:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 10:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdfa72ea-2e3a-5643-a0c1-88303f72987e/fdfa72ea-2e3a-5643-a0c1-88303f72987e_image_5.jpg HTTP/1.1" 201 0
2025-12-03 10:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6c249875-b24d-48c6-8254-1027b65063aa_4.jpg') HTTP/1.1" 204 0
2025-12-03 10:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6c249875-b24d-48c6-8254-1027b65063aa_4.jpg saved to cache
2025-12-03 10:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fdfa72ea-2e3a-5643-a0c1-88303f72987e
2025-12-03 10:01:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:01:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa275811290>
2025-12-03 10:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:01:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 10:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdfa72ea-2e3a-5643-a0c1-88303f72987e/fdfa72ea-2e3a-5643-a0c1-88303f72987e_image_3.jpg HTTP/1.1" 201 0
2025-12-03 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6c249875-b24d-48c6-8254-1027b65063aa_ext_1.jpg') HTTP/1.1" 204 0
2025-12-03 10:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6c249875-b24d-48c6-8254-1027b65063aa_ext_1.jpg saved to cache
2025-12-03 10:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fdfa72ea-2e3a-5643-a0c1-88303f72987e
2025-12-03 10:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001297328-01988935-001.pdf)
2025-12-03 10:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001297328-01988935-001.pdf)
2025-12-03 10:01:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:01:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa2770479d0>
2025-12-03 10:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:01:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 10:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdfa72ea-2e3a-5643-a0c1-88303f72987e/fdfa72ea-2e3a-5643-a0c1-88303f72987e_image_4.jpg HTTP/1.1" 201 0
2025-12-03 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6c249875-b24d-48c6-8254-1027b65063aa_5.jpg') HTTP/1.1" 204 0
2025-12-03 10:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6c249875-b24d-48c6-8254-1027b65063aa_5.jpg saved to cache
2025-12-03 10:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fdfa72ea-2e3a-5643-a0c1-88303f72987e
2025-12-03 10:01:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:01:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa27703e210>
2025-12-03 10:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:01:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 10:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdfa72ea-2e3a-5643-a0c1-88303f72987e/fdfa72ea-2e3a-5643-a0c1-88303f72987e_image_1.jpg HTTP/1.1" 201 0
2025-12-03 10:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6c249875-b24d-48c6-8254-1027b65063aa_ext_7.jpg') HTTP/1.1" 204 0
2025-12-03 10:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6c249875-b24d-48c6-8254-1027b65063aa_ext_7.jpg saved to cache
2025-12-03 10:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fdfa72ea-2e3a-5643-a0c1-88303f72987e
2025-12-03 10:01:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:01:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa27702cbd0>
2025-12-03 10:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:01:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 10:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdfa72ea-2e3a-5643-a0c1-88303f72987e/fdfa72ea-2e3a-5643-a0c1-88303f72987e_image_0.jpg HTTP/1.1" 201 0
2025-12-03 10:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6c249875-b24d-48c6-8254-1027b65063aa_ext_7.jpg') HTTP/1.1" 204 0
2025-12-03 10:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6c249875-b24d-48c6-8254-1027b65063aa_ext_7.jpg saved to cache
2025-12-03 10:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fdfa72ea-2e3a-5643-a0c1-88303f72987e
2025-12-03 10:01:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fdfa72ea-2e3a-5643-a0c1-88303f72987e, skipping ID generation
2025-12-03 10:01:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fdfa72ea-2e3a-5643-a0c1-88303f72987e with scrape type 1
2025-12-03 10:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Removing item fdfa72ea-2e3a-5643-a0c1-88303f72987e from tracking dictionaries
2025-12-03 10:01:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fdfa72ea-2e3a-5643-a0c1-88303f72987e sending to next pipeline
2025-12-03 10:01:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: fdfa72ea-2e3a-5643-a0c1-88303f72987e, identifier: 1257174
2025-12-03 10:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001297328-01988935-001.pdf)
2025-12-03 10:01:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: fdfa72ea-2e3a-5643-a0c1-88303f72987e with identifier: 1257174
2025-12-03 10:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-03 10:01:32 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=BLUE HTTP/1.1" 200 None
2025-12-03 10:01:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-03 10:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-03 10:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-03 10:01:32 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Diesel HTTP/1.1" 200 None
2025-12-03 10:01:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-03 10:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-03 10:01:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: fdfa72ea-2e3a-5643-a0c1-88303f72987e with identifier: 1257174
2025-12-03 10:01:33 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 154446 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    154446
2025-12-03 10:01:33 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: fdfa72ea-2e3a-5643-a0c1-88303f72987e spider: manheim.gb
2025-12-03 10:01:33 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: fdfa72ea-2e3a-5643-a0c1-88303f72987e due to rule: high_mileage_for_country.json, error: 154446 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    154446
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'car_expert_report_source_url': None,
 'color': 'BLUE',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'fdfa72ea-2e3a-5643-a0c1-88303f72987e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'LM65HBJ',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/CITROEN/C4%20PICASSO?id=1257174',
 'listing': 'auction',
 'location': 'Birmingham',
 'make': 'CITROEN',
 'model': 'C4 PICASSO',
 'odometer': 95969,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 33,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdfa72ea-2e3a-5643-a0c1-88303f72987e/fdfa72ea-2e3a-5643-a0c1-88303f72987e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 207607,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/6c249875-b24d-48c6-8254-1027b65063aa_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdfa72ea-2e3a-5643-a0c1-88303f72987e/fdfa72ea-2e3a-5643-a0c1-88303f72987e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 207607,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/6c249875-b24d-48c6-8254-1027b65063aa_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdfa72ea-2e3a-5643-a0c1-88303f72987e/fdfa72ea-2e3a-5643-a0c1-88303f72987e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 149595,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/6c249875-b24d-48c6-8254-1027b65063aa_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdfa72ea-2e3a-5643-a0c1-88303f72987e/fdfa72ea-2e3a-5643-a0c1-88303f72987e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85450,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/6c249875-b24d-48c6-8254-1027b65063aa_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdfa72ea-2e3a-5643-a0c1-88303f72987e/fdfa72ea-2e3a-5643-a0c1-88303f72987e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 198243,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/6c249875-b24d-48c6-8254-1027b65063aa_5.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdfa72ea-2e3a-5643-a0c1-88303f72987e/fdfa72ea-2e3a-5643-a0c1-88303f72987e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 209486,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/6c249875-b24d-48c6-8254-1027b65063aa_4.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdfa72ea-2e3a-5643-a0c1-88303f72987e/fdfa72ea-2e3a-5643-a0c1-88303f72987e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 197613,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/6c249875-b24d-48c6-8254-1027b65063aa_11.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdfa72ea-2e3a-5643-a0c1-88303f72987e/fdfa72ea-2e3a-5643-a0c1-88303f72987e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 204219,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/6c249875-b24d-48c6-8254-1027b65063aa_10.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdfa72ea-2e3a-5643-a0c1-88303f72987e/fdfa72ea-2e3a-5643-a0c1-88303f72987e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 213379,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/6c249875-b24d-48c6-8254-1027b65063aa_9.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdfa72ea-2e3a-5643-a0c1-88303f72987e/fdfa72ea-2e3a-5643-a0c1-88303f72987e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 182490,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/6c249875-b24d-48c6-8254-1027b65063aa_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdfa72ea-2e3a-5643-a0c1-88303f72987e/fdfa72ea-2e3a-5643-a0c1-88303f72987e_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 170307,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/6c249875-b24d-48c6-8254-1027b65063aa_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdfa72ea-2e3a-5643-a0c1-88303f72987e/fdfa72ea-2e3a-5643-a0c1-88303f72987e_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 167282,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/6c249875-b24d-48c6-8254-1027b65063aa_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdfa72ea-2e3a-5643-a0c1-88303f72987e/fdfa72ea-2e3a-5643-a0c1-88303f72987e_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 202044,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/6c249875-b24d-48c6-8254-1027b65063aa_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdfa72ea-2e3a-5643-a0c1-88303f72987e/fdfa72ea-2e3a-5643-a0c1-88303f72987e_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 295074,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1257174-4005920-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdfa72ea-2e3a-5643-a0c1-88303f72987e/fdfa72ea-2e3a-5643-a0c1-88303f72987e_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 228234,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1257174-4005920-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdfa72ea-2e3a-5643-a0c1-88303f72987e/fdfa72ea-2e3a-5643-a0c1-88303f72987e_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 219495,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1257174-4005920-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdfa72ea-2e3a-5643-a0c1-88303f72987e/fdfa72ea-2e3a-5643-a0c1-88303f72987e_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 227493,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1257174-4005920-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdfa72ea-2e3a-5643-a0c1-88303f72987e/fdfa72ea-2e3a-5643-a0c1-88303f72987e_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 322552,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1257174-4005920-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdfa72ea-2e3a-5643-a0c1-88303f72987e/fdfa72ea-2e3a-5643-a0c1-88303f72987e_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 235655,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1257174-4005920-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdfa72ea-2e3a-5643-a0c1-88303f72987e/fdfa72ea-2e3a-5643-a0c1-88303f72987e_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 172645,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1257174-4005920-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-31',
 'seller_name': 'Big Motoring World Ltd',
 'title': 'CITROEN C4 PICASSO 1.6 BlueHDi 100 VTR+ 5dr',
 'transmission': 'manual',
 'trim': '1.6 BlueHDi 100 VTR+ 5dr',
 'year': 2015}
2025-12-03 10:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271257174%27 HTTP/1.1" 200 None
2025-12-03 10:01:33 [manheim.gb] INFO: Saving data for 1257174: {'created_time': 1764756093.282903, 'last_price_update_time': 1764756093.282913, 'auction_closing_time': 1765184400.0}
2025-12-03 10:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1257174') HTTP/1.1" 204 0
2025-12-03 10:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001297328-01988935-001.pdf)
2025-12-03 10:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001297328-01988935-001.pdf)
2025-12-03 10:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001297328-01988935-001.pdf)
2025-12-03 10:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001297328-01988935-001.pdf)
2025-12-03 10:01:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:01:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa276f91350>
2025-12-03 10:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:01:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 10:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f26da7e4-b5b3-56d4-a53a-3407e101d96f/f26da7e4-b5b3-56d4-a53a-3407e101d96f_image_11.jpg HTTP/1.1" 201 0
2025-12-03 10:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_ext_3.jpg') HTTP/1.1" 204 0
2025-12-03 10:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_ext_3.jpg saved to cache
2025-12-03 10:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item f26da7e4-b5b3-56d4-a53a-3407e101d96f
2025-12-03 10:01:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:01:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa277146e90>
2025-12-03 10:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:01:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 10:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f26da7e4-b5b3-56d4-a53a-3407e101d96f/f26da7e4-b5b3-56d4-a53a-3407e101d96f_image_10.jpg HTTP/1.1" 201 0
2025-12-03 10:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_ext_5.jpg') HTTP/1.1" 204 0
2025-12-03 10:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_ext_5.jpg saved to cache
2025-12-03 10:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item f26da7e4-b5b3-56d4-a53a-3407e101d96f
2025-12-03 10:01:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:01:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa2772ec810>
2025-12-03 10:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:01:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 10:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f26da7e4-b5b3-56d4-a53a-3407e101d96f/f26da7e4-b5b3-56d4-a53a-3407e101d96f_image_9.jpg HTTP/1.1" 201 0
2025-12-03 10:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_ext_2.jpg') HTTP/1.1" 204 0
2025-12-03 10:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_ext_2.jpg saved to cache
2025-12-03 10:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f26da7e4-b5b3-56d4-a53a-3407e101d96f
2025-12-03 10:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001297328-01988935-001.pdf)
2025-12-03 10:01:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:01:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa277063fd0>
2025-12-03 10:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:01:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 10:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f26da7e4-b5b3-56d4-a53a-3407e101d96f/f26da7e4-b5b3-56d4-a53a-3407e101d96f_image_8.jpg HTTP/1.1" 201 0
2025-12-03 10:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_9.jpg') HTTP/1.1" 204 0
2025-12-03 10:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_9.jpg saved to cache
2025-12-03 10:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f26da7e4-b5b3-56d4-a53a-3407e101d96f
2025-12-03 10:01:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:01:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa27725f3d0>
2025-12-03 10:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:01:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 10:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f26da7e4-b5b3-56d4-a53a-3407e101d96f/f26da7e4-b5b3-56d4-a53a-3407e101d96f_image_7.jpg HTTP/1.1" 201 0
2025-12-03 10:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_10.jpg') HTTP/1.1" 204 0
2025-12-03 10:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_10.jpg saved to cache
2025-12-03 10:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f26da7e4-b5b3-56d4-a53a-3407e101d96f
2025-12-03 10:01:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:01:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa277279250>
2025-12-03 10:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:01:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 10:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f26da7e4-b5b3-56d4-a53a-3407e101d96f/f26da7e4-b5b3-56d4-a53a-3407e101d96f_image_6.jpg HTTP/1.1" 201 0
2025-12-03 10:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_11.jpg') HTTP/1.1" 204 0
2025-12-03 10:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_11.jpg saved to cache
2025-12-03 10:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f26da7e4-b5b3-56d4-a53a-3407e101d96f
2025-12-03 10:01:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:01:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa27724b510>
2025-12-03 10:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:01:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 10:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f26da7e4-b5b3-56d4-a53a-3407e101d96f/f26da7e4-b5b3-56d4-a53a-3407e101d96f_image_5.jpg HTTP/1.1" 201 0
2025-12-03 10:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_4.jpg') HTTP/1.1" 204 0
2025-12-03 10:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_4.jpg saved to cache
2025-12-03 10:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f26da7e4-b5b3-56d4-a53a-3407e101d96f
2025-12-03 10:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001297328-01988935-001.pdf)
2025-12-03 10:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001297328-01988935-001.pdf)
2025-12-03 10:01:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:01:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa2773fbf50>
2025-12-03 10:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:01:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 10:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f26da7e4-b5b3-56d4-a53a-3407e101d96f/f26da7e4-b5b3-56d4-a53a-3407e101d96f_image_4.jpg HTTP/1.1" 201 0
2025-12-03 10:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_5.jpg') HTTP/1.1" 204 0
2025-12-03 10:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_5.jpg saved to cache
2025-12-03 10:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f26da7e4-b5b3-56d4-a53a-3407e101d96f
2025-12-03 10:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001297328-01988935-001.pdf)
2025-12-03 10:01:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:01:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa2770d5f50>
2025-12-03 10:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:01:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 10:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f26da7e4-b5b3-56d4-a53a-3407e101d96f/f26da7e4-b5b3-56d4-a53a-3407e101d96f_image_1.jpg HTTP/1.1" 201 0
2025-12-03 10:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_ext_7.jpg') HTTP/1.1" 204 0
2025-12-03 10:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_ext_7.jpg saved to cache
2025-12-03 10:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f26da7e4-b5b3-56d4-a53a-3407e101d96f
2025-12-03 10:01:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:01:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa276104a90>
2025-12-03 10:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:01:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 10:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f26da7e4-b5b3-56d4-a53a-3407e101d96f/f26da7e4-b5b3-56d4-a53a-3407e101d96f_image_3.jpg HTTP/1.1" 201 0
2025-12-03 10:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_ext_1.jpg') HTTP/1.1" 204 0
2025-12-03 10:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_ext_1.jpg saved to cache
2025-12-03 10:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f26da7e4-b5b3-56d4-a53a-3407e101d96f
2025-12-03 10:01:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:01:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa2772c2f10>
2025-12-03 10:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:01:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 10:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f26da7e4-b5b3-56d4-a53a-3407e101d96f/f26da7e4-b5b3-56d4-a53a-3407e101d96f_image_2.jpg HTTP/1.1" 201 0
2025-12-03 10:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_ext_6.jpg') HTTP/1.1" 204 0
2025-12-03 10:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_ext_6.jpg saved to cache
2025-12-03 10:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f26da7e4-b5b3-56d4-a53a-3407e101d96f
2025-12-03 10:01:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f26da7e4-b5b3-56d4-a53a-3407e101d96f, skipping ID generation
2025-12-03 10:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Removing item f26da7e4-b5b3-56d4-a53a-3407e101d96f from tracking dictionaries
2025-12-03 10:01:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f26da7e4-b5b3-56d4-a53a-3407e101d96f sending to next pipeline
2025-12-03 10:01:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: f26da7e4-b5b3-56d4-a53a-3407e101d96f, identifier: 1297328
2025-12-03 10:01:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: f26da7e4-b5b3-56d4-a53a-3407e101d96f with identifier: 1297328
2025-12-03 10:01:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: f26da7e4-b5b3-56d4-a53a-3407e101d96f with identifier: 1297328
2025-12-03 10:01:37 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 10 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    10
2025-12-03 10:01:37 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: f26da7e4-b5b3-56d4-a53a-3407e101d96f spider: manheim.gb
2025-12-03 10:01:37 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: f26da7e4-b5b3-56d4-a53a-3407e101d96f due to rule: registration_date_old.json, error: 10 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    10
{'auction_title': '',
 'c_o_2_emission_value': 95,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f26da7e4-b5b3-56d4-a53a-3407e101d96f/f26da7e4-b5b3-56d4-a53a-3407e101d96f_expert_report_file_f0312039-d034-4354-9134-ffdeebca9c55.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001297328-01988935-001.pdf',
 'color': 'BLUE',
 'currency': 'GBP',
 'engine': '1.0L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'f26da7e4-b5b3-56d4-a53a-3407e101d96f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'PJ65MPU',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/CITROEN/C1?id=1297328',
 'listing': 'auction',
 'location': 'Leeds',
 'make': 'CITROEN',
 'model': 'C1',
 'odometer': 58554,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f26da7e4-b5b3-56d4-a53a-3407e101d96f/f26da7e4-b5b3-56d4-a53a-3407e101d96f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 210943,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f26da7e4-b5b3-56d4-a53a-3407e101d96f/f26da7e4-b5b3-56d4-a53a-3407e101d96f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 210943,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f26da7e4-b5b3-56d4-a53a-3407e101d96f/f26da7e4-b5b3-56d4-a53a-3407e101d96f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 263496,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f26da7e4-b5b3-56d4-a53a-3407e101d96f/f26da7e4-b5b3-56d4-a53a-3407e101d96f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 227199,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f26da7e4-b5b3-56d4-a53a-3407e101d96f/f26da7e4-b5b3-56d4-a53a-3407e101d96f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 172523,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f26da7e4-b5b3-56d4-a53a-3407e101d96f/f26da7e4-b5b3-56d4-a53a-3407e101d96f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 181591,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f26da7e4-b5b3-56d4-a53a-3407e101d96f/f26da7e4-b5b3-56d4-a53a-3407e101d96f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 176196,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f26da7e4-b5b3-56d4-a53a-3407e101d96f/f26da7e4-b5b3-56d4-a53a-3407e101d96f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 186219,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f26da7e4-b5b3-56d4-a53a-3407e101d96f/f26da7e4-b5b3-56d4-a53a-3407e101d96f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 187414,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f26da7e4-b5b3-56d4-a53a-3407e101d96f/f26da7e4-b5b3-56d4-a53a-3407e101d96f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 286579,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f26da7e4-b5b3-56d4-a53a-3407e101d96f/f26da7e4-b5b3-56d4-a53a-3407e101d96f_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 155747,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f26da7e4-b5b3-56d4-a53a-3407e101d96f/f26da7e4-b5b3-56d4-a53a-3407e101d96f_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 163738,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f26da7e4-b5b3-56d4-a53a-3407e101d96f/f26da7e4-b5b3-56d4-a53a-3407e101d96f_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 218910,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/584e6b57-ea41-4bb9-93fc-4f2c13f6bd88_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f26da7e4-b5b3-56d4-a53a-3407e101d96f/f26da7e4-b5b3-56d4-a53a-3407e101d96f_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 339102,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1297328-4005989-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f26da7e4-b5b3-56d4-a53a-3407e101d96f/f26da7e4-b5b3-56d4-a53a-3407e101d96f_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 424276,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1297328-4005989-1000.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-27',
 'seller_name': 'Available Car',
 'title': 'CITROEN C1 1.0 VTi Feel 3dr',
 'transmission': 'manual',
 'trim': '1.0 VTi Feel 3dr',
 'year': 2015}
2025-12-03 10:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271297328%27 HTTP/1.1" 200 None
2025-12-03 10:01:37 [manheim.gb] INFO: Saving data for 1297328: {'created_time': 1764756097.956274, 'last_price_update_time': 1764756097.956289, 'auction_closing_time': 1765184400.0}
2025-12-03 10:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1297328') HTTP/1.1" 204 0
2025-12-03 10:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/HYUNDAI/I20?id=1546758&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231546758&indx=42> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 10:01:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 10:01:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 165c7016-28ee-5501-9051-16d20a9d3c9a with identifier: 1546758
2025-12-03 10:01:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 165c7016-28ee-5501-9051-16d20a9d3c9a with scrape type 2
2025-12-03 10:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 165c7016-28ee-5501-9051-16d20a9d3c9a with scrape type 2
2025-12-03 10:01:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 165c7016-28ee-5501-9051-16d20a9d3c9a, identifier: 1546758
2025-12-03 10:01:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 165c7016-28ee-5501-9051-16d20a9d3c9a with identifier: 1546758
2025-12-03 10:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-03 10:01:38 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=RED HTTP/1.1" 200 None
2025-12-03 10:01:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-03 10:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-03 10:01:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 165c7016-28ee-5501-9051-16d20a9d3c9a with identifier: 1546758
2025-12-03 10:01:38 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 153439 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    153439
2025-12-03 10:01:38 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 165c7016-28ee-5501-9051-16d20a9d3c9a spider: manheim.gb
2025-12-03 10:01:38 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 165c7016-28ee-5501-9051-16d20a9d3c9a due to rule: high_mileage_for_country.json, error: 153439 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    153439
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001546758-01971823-003.pdf',
 'color': 'RED',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '165c7016-28ee-5501-9051-16d20a9d3c9a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'EY59KSX',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/HYUNDAI/I20?id=1546758',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'HYUNDAI',
 'model': 'I20',
 'odometer': 95343,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-09-01',
 'seller_name': 'EMG Group',
 'title': 'HYUNDAI I20 1.2 Comfort 3dr',
 'transmission': 'manual',
 'trim': '1.2 Comfort 3dr',
 'year': 2009}
2025-12-03 10:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271546758%27 HTTP/1.1" 200 None
2025-12-03 10:01:38 [manheim.gb] INFO: Saving data for 1546758: {'auction_closing_time': 1764838800.0, 'created_time': 1764662513.860274, 'last_price_update_time': 1764756098.550862}
2025-12-03 10:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1546758') HTTP/1.1" 204 0
2025-12-03 10:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/MINI/HATCHBACK?id=1701386&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231701386&indx=53> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 10:01:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 10:01:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffdda9e8-fcfb-5878-bd75-8f4780e869b3 with identifier: 1701386
2025-12-03 10:01:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffdda9e8-fcfb-5878-bd75-8f4780e869b3 with scrape type 2
2025-12-03 10:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ffdda9e8-fcfb-5878-bd75-8f4780e869b3 with scrape type 2
2025-12-03 10:01:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: ffdda9e8-fcfb-5878-bd75-8f4780e869b3, identifier: 1701386
2025-12-03 10:01:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: ffdda9e8-fcfb-5878-bd75-8f4780e869b3 with identifier: 1701386
2025-12-03 10:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-03 10:01:42 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=BLACK HTTP/1.1" 200 None
2025-12-03 10:01:42 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-03 10:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-03 10:01:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: ffdda9e8-fcfb-5878-bd75-8f4780e869b3 with identifier: 1701386
2025-12-03 10:01:42 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 167981 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    167981
2025-12-03 10:01:42 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: ffdda9e8-fcfb-5878-bd75-8f4780e869b3 spider: manheim.gb
2025-12-03 10:01:43 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: ffdda9e8-fcfb-5878-bd75-8f4780e869b3 due to rule: high_mileage_for_country.json, error: 167981 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    167981
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001701386-01983453-002.pdf',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.5L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'ffdda9e8-fcfb-5878-bd75-8f4780e869b3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'ND16MFX',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MINI/HATCHBACK?id=1701386',
 'listing': 'auction',
 'location': 'Leeds',
 'make': 'MINI',
 'model': 'HATCHBACK',
 'odometer': 104379,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-25',
 'seller_name': 'Pentagon Group',
 'title': 'MINI HATCHBACK 1.5 Cooper 5dr',
 'transmission': 'manual',
 'trim': '1.5 Cooper 5dr',
 'year': 2016}
2025-12-03 10:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271701386%27 HTTP/1.1" 200 None
2025-12-03 10:01:43 [manheim.gb] INFO: Saving data for 1701386: {'auction_closing_time': 1764838800.0, 'created_time': 1764662552.224462, 'last_price_update_time': 1764756103.061664}
2025-12-03 10:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1701386') HTTP/1.1" 204 0
2025-12-03 10:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/ACLASS?id=1762778&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231762778&indx=58> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 10:01:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 10:01:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53435159-8236-51e4-9863-21bfdbdc4d40 with identifier: 1762778
2025-12-03 10:01:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53435159-8236-51e4-9863-21bfdbdc4d40 with scrape type 2
2025-12-03 10:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 53435159-8236-51e4-9863-21bfdbdc4d40 with scrape type 2
2025-12-03 10:01:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 53435159-8236-51e4-9863-21bfdbdc4d40, identifier: 1762778
2025-12-03 10:01:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 53435159-8236-51e4-9863-21bfdbdc4d40 with identifier: 1762778
2025-12-03 10:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-03 10:01:46 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Silver HTTP/1.1" 200 None
2025-12-03 10:01:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-03 10:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-03 10:01:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 53435159-8236-51e4-9863-21bfdbdc4d40 with identifier: 1762778
2025-12-03 10:01:46 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: 53435159-8236-51e4-9863-21bfdbdc4d40 with expiration date: 2025-12-03T09:00:00Z
{'auction_title': '',
 'c_o_2_emission_value': 98,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001762778-01989047-001.pdf',
 'color': 'Silver',
 'currency': 'GBP',
 'engine': '1.5L',
 'expiration_date': '2025-12-03T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '53435159-8236-51e4-9863-21bfdbdc4d40',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'CX15WLK',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/A%20CLASS?id=1762778',
 'listing': 'auction',
 'location': 'Birmingham',
 'make': 'MERCEDES-BENZ',
 'model': 'A CLASS',
 'odometer': 114982,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-22',
 'seller_name': 'Hilton Garage Ltd',
 'title': 'MERCEDES-BENZ A CLASS A180 [1.5] CDI SE 5dr Auto',
 'transmission': 'automatic',
 'trim': 'A180 [1.5] CDI SE 5dr Auto',
 'year': 2015}
2025-12-03 10:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271762778%27 HTTP/1.1" 200 None
2025-12-03 10:01:46 [manheim.gb] INFO: Saving data for 1762778: {'auction_closing_time': 1764752400.0, 'created_time': 1764662543.697851, 'last_price_update_time': 1764756106.187234}
2025-12-03 10:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1762778') HTTP/1.1" 204 0
2025-12-03 10:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/NISSAN/NOTE?id=1798612&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231798612&indx=61> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 10:01:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06d87df0-6aef-5d6d-8442-100ba6aaef5a with identifier: 1798612
2025-12-03 10:01:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06d87df0-6aef-5d6d-8442-100ba6aaef5a with scrape type 2
2025-12-03 10:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 06d87df0-6aef-5d6d-8442-100ba6aaef5a with scrape type 2
2025-12-03 10:01:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 06d87df0-6aef-5d6d-8442-100ba6aaef5a, identifier: 1798612
2025-12-03 10:01:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 06d87df0-6aef-5d6d-8442-100ba6aaef5a with identifier: 1798612
2025-12-03 10:01:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 06d87df0-6aef-5d6d-8442-100ba6aaef5a with identifier: 1798612
2025-12-03 10:01:47 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 10 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    10
2025-12-03 10:01:47 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: 06d87df0-6aef-5d6d-8442-100ba6aaef5a spider: manheim.gb
2025-12-03 10:01:47 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 06d87df0-6aef-5d6d-8442-100ba6aaef5a due to rule: registration_date_old.json, error: 10 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    10
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001798612-01990477-003.pdf',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '06d87df0-6aef-5d6d-8442-100ba6aaef5a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'NA15LXP',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/NISSAN/NOTE?id=1798612',
 'listing': 'auction',
 'location': 'Shotts',
 'make': 'NISSAN',
 'model': 'NOTE',
 'odometer': 76768,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-08',
 'seller_name': 'Oplo CF Limited',
 'title': 'NISSAN NOTE 1.2 Acenta 5dr',
 'transmission': 'manual',
 'trim': '1.2 Acenta 5dr',
 'year': 2015}
2025-12-03 10:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271798612%27 HTTP/1.1" 200 None
2025-12-03 10:01:47 [manheim.gb] INFO: Saving data for 1798612: {'auction_closing_time': 1764838800.0, 'created_time': 1764662608.034241, 'last_price_update_time': 1764756107.984836}
2025-12-03 10:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1798612') HTTP/1.1" 204 0
2025-12-03 10:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/PEUGEOT/3008?id=1736358&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231736358&indx=56> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 10:01:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 261fae57-e3f6-5060-9570-55439dcdcc42 with identifier: 1736358
2025-12-03 10:01:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 261fae57-e3f6-5060-9570-55439dcdcc42 with scrape type 2
2025-12-03 10:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 261fae57-e3f6-5060-9570-55439dcdcc42 with scrape type 2
2025-12-03 10:01:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 261fae57-e3f6-5060-9570-55439dcdcc42, identifier: 1736358
2025-12-03 10:01:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 261fae57-e3f6-5060-9570-55439dcdcc42 with identifier: 1736358
2025-12-03 10:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-03 10:01:52 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Pearl+White HTTP/1.1" 200 None
2025-12-03 10:01:52 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-03 10:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-03 10:01:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 261fae57-e3f6-5060-9570-55439dcdcc42 with identifier: 1736358
2025-12-03 10:01:52 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: 261fae57-e3f6-5060-9570-55439dcdcc42 with expiration date: 2025-12-03T09:00:00Z
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001736358-01967729-003.pdf',
 'color': 'Pearl White',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': '2025-12-03T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '261fae57-e3f6-5060-9570-55439dcdcc42',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'CV67NVN',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/PEUGEOT/3008?id=1736358',
 'listing': 'auction',
 'location': 'Leeds',
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 64303,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-29',
 'seller_name': 'Peugeot',
 'title': 'PEUGEOT 3008 1.6 BlueHDi 120 Allure 5dr',
 'transmission': 'manual',
 'trim': '1.6 BlueHDi 120 Allure 5dr',
 'year': 2017}
2025-12-03 10:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271736358%27 HTTP/1.1" 200 None
2025-12-03 10:01:52 [manheim.gb] INFO: Saving data for 1736358: {'auction_closing_time': 1764752400.0, 'created_time': 1764662538.189623, 'last_price_update_time': 1764756112.493933}
2025-12-03 10:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1736358') HTTP/1.1" 204 0
2025-12-03 10:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/refine> (referer: https://www.manheim.co.uk/search) ['zyte-api']
2025-12-03 10:01:52 [manheim.gb] INFO: Found listing with ID: 2237239
2025-12-03 10:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272237239%27 HTTP/1.1" 200 None
2025-12-03 10:01:52 [manheim.gb] INFO: Scrape type for 2237239: 0
2025-12-03 10:01:52 [manheim.gb] INFO: Found listing with ID: 2243807
2025-12-03 10:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272243807%27 HTTP/1.1" 200 None
2025-12-03 10:01:52 [manheim.gb] INFO: Scrape type for 2243807: 0
2025-12-03 10:01:52 [manheim.gb] INFO: Found listing with ID: 2252704
2025-12-03 10:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272252704%27 HTTP/1.1" 200 None
2025-12-03 10:01:52 [manheim.gb] INFO: Scrape type for 2252704: 0
2025-12-03 10:01:52 [manheim.gb] INFO: Found listing with ID: 2255216
2025-12-03 10:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272255216%27 HTTP/1.1" 200 None
2025-12-03 10:01:52 [manheim.gb] INFO: Scrape type for 2255216: 0
2025-12-03 10:01:52 [manheim.gb] INFO: Found listing with ID: 2255783
2025-12-03 10:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272255783%27 HTTP/1.1" 200 None
2025-12-03 10:01:52 [manheim.gb] INFO: Scrape type for 2255783: 0
2025-12-03 10:01:52 [manheim.gb] INFO: Found listing with ID: 2262431
2025-12-03 10:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272262431%27 HTTP/1.1" 200 None
2025-12-03 10:01:52 [manheim.gb] INFO: Scrape type for 2262431: 0
2025-12-03 10:01:52 [manheim.gb] INFO: Found listing with ID: 2286249
2025-12-03 10:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272286249%27 HTTP/1.1" 200 None
2025-12-03 10:01:52 [manheim.gb] INFO: Scrape type for 2286249: 0
2025-12-03 10:01:52 [manheim.gb] INFO: Found listing with ID: 2292927
2025-12-03 10:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272292927%27 HTTP/1.1" 200 None
2025-12-03 10:01:52 [manheim.gb] INFO: Scrape type for 2292927: 0
2025-12-03 10:01:52 [manheim.gb] INFO: Found listing with ID: 2303707
2025-12-03 10:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272303707%27 HTTP/1.1" 200 None
2025-12-03 10:01:52 [manheim.gb] INFO: Scrape type for 2303707: 0
2025-12-03 10:01:52 [manheim.gb] INFO: Found listing with ID: 2316345
2025-12-03 10:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272316345%27 HTTP/1.1" 200 None
2025-12-03 10:01:52 [manheim.gb] INFO: Scrape type for 2316345: 0
2025-12-03 10:01:52 [manheim.gb] INFO: Found listing with ID: 2321815
2025-12-03 10:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272321815%27 HTTP/1.1" 200 None
2025-12-03 10:01:52 [manheim.gb] INFO: Scrape type for 2321815: 0
2025-12-03 10:01:52 [manheim.gb] INFO: Found listing with ID: 2326281
2025-12-03 10:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272326281%27 HTTP/1.1" 200 None
2025-12-03 10:01:52 [manheim.gb] INFO: Scrape type for 2326281: 0
2025-12-03 10:01:52 [manheim.gb] INFO: Found listing with ID: 2330511
2025-12-03 10:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272330511%27 HTTP/1.1" 200 None
2025-12-03 10:01:52 [manheim.gb] INFO: Scrape type for 2330511: 0
2025-12-03 10:01:52 [manheim.gb] INFO: Found listing with ID: 2354571
2025-12-03 10:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272354571%27 HTTP/1.1" 200 None
2025-12-03 10:01:52 [manheim.gb] INFO: Scrape type for 2354571: 0
2025-12-03 10:01:52 [manheim.gb] INFO: Found listing with ID: 2358676
2025-12-03 10:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272358676%27 HTTP/1.1" 200 None
2025-12-03 10:01:52 [manheim.gb] INFO: Scrape type for 2358676: 0
2025-12-03 10:01:52 [manheim.gb] INFO: Found listing with ID: 2359941
2025-12-03 10:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272359941%27 HTTP/1.1" 200 None
2025-12-03 10:01:52 [manheim.gb] INFO: Scrape type for 2359941: 0
2025-12-03 10:01:52 [manheim.gb] INFO: Found listing with ID: 2365471
2025-12-03 10:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272365471%27 HTTP/1.1" 200 None
2025-12-03 10:01:52 [manheim.gb] INFO: Scrape type for 2365471: 0
2025-12-03 10:01:52 [manheim.gb] INFO: Found listing with ID: 2374569
2025-12-03 10:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272374569%27 HTTP/1.1" 200 None
2025-12-03 10:01:52 [manheim.gb] INFO: Scrape type for 2374569: 0
2025-12-03 10:01:52 [manheim.gb] INFO: Found listing with ID: 2378382
2025-12-03 10:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272378382%27 HTTP/1.1" 200 None
2025-12-03 10:01:52 [manheim.gb] INFO: Scrape type for 2378382: 0
2025-12-03 10:01:52 [manheim.gb] INFO: Found listing with ID: 2407950
2025-12-03 10:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272407950%27 HTTP/1.1" 200 None
2025-12-03 10:01:52 [manheim.gb] INFO: Scrape type for 2407950: 0
2025-12-03 10:01:52 [manheim.gb] INFO: Found listing with ID: 2416699
2025-12-03 10:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272416699%27 HTTP/1.1" 200 None
2025-12-03 10:01:52 [manheim.gb] INFO: Scrape type for 2416699: 1
2025-12-03 10:01:52 [manheim.gb] INFO: Found listing with ID: 2437613
2025-12-03 10:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272437613%27 HTTP/1.1" 200 None
2025-12-03 10:01:52 [manheim.gb] INFO: Scrape type for 2437613: 0
2025-12-03 10:01:52 [manheim.gb] INFO: Found listing with ID: 2441700
2025-12-03 10:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272441700%27 HTTP/1.1" 200 None
2025-12-03 10:01:52 [manheim.gb] INFO: Scrape type for 2441700: 0
2025-12-03 10:01:52 [manheim.gb] INFO: Found listing with ID: 2443557
2025-12-03 10:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272443557%27 HTTP/1.1" 200 None
2025-12-03 10:01:52 [manheim.gb] INFO: Scrape type for 2443557: 1
2025-12-03 10:01:53 [scrapy.core.engine] DEBUG: Crawled (404) <GET https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=1995165&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231995165&indx=81> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 10:01:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 10:01:53 [manheim.gb] INFO: Found listing with ID: 2443996
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272443996%27 HTTP/1.1" 200 None
2025-12-03 10:01:53 [manheim.gb] INFO: Scrape type for 2443996: 0
2025-12-03 10:01:53 [manheim.gb] INFO: Found listing with ID: 2456004
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272456004%27 HTTP/1.1" 200 None
2025-12-03 10:01:53 [manheim.gb] INFO: Scrape type for 2456004: 1
2025-12-03 10:01:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 10:01:53 [manheim.gb] INFO: Found listing with ID: 2458076
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272458076%27 HTTP/1.1" 200 None
2025-12-03 10:01:53 [manheim.gb] INFO: Scrape type for 2458076: 0
2025-12-03 10:01:53 [manheim.gb] INFO: Found listing with ID: 2461241
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272461241%27 HTTP/1.1" 200 None
2025-12-03 10:01:53 [manheim.gb] INFO: Scrape type for 2461241: 0
2025-12-03 10:01:53 [manheim.gb] INFO: Found listing with ID: 2492073
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272492073%27 HTTP/1.1" 200 None
2025-12-03 10:01:53 [manheim.gb] INFO: Scrape type for 2492073: 1
2025-12-03 10:01:53 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Ignoring non-200 response
NoneType: None
2025-12-03 10:01:53 [scrapy.core.scraper] ERROR: Spider error processing <GET https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=1995165&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231995165&indx=81> (referer: https://www.manheim.co.uk/search/refine)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1078, in _runCallbacks
    current.result = callback(  # type: ignore[misc]
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 301, in process_spider_exception
    return self._process_spider_exception(response, spider, _failure)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/httperror.py", line 46, in process_spider_input
    raise HttpError(response, "Ignoring non-200 response")
scrapy.spidermiddlewares.httperror.HttpError: Ignoring non-200 response
2025-12-03 10:01:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 10:01:53 [manheim.gb] INFO: Found listing with ID: 2512673
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272512673%27 HTTP/1.1" 200 None
2025-12-03 10:01:53 [manheim.gb] INFO: Scrape type for 2512673: 0
2025-12-03 10:01:53 [manheim.gb] INFO: Found listing with ID: 2528107
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272528107%27 HTTP/1.1" 200 None
2025-12-03 10:01:53 [manheim.gb] INFO: Scrape type for 2528107: 0
2025-12-03 10:01:53 [manheim.gb] INFO: Found listing with ID: 2531448
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272531448%27 HTTP/1.1" 200 None
2025-12-03 10:01:53 [manheim.gb] INFO: Scrape type for 2531448: 0
2025-12-03 10:01:53 [manheim.gb] INFO: Found listing with ID: 2536974
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272536974%27 HTTP/1.1" 200 None
2025-12-03 10:01:53 [manheim.gb] INFO: Scrape type for 2536974: 0
2025-12-03 10:01:53 [manheim.gb] INFO: Found listing with ID: 2542025
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272542025%27 HTTP/1.1" 200 None
2025-12-03 10:01:53 [manheim.gb] INFO: Scrape type for 2542025: 0
2025-12-03 10:01:53 [manheim.gb] INFO: Found listing with ID: 2557325
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272557325%27 HTTP/1.1" 200 None
2025-12-03 10:01:53 [manheim.gb] INFO: Scrape type for 2557325: 0
2025-12-03 10:01:53 [manheim.gb] INFO: Found listing with ID: 2562472
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272562472%27 HTTP/1.1" 200 None
2025-12-03 10:01:53 [manheim.gb] INFO: Scrape type for 2562472: 0
2025-12-03 10:01:53 [manheim.gb] INFO: Found listing with ID: 2565829
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272565829%27 HTTP/1.1" 200 None
2025-12-03 10:01:53 [manheim.gb] INFO: Scrape type for 2565829: 0
2025-12-03 10:01:53 [manheim.gb] INFO: Found listing with ID: 2577653
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272577653%27 HTTP/1.1" 200 None
2025-12-03 10:01:53 [manheim.gb] INFO: Scrape type for 2577653: 0
2025-12-03 10:01:53 [manheim.gb] INFO: Found listing with ID: 2589156
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272589156%27 HTTP/1.1" 200 None
2025-12-03 10:01:53 [manheim.gb] INFO: Scrape type for 2589156: 0
2025-12-03 10:01:53 [manheim.gb] INFO: Found listing with ID: 2590049
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272590049%27 HTTP/1.1" 200 None
2025-12-03 10:01:53 [manheim.gb] INFO: Scrape type for 2590049: 1
2025-12-03 10:01:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 10:01:53 [manheim.gb] INFO: Found listing with ID: 2616439
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272616439%27 HTTP/1.1" 200 None
2025-12-03 10:01:53 [manheim.gb] INFO: Scrape type for 2616439: 0
2025-12-03 10:01:53 [manheim.gb] INFO: Found listing with ID: 2660446
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272660446%27 HTTP/1.1" 200 None
2025-12-03 10:01:53 [manheim.gb] INFO: Scrape type for 2660446: 0
2025-12-03 10:01:53 [manheim.gb] INFO: Found listing with ID: 2664010
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272664010%27 HTTP/1.1" 200 None
2025-12-03 10:01:53 [manheim.gb] INFO: Scrape type for 2664010: 0
2025-12-03 10:01:53 [manheim.gb] INFO: Found listing with ID: 2667513
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272667513%27 HTTP/1.1" 200 None
2025-12-03 10:01:53 [manheim.gb] INFO: Scrape type for 2667513: 0
2025-12-03 10:01:53 [manheim.gb] INFO: Found listing with ID: 2683371
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272683371%27 HTTP/1.1" 200 None
2025-12-03 10:01:53 [manheim.gb] INFO: Scrape type for 2683371: 0
2025-12-03 10:01:53 [manheim.gb] INFO: Found listing with ID: 2688065
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272688065%27 HTTP/1.1" 200 None
2025-12-03 10:01:53 [manheim.gb] INFO: Scrape type for 2688065: 0
2025-12-03 10:01:53 [manheim.gb] INFO: Found listing with ID: 2698793
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272698793%27 HTTP/1.1" 200 None
2025-12-03 10:01:53 [manheim.gb] INFO: Scrape type for 2698793: 0
2025-12-03 10:01:53 [manheim.gb] INFO: Found listing with ID: 269980
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27269980%27 HTTP/1.1" 200 None
2025-12-03 10:01:53 [manheim.gb] INFO: Scrape type for 269980: 1
2025-12-03 10:01:53 [manheim.gb] INFO: Found listing with ID: 2702180
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272702180%27 HTTP/1.1" 200 None
2025-12-03 10:01:53 [manheim.gb] INFO: Scrape type for 2702180: 0
2025-12-03 10:01:53 [manheim.gb] INFO: Found listing with ID: 2702439
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272702439%27 HTTP/1.1" 200 None
2025-12-03 10:01:53 [manheim.gb] INFO: Scrape type for 2702439: 0
2025-12-03 10:01:53 [manheim.gb] INFO: Found listing with ID: 2727315
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272727315%27 HTTP/1.1" 200 None
2025-12-03 10:01:53 [manheim.gb] INFO: Scrape type for 2727315: 0
2025-12-03 10:01:53 [manheim.gb] INFO: Found listing with ID: 2729252
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272729252%27 HTTP/1.1" 200 None
2025-12-03 10:01:53 [manheim.gb] INFO: Scrape type for 2729252: 0
2025-12-03 10:01:53 [manheim.gb] INFO: Found listing with ID: 2752960
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272752960%27 HTTP/1.1" 200 None
2025-12-03 10:01:53 [manheim.gb] INFO: Scrape type for 2752960: 0
2025-12-03 10:01:53 [manheim.gb] INFO: Found listing with ID: 2757523
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272757523%27 HTTP/1.1" 200 None
2025-12-03 10:01:53 [manheim.gb] INFO: Scrape type for 2757523: 0
2025-12-03 10:01:53 [manheim.gb] INFO: Found listing with ID: 2778685
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272778685%27 HTTP/1.1" 200 None
2025-12-03 10:01:53 [manheim.gb] INFO: Scrape type for 2778685: 0
2025-12-03 10:01:53 [manheim.gb] INFO: Found listing with ID: 2803879
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272803879%27 HTTP/1.1" 200 None
2025-12-03 10:01:53 [manheim.gb] INFO: Scrape type for 2803879: 0
2025-12-03 10:01:53 [manheim.gb] INFO: Found listing with ID: 2817812
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272817812%27 HTTP/1.1" 200 None
2025-12-03 10:01:53 [manheim.gb] INFO: Scrape type for 2817812: 0
2025-12-03 10:01:53 [manheim.gb] INFO: Found listing with ID: 2830703
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272830703%27 HTTP/1.1" 200 None
2025-12-03 10:01:53 [manheim.gb] INFO: Scrape type for 2830703: 0
2025-12-03 10:01:53 [manheim.gb] INFO: Found listing with ID: 2837848
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272837848%27 HTTP/1.1" 200 None
2025-12-03 10:01:53 [manheim.gb] INFO: Scrape type for 2837848: 0
2025-12-03 10:01:53 [manheim.gb] INFO: Found listing with ID: 2871207
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272871207%27 HTTP/1.1" 200 None
2025-12-03 10:01:53 [manheim.gb] INFO: Scrape type for 2871207: 0
2025-12-03 10:01:53 [manheim.gb] INFO: Found listing with ID: 2876443
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272876443%27 HTTP/1.1" 200 None
2025-12-03 10:01:53 [manheim.gb] INFO: Scrape type for 2876443: 0
2025-12-03 10:01:53 [manheim.gb] INFO: Found listing with ID: 2891297
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272891297%27 HTTP/1.1" 200 None
2025-12-03 10:01:53 [manheim.gb] INFO: Scrape type for 2891297: 0
2025-12-03 10:01:53 [manheim.gb] INFO: Found listing with ID: 2893691
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272893691%27 HTTP/1.1" 200 None
2025-12-03 10:01:53 [manheim.gb] INFO: Scrape type for 2893691: 0
2025-12-03 10:01:53 [manheim.gb] INFO: Found listing with ID: 2896151
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272896151%27 HTTP/1.1" 200 None
2025-12-03 10:01:53 [manheim.gb] INFO: Scrape type for 2896151: 0
2025-12-03 10:01:53 [manheim.gb] INFO: Found listing with ID: 2907665
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272907665%27 HTTP/1.1" 200 None
2025-12-03 10:01:53 [manheim.gb] INFO: Scrape type for 2907665: 0
2025-12-03 10:01:53 [manheim.gb] INFO: Found listing with ID: 2933109
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272933109%27 HTTP/1.1" 200 None
2025-12-03 10:01:53 [manheim.gb] INFO: Scrape type for 2933109: 0
2025-12-03 10:01:53 [manheim.gb] INFO: Found listing with ID: 2936956
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272936956%27 HTTP/1.1" 200 None
2025-12-03 10:01:53 [manheim.gb] INFO: Scrape type for 2936956: 0
2025-12-03 10:01:53 [manheim.gb] INFO: Found listing with ID: 2939815
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272939815%27 HTTP/1.1" 200 None
2025-12-03 10:01:53 [manheim.gb] INFO: Scrape type for 2939815: 0
2025-12-03 10:01:53 [manheim.gb] INFO: Found listing with ID: 2944079
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272944079%27 HTTP/1.1" 200 None
2025-12-03 10:01:53 [manheim.gb] INFO: Scrape type for 2944079: 0
2025-12-03 10:01:53 [manheim.gb] INFO: Found listing with ID: 2948457
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272948457%27 HTTP/1.1" 200 None
2025-12-03 10:01:53 [manheim.gb] INFO: Scrape type for 2948457: 0
2025-12-03 10:01:53 [manheim.gb] INFO: Found listing with ID: 2951063
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272951063%27 HTTP/1.1" 200 None
2025-12-03 10:01:53 [manheim.gb] INFO: Scrape type for 2951063: 0
2025-12-03 10:01:53 [manheim.gb] INFO: Found listing with ID: 2956148
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272956148%27 HTTP/1.1" 200 None
2025-12-03 10:01:53 [manheim.gb] INFO: Scrape type for 2956148: 0
2025-12-03 10:01:53 [manheim.gb] INFO: Found listing with ID: 2968609
2025-12-03 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272968609%27 HTTP/1.1" 200 None
2025-12-03 10:01:54 [manheim.gb] INFO: Scrape type for 2968609: 0
2025-12-03 10:01:54 [manheim.gb] INFO: Found listing with ID: 2976938
2025-12-03 10:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272976938%27 HTTP/1.1" 200 None
2025-12-03 10:01:54 [manheim.gb] INFO: Scrape type for 2976938: 1
2025-12-03 10:01:54 [manheim.gb] INFO: Found listing with ID: 3004217
2025-12-03 10:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273004217%27 HTTP/1.1" 200 None
2025-12-03 10:01:54 [manheim.gb] INFO: Scrape type for 3004217: 1
2025-12-03 10:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/JEEP/COMPASS?id=2044428&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232044428&indx=84> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 10:01:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 10:01:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ddd3c60-4b9c-535b-8351-04bf048bca18 with identifier: 2044428
2025-12-03 10:01:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ddd3c60-4b9c-535b-8351-04bf048bca18 with scrape type 2
2025-12-03 10:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ddd3c60-4b9c-535b-8351-04bf048bca18 with scrape type 2
2025-12-03 10:01:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 8ddd3c60-4b9c-535b-8351-04bf048bca18, identifier: 2044428
2025-12-03 10:01:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 8ddd3c60-4b9c-535b-8351-04bf048bca18 with identifier: 2044428
2025-12-03 10:01:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 8ddd3c60-4b9c-535b-8351-04bf048bca18 with identifier: 2044428
2025-12-03 10:01:54 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 8ddd3c60-4b9c-535b-8351-04bf048bca18 with identifier: 2044428 to the API
2025-12-03 10:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 10:01:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 10:01:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/JEEP/COMPASS?id=2044428&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232044428&indx=84>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002044428-01986796-003.pdf',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '1.4L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '8ddd3c60-4b9c-535b-8351-04bf048bca18',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'CY18UDX',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/JEEP/COMPASS?id=2044428',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'JEEP',
 'model': 'COMPASS',
 'odometer': 68336,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-22',
 'seller_name': 'FCA Group',
 'title': 'JEEP COMPASS 1.4 Multiair 140 Longitude 5dr [2WD]',
 'transmission': 'manual',
 'trim': '1.4 Multiair 140 Longitude 5dr [2WD]',
 'year': 2018}
2025-12-03 10:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272044428%27 HTTP/1.1" 200 None
2025-12-03 10:01:54 [manheim.gb] INFO: Saving data for 2044428: {'auction_closing_time': 1765184400.0, 'created_time': 1764662651.491045, 'last_price_update_time': 1764756114.746843}
2025-12-03 10:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2044428') HTTP/1.1" 204 0
2025-12-03 10:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/NISSAN/JUKE?id=2014140&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232014140&indx=82> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 10:01:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 10:01:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2712f63-9d5d-5b54-8849-3e91022144b6 with identifier: 2014140
2025-12-03 10:01:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2712f63-9d5d-5b54-8849-3e91022144b6 with scrape type 2
2025-12-03 10:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f2712f63-9d5d-5b54-8849-3e91022144b6 with scrape type 2
2025-12-03 10:01:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: f2712f63-9d5d-5b54-8849-3e91022144b6, identifier: 2014140
2025-12-03 10:01:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: f2712f63-9d5d-5b54-8849-3e91022144b6 with identifier: 2014140
2025-12-03 10:01:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: f2712f63-9d5d-5b54-8849-3e91022144b6 with identifier: 2014140
2025-12-03 10:01:58 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: f2712f63-9d5d-5b54-8849-3e91022144b6 with identifier: 2014140 to the API
2025-12-03 10:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 10:01:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 10:01:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/NISSAN/JUKE?id=2014140&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232014140&indx=82>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002014140-01982404-003.pdf',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '1.5L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'f2712f63-9d5d-5b54-8849-3e91022144b6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'CE16WYR',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/NISSAN/JUKE?id=2014140',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'NISSAN',
 'model': 'JUKE',
 'odometer': 71203,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-26',
 'seller_name': 'Stellantis & You',
 'title': 'NISSAN JUKE 1.5 dCi Acenta 5dr',
 'transmission': 'manual',
 'trim': '1.5 dCi Acenta 5dr',
 'year': 2016}
2025-12-03 10:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272014140%27 HTTP/1.1" 200 None
2025-12-03 10:01:58 [manheim.gb] INFO: Saving data for 2014140: {'auction_closing_time': 1764838800.0, 'created_time': 1764662590.23373, 'last_price_update_time': 1764756118.696736}
2025-12-03 10:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2014140') HTTP/1.1" 204 0
2025-12-03 10:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/GOLF?id=2058572&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232058572&indx=86> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 10:02:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 10:02:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2876842-745d-59e6-b4ec-f2a23163a614 with identifier: 2058572
2025-12-03 10:02:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2876842-745d-59e6-b4ec-f2a23163a614 with scrape type 2
2025-12-03 10:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f2876842-745d-59e6-b4ec-f2a23163a614 with scrape type 2
2025-12-03 10:02:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: f2876842-745d-59e6-b4ec-f2a23163a614, identifier: 2058572
2025-12-03 10:02:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: f2876842-745d-59e6-b4ec-f2a23163a614 with identifier: 2058572
2025-12-03 10:02:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: f2876842-745d-59e6-b4ec-f2a23163a614 with identifier: 2058572
2025-12-03 10:02:15 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: f2876842-745d-59e6-b4ec-f2a23163a614 with identifier: 2058572 to the API
2025-12-03 10:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 10:02:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 10:02:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/GOLF?id=2058572&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232058572&indx=86>
{'auction_title': '',
 'c_o_2_emission_value': 163,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002058572-01614192-001.pdf',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': '2025-12-10T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'f2876842-745d-59e6-b4ec-f2a23163a614',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'VA17FZV',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/GOLF?id=2058572',
 'listing': 'auction',
 'location': 'Leeds',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF',
 'odometer': 63555,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-23',
 'seller_name': 'FCA Group',
 'title': 'VOLKSWAGEN GOLF 2.0 TSI 310 R 5dr 4MOTION DSG',
 'transmission': 'automatic',
 'trim': '2.0 TSI 310 R 5dr 4MOTION DSG',
 'year': 2017}
2025-12-03 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272058572%27 HTTP/1.1" 200 None
2025-12-03 10:02:15 [manheim.gb] INFO: Saving data for 2058572: {'auction_closing_time': 1765357200.0, 'created_time': 1764662596.823069, 'last_price_update_time': 1764756135.310131}
2025-12-03 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2058572') HTTP/1.1" 204 0
2025-12-03 10:02:15 [scrapy.extensions.logstats] INFO: Crawled 20 pages (at 18 pages/min), scraped 4 items (at 4 items/min)
2025-12-03 10:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/LAND%20ROVER/FREELANDER?id=2416699&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232416699&indx=131> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 10:02:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 10:02:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3be68c4d-e2c9-554b-a455-fb6bef1ee29d with identifier: 2416699
2025-12-03 10:02:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3be68c4d-e2c9-554b-a455-fb6bef1ee29d with scrape type 1
2025-12-03 10:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 3be68c4d-e2c9-554b-a455-fb6bef1ee29d
2025-12-03 10:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc5b188d8-c1cf-4de1-9d39-75495263ecc8_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c5b188d8-c1cf-4de1-9d39-75495263ecc8_ext_7.jpg not downloaded yet
2025-12-03 10:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc5b188d8-c1cf-4de1-9d39-75495263ecc8_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c5b188d8-c1cf-4de1-9d39-75495263ecc8_ext_7.jpg not downloaded yet
2025-12-03 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc5b188d8-c1cf-4de1-9d39-75495263ecc8_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c5b188d8-c1cf-4de1-9d39-75495263ecc8_ext_6.jpg not downloaded yet
2025-12-03 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc5b188d8-c1cf-4de1-9d39-75495263ecc8_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c5b188d8-c1cf-4de1-9d39-75495263ecc8_ext_1.jpg not downloaded yet
2025-12-03 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc5b188d8-c1cf-4de1-9d39-75495263ecc8_5.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c5b188d8-c1cf-4de1-9d39-75495263ecc8_5.jpg not downloaded yet
2025-12-03 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc5b188d8-c1cf-4de1-9d39-75495263ecc8_4.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c5b188d8-c1cf-4de1-9d39-75495263ecc8_4.jpg not downloaded yet
2025-12-03 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc5b188d8-c1cf-4de1-9d39-75495263ecc8_11.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c5b188d8-c1cf-4de1-9d39-75495263ecc8_11.jpg not downloaded yet
2025-12-03 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc5b188d8-c1cf-4de1-9d39-75495263ecc8_10.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c5b188d8-c1cf-4de1-9d39-75495263ecc8_10.jpg not downloaded yet
2025-12-03 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc5b188d8-c1cf-4de1-9d39-75495263ecc8_9.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c5b188d8-c1cf-4de1-9d39-75495263ecc8_9.jpg not downloaded yet
2025-12-03 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc5b188d8-c1cf-4de1-9d39-75495263ecc8_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c5b188d8-c1cf-4de1-9d39-75495263ecc8_ext_2.jpg not downloaded yet
2025-12-03 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc5b188d8-c1cf-4de1-9d39-75495263ecc8_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c5b188d8-c1cf-4de1-9d39-75495263ecc8_ext_5.jpg not downloaded yet
2025-12-03 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc5b188d8-c1cf-4de1-9d39-75495263ecc8_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c5b188d8-c1cf-4de1-9d39-75495263ecc8_ext_3.jpg not downloaded yet
2025-12-03 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc5b188d8-c1cf-4de1-9d39-75495263ecc8_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c5b188d8-c1cf-4de1-9d39-75495263ecc8_ext_4.jpg not downloaded yet
2025-12-03 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2416699-4006031-13.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2416699-4006031-13.jpg not downloaded yet
2025-12-03 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2416699-4006031-1000.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2416699-4006031-1000.jpg not downloaded yet
2025-12-03 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2416699-4006031-1001.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2416699-4006031-1001.jpg not downloaded yet
2025-12-03 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2416699-4006031-1002.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2416699-4006031-1002.jpg not downloaded yet
2025-12-03 10:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c5b188d8-c1cf-4de1-9d39-75495263ecc8_ext_7.jpg> (referer: None)
2025-12-03 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2416699-4006031-1003.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2416699-4006031-1003.jpg not downloaded yet
2025-12-03 10:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c5b188d8-c1cf-4de1-9d39-75495263ecc8_ext_7.jpg> (referer: None)
2025-12-03 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2416699-4006031-1004.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2416699-4006031-1004.jpg not downloaded yet
2025-12-03 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2416699-4006031-1005.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2416699-4006031-1005.jpg not downloaded yet
2025-12-03 10:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c5b188d8-c1cf-4de1-9d39-75495263ecc8_ext_6.jpg> (referer: None)
2025-12-03 10:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c5b188d8-c1cf-4de1-9d39-75495263ecc8_ext_1.jpg> (referer: None)
2025-12-03 10:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c5b188d8-c1cf-4de1-9d39-75495263ecc8_5.jpg> (referer: None)
2025-12-03 10:02:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa276fd04d0>
2025-12-03 10:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 10:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3be68c4d-e2c9-554b-a455-fb6bef1ee29d/3be68c4d-e2c9-554b-a455-fb6bef1ee29d_image_0.jpg HTTP/1.1" 201 0
2025-12-03 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc5b188d8-c1cf-4de1-9d39-75495263ecc8_ext_7.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c5b188d8-c1cf-4de1-9d39-75495263ecc8_ext_7.jpg saved to cache
2025-12-03 10:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3be68c4d-e2c9-554b-a455-fb6bef1ee29d
2025-12-03 10:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2416699-4006031-1001.jpg> (referer: None)
2025-12-03 10:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2416699-4006031-1005.jpg> (referer: None)
2025-12-03 10:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2416699-4006031-1002.jpg> (referer: None)
2025-12-03 10:02:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa27722bfd0>
2025-12-03 10:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 10:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3be68c4d-e2c9-554b-a455-fb6bef1ee29d/3be68c4d-e2c9-554b-a455-fb6bef1ee29d_image_1.jpg HTTP/1.1" 201 0
2025-12-03 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc5b188d8-c1cf-4de1-9d39-75495263ecc8_ext_7.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c5b188d8-c1cf-4de1-9d39-75495263ecc8_ext_7.jpg saved to cache
2025-12-03 10:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3be68c4d-e2c9-554b-a455-fb6bef1ee29d
2025-12-03 10:02:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa27732d910>
2025-12-03 10:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 10:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3be68c4d-e2c9-554b-a455-fb6bef1ee29d/3be68c4d-e2c9-554b-a455-fb6bef1ee29d_image_2.jpg HTTP/1.1" 201 0
2025-12-03 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc5b188d8-c1cf-4de1-9d39-75495263ecc8_ext_6.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c5b188d8-c1cf-4de1-9d39-75495263ecc8_ext_6.jpg saved to cache
2025-12-03 10:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3be68c4d-e2c9-554b-a455-fb6bef1ee29d
2025-12-03 10:02:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa27738fed0>
2025-12-03 10:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 10:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3be68c4d-e2c9-554b-a455-fb6bef1ee29d/3be68c4d-e2c9-554b-a455-fb6bef1ee29d_image_3.jpg HTTP/1.1" 201 0
2025-12-03 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc5b188d8-c1cf-4de1-9d39-75495263ecc8_ext_1.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c5b188d8-c1cf-4de1-9d39-75495263ecc8_ext_1.jpg saved to cache
2025-12-03 10:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3be68c4d-e2c9-554b-a455-fb6bef1ee29d
2025-12-03 10:02:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa27731ea10>
2025-12-03 10:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 10:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3be68c4d-e2c9-554b-a455-fb6bef1ee29d/3be68c4d-e2c9-554b-a455-fb6bef1ee29d_image_4.jpg HTTP/1.1" 201 0
2025-12-03 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc5b188d8-c1cf-4de1-9d39-75495263ecc8_5.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c5b188d8-c1cf-4de1-9d39-75495263ecc8_5.jpg saved to cache
2025-12-03 10:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3be68c4d-e2c9-554b-a455-fb6bef1ee29d
2025-12-03 10:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2416699-4006031-1003.jpg> (referer: None)
2025-12-03 10:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c5b188d8-c1cf-4de1-9d39-75495263ecc8_11.jpg> (referer: None)
2025-12-03 10:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c5b188d8-c1cf-4de1-9d39-75495263ecc8_4.jpg> (referer: None)
2025-12-03 10:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2416699-4006031-1004.jpg> (referer: None)
2025-12-03 10:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/KIA/PICANTO?id=2057516&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232057516&indx=85> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 10:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/FORD/FOCUS?id=2456004&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232456004&indx=137> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 10:02:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 10:02:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa2771c5810>
2025-12-03 10:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 10:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3be68c4d-e2c9-554b-a455-fb6bef1ee29d/3be68c4d-e2c9-554b-a455-fb6bef1ee29d_image_15.jpg HTTP/1.1" 201 0
2025-12-03 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2416699-4006031-1001.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2416699-4006031-1001.jpg saved to cache
2025-12-03 10:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 3be68c4d-e2c9-554b-a455-fb6bef1ee29d
2025-12-03 10:02:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa27725d150>
2025-12-03 10:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 10:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3be68c4d-e2c9-554b-a455-fb6bef1ee29d/3be68c4d-e2c9-554b-a455-fb6bef1ee29d_image_19.jpg HTTP/1.1" 201 0
2025-12-03 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2416699-4006031-1005.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2416699-4006031-1005.jpg saved to cache
2025-12-03 10:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 3be68c4d-e2c9-554b-a455-fb6bef1ee29d
2025-12-03 10:02:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa277254410>
2025-12-03 10:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 10:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3be68c4d-e2c9-554b-a455-fb6bef1ee29d/3be68c4d-e2c9-554b-a455-fb6bef1ee29d_image_16.jpg HTTP/1.1" 201 0
2025-12-03 10:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2416699-4006031-1002.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2416699-4006031-1002.jpg saved to cache
2025-12-03 10:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 3be68c4d-e2c9-554b-a455-fb6bef1ee29d
2025-12-03 10:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/MINI/HATCHBACK?id=2492073&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232492073&indx=140> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 10:02:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa277363fd0>
2025-12-03 10:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 10:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3be68c4d-e2c9-554b-a455-fb6bef1ee29d/3be68c4d-e2c9-554b-a455-fb6bef1ee29d_image_17.jpg HTTP/1.1" 201 0
2025-12-03 10:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2416699-4006031-1003.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2416699-4006031-1003.jpg saved to cache
2025-12-03 10:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 3be68c4d-e2c9-554b-a455-fb6bef1ee29d
2025-12-03 10:02:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa276f16890>
2025-12-03 10:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 10:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3be68c4d-e2c9-554b-a455-fb6bef1ee29d/3be68c4d-e2c9-554b-a455-fb6bef1ee29d_image_6.jpg HTTP/1.1" 201 0
2025-12-03 10:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc5b188d8-c1cf-4de1-9d39-75495263ecc8_11.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c5b188d8-c1cf-4de1-9d39-75495263ecc8_11.jpg saved to cache
2025-12-03 10:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3be68c4d-e2c9-554b-a455-fb6bef1ee29d
2025-12-03 10:02:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa2761c0690>
2025-12-03 10:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 10:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3be68c4d-e2c9-554b-a455-fb6bef1ee29d/3be68c4d-e2c9-554b-a455-fb6bef1ee29d_image_5.jpg HTTP/1.1" 201 0
2025-12-03 10:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc5b188d8-c1cf-4de1-9d39-75495263ecc8_4.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c5b188d8-c1cf-4de1-9d39-75495263ecc8_4.jpg saved to cache
2025-12-03 10:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3be68c4d-e2c9-554b-a455-fb6bef1ee29d
2025-12-03 10:02:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa2770b6510>
2025-12-03 10:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 10:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3be68c4d-e2c9-554b-a455-fb6bef1ee29d/3be68c4d-e2c9-554b-a455-fb6bef1ee29d_image_18.jpg HTTP/1.1" 201 0
2025-12-03 10:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2416699-4006031-1004.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2416699-4006031-1004.jpg saved to cache
2025-12-03 10:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 3be68c4d-e2c9-554b-a455-fb6bef1ee29d
2025-12-03 10:02:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be58e6f6-2608-5d15-be6a-b49e5f011661 with identifier: 2057516
2025-12-03 10:02:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be58e6f6-2608-5d15-be6a-b49e5f011661 with scrape type 2
2025-12-03 10:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be58e6f6-2608-5d15-be6a-b49e5f011661 with scrape type 2
2025-12-03 10:02:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: be58e6f6-2608-5d15-be6a-b49e5f011661, identifier: 2057516
2025-12-03 10:02:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b53128c4-e05d-54e6-a7ad-dd80dd9160fe with identifier: 2456004
2025-12-03 10:02:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b53128c4-e05d-54e6-a7ad-dd80dd9160fe with scrape type 1
2025-12-03 10:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item b53128c4-e05d-54e6-a7ad-dd80dd9160fe
2025-12-03 10:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd94f615f-d952-4208-a39a-3db272fcb48f_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d94f615f-d952-4208-a39a-3db272fcb48f_ext_6.jpg not downloaded yet
2025-12-03 10:02:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: be58e6f6-2608-5d15-be6a-b49e5f011661 with identifier: 2057516
2025-12-03 10:02:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: be58e6f6-2608-5d15-be6a-b49e5f011661 with identifier: 2057516
2025-12-03 10:02:23 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: be58e6f6-2608-5d15-be6a-b49e5f011661 with identifier: 2057516 to the API
2025-12-03 10:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 10:02:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 10:02:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/KIA/PICANTO?id=2057516&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232057516&indx=85>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002057516-01987882-002.pdf',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.0L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'be58e6f6-2608-5d15-be6a-b49e5f011661',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'MA66AVZ',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/KIA/PICANTO?id=2057516',
 'listing': 'auction',
 'location': 'Leeds',
 'make': 'KIA',
 'model': 'PICANTO',
 'odometer': 18176,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-12',
 'seller_name': 'Big Motoring World Ltd',
 'title': 'KIA PICANTO 1.0 65 SE 5dr',
 'transmission': 'manual',
 'trim': '1.0 65 SE 5dr',
 'year': 2016}
2025-12-03 10:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272057516%27 HTTP/1.1" 200 None
2025-12-03 10:02:23 [manheim.gb] INFO: Saving data for 2057516: {'auction_closing_time': 1765184400.0, 'created_time': 1764662593.645106, 'last_price_update_time': 1764756143.311865}
2025-12-03 10:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2057516') HTTP/1.1" 204 0
2025-12-03 10:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c5b188d8-c1cf-4de1-9d39-75495263ecc8_ext_5.jpg> (referer: None)
2025-12-03 10:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2416699-4006031-13.jpg> (referer: None)
2025-12-03 10:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c5b188d8-c1cf-4de1-9d39-75495263ecc8_ext_2.jpg> (referer: None)
2025-12-03 10:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c5b188d8-c1cf-4de1-9d39-75495263ecc8_ext_3.jpg> (referer: None)
2025-12-03 10:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Foriginal%252Fd94f615f-d952-4208-a39a-3db272fcb48f_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/original/d94f615f-d952-4208-a39a-3db272fcb48f_ext_7.jpg not downloaded yet
2025-12-03 10:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c5b188d8-c1cf-4de1-9d39-75495263ecc8_ext_4.jpg> (referer: None)
2025-12-03 10:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2416699-4006031-1000.jpg> (referer: None)
2025-12-03 10:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd94f615f-d952-4208-a39a-3db272fcb48f_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d94f615f-d952-4208-a39a-3db272fcb48f_ext_1.jpg not downloaded yet
2025-12-03 10:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c5b188d8-c1cf-4de1-9d39-75495263ecc8_9.jpg> (referer: None)
2025-12-03 10:02:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ce25d2b-dcfb-56ac-81f0-cbc5540866a4 with identifier: 2492073
2025-12-03 10:02:23 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 8ce25d2b-dcfb-56ac-81f0-cbc5540866a4
2025-12-03 10:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd94f615f-d952-4208-a39a-3db272fcb48f_5.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d94f615f-d952-4208-a39a-3db272fcb48f_5.jpg not downloaded yet
2025-12-03 10:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd94f615f-d952-4208-a39a-3db272fcb48f_4.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d94f615f-d952-4208-a39a-3db272fcb48f_4.jpg not downloaded yet
2025-12-03 10:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd94f615f-d952-4208-a39a-3db272fcb48f_11.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d94f615f-d952-4208-a39a-3db272fcb48f_11.jpg not downloaded yet
2025-12-03 10:02:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa27724b250>
2025-12-03 10:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 10:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3be68c4d-e2c9-554b-a455-fb6bef1ee29d/3be68c4d-e2c9-554b-a455-fb6bef1ee29d_image_10.jpg HTTP/1.1" 201 0
2025-12-03 10:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc5b188d8-c1cf-4de1-9d39-75495263ecc8_ext_5.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c5b188d8-c1cf-4de1-9d39-75495263ecc8_ext_5.jpg saved to cache
2025-12-03 10:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 3be68c4d-e2c9-554b-a455-fb6bef1ee29d
2025-12-03 10:02:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa277025f50>
2025-12-03 10:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 10:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3be68c4d-e2c9-554b-a455-fb6bef1ee29d/3be68c4d-e2c9-554b-a455-fb6bef1ee29d_image_13.jpg HTTP/1.1" 201 0
2025-12-03 10:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2416699-4006031-13.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2416699-4006031-13.jpg saved to cache
2025-12-03 10:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 3be68c4d-e2c9-554b-a455-fb6bef1ee29d
2025-12-03 10:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd94f615f-d952-4208-a39a-3db272fcb48f_10.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d94f615f-d952-4208-a39a-3db272fcb48f_10.jpg not downloaded yet
2025-12-03 10:02:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa2761be5d0>
2025-12-03 10:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 10:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3be68c4d-e2c9-554b-a455-fb6bef1ee29d/3be68c4d-e2c9-554b-a455-fb6bef1ee29d_image_9.jpg HTTP/1.1" 201 0
2025-12-03 10:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc5b188d8-c1cf-4de1-9d39-75495263ecc8_ext_2.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c5b188d8-c1cf-4de1-9d39-75495263ecc8_ext_2.jpg saved to cache
2025-12-03 10:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3be68c4d-e2c9-554b-a455-fb6bef1ee29d
2025-12-03 10:02:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa2773447d0>
2025-12-03 10:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 10:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3be68c4d-e2c9-554b-a455-fb6bef1ee29d/3be68c4d-e2c9-554b-a455-fb6bef1ee29d_image_11.jpg HTTP/1.1" 201 0
2025-12-03 10:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc5b188d8-c1cf-4de1-9d39-75495263ecc8_ext_3.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c5b188d8-c1cf-4de1-9d39-75495263ecc8_ext_3.jpg saved to cache
2025-12-03 10:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 3be68c4d-e2c9-554b-a455-fb6bef1ee29d
2025-12-03 10:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d94f615f-d952-4208-a39a-3db272fcb48f_ext_1.jpg> (referer: None)
2025-12-03 10:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d94f615f-d952-4208-a39a-3db272fcb48f_ext_6.jpg> (referer: None)
2025-12-03 10:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d94f615f-d952-4208-a39a-3db272fcb48f_5.jpg> (referer: None)
2025-12-03 10:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd94f615f-d952-4208-a39a-3db272fcb48f_9.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d94f615f-d952-4208-a39a-3db272fcb48f_9.jpg not downloaded yet
2025-12-03 10:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/c5b188d8-c1cf-4de1-9d39-75495263ecc8_10.jpg> (referer: None)
2025-12-03 10:02:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa2770e6450>
2025-12-03 10:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 10:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3be68c4d-e2c9-554b-a455-fb6bef1ee29d/3be68c4d-e2c9-554b-a455-fb6bef1ee29d_image_12.jpg HTTP/1.1" 201 0
2025-12-03 10:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc5b188d8-c1cf-4de1-9d39-75495263ecc8_ext_4.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c5b188d8-c1cf-4de1-9d39-75495263ecc8_ext_4.jpg saved to cache
2025-12-03 10:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 3be68c4d-e2c9-554b-a455-fb6bef1ee29d
2025-12-03 10:02:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa276f90f10>
2025-12-03 10:02:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 10:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3be68c4d-e2c9-554b-a455-fb6bef1ee29d/3be68c4d-e2c9-554b-a455-fb6bef1ee29d_image_14.jpg HTTP/1.1" 201 0
2025-12-03 10:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2416699-4006031-1000.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2416699-4006031-1000.jpg saved to cache
2025-12-03 10:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 3be68c4d-e2c9-554b-a455-fb6bef1ee29d
2025-12-03 10:02:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa277027310>
2025-12-03 10:02:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 10:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3be68c4d-e2c9-554b-a455-fb6bef1ee29d/3be68c4d-e2c9-554b-a455-fb6bef1ee29d_image_8.jpg HTTP/1.1" 201 0
2025-12-03 10:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc5b188d8-c1cf-4de1-9d39-75495263ecc8_9.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c5b188d8-c1cf-4de1-9d39-75495263ecc8_9.jpg saved to cache
2025-12-03 10:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3be68c4d-e2c9-554b-a455-fb6bef1ee29d
2025-12-03 10:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d94f615f-d952-4208-a39a-3db272fcb48f_4.jpg> (referer: None)
2025-12-03 10:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd94f615f-d952-4208-a39a-3db272fcb48f_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d94f615f-d952-4208-a39a-3db272fcb48f_ext_2.jpg not downloaded yet
2025-12-03 10:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/ACLASS?id=2443557&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232443557&indx=134> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 10:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd94f615f-d952-4208-a39a-3db272fcb48f_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d94f615f-d952-4208-a39a-3db272fcb48f_ext_5.jpg not downloaded yet
2025-12-03 10:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/refine> (referer: https://www.manheim.co.uk/search) ['zyte-api']
2025-12-03 10:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/PASSATCC?id=269980&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%23269980&indx=167> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 10:02:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa275812010>
2025-12-03 10:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 10:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b53128c4-e05d-54e6-a7ad-dd80dd9160fe/b53128c4-e05d-54e6-a7ad-dd80dd9160fe_image_2.jpg HTTP/1.1" 201 0
2025-12-03 10:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd94f615f-d952-4208-a39a-3db272fcb48f_ext_1.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d94f615f-d952-4208-a39a-3db272fcb48f_ext_1.jpg saved to cache
2025-12-03 10:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b53128c4-e05d-54e6-a7ad-dd80dd9160fe
2025-12-03 10:02:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa2771c6490>
2025-12-03 10:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 10:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b53128c4-e05d-54e6-a7ad-dd80dd9160fe/b53128c4-e05d-54e6-a7ad-dd80dd9160fe_image_0.jpg HTTP/1.1" 201 0
2025-12-03 10:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd94f615f-d952-4208-a39a-3db272fcb48f_ext_6.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d94f615f-d952-4208-a39a-3db272fcb48f_ext_6.jpg saved to cache
2025-12-03 10:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b53128c4-e05d-54e6-a7ad-dd80dd9160fe
2025-12-03 10:02:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa275803fd0>
2025-12-03 10:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 10:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b53128c4-e05d-54e6-a7ad-dd80dd9160fe/b53128c4-e05d-54e6-a7ad-dd80dd9160fe_image_3.jpg HTTP/1.1" 201 0
2025-12-03 10:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd94f615f-d952-4208-a39a-3db272fcb48f_5.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d94f615f-d952-4208-a39a-3db272fcb48f_5.jpg saved to cache
2025-12-03 10:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b53128c4-e05d-54e6-a7ad-dd80dd9160fe
2025-12-03 10:02:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa27703ca10>
2025-12-03 10:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 10:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3be68c4d-e2c9-554b-a455-fb6bef1ee29d/3be68c4d-e2c9-554b-a455-fb6bef1ee29d_image_7.jpg HTTP/1.1" 201 0
2025-12-03 10:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fc5b188d8-c1cf-4de1-9d39-75495263ecc8_10.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/c5b188d8-c1cf-4de1-9d39-75495263ecc8_10.jpg saved to cache
2025-12-03 10:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3be68c4d-e2c9-554b-a455-fb6bef1ee29d
2025-12-03 10:02:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3be68c4d-e2c9-554b-a455-fb6bef1ee29d, skipping ID generation
2025-12-03 10:02:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3be68c4d-e2c9-554b-a455-fb6bef1ee29d with scrape type 1
2025-12-03 10:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 3be68c4d-e2c9-554b-a455-fb6bef1ee29d from tracking dictionaries
2025-12-03 10:02:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3be68c4d-e2c9-554b-a455-fb6bef1ee29d sending to next pipeline
2025-12-03 10:02:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 3be68c4d-e2c9-554b-a455-fb6bef1ee29d, identifier: 2416699
2025-12-03 10:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d94f615f-d952-4208-a39a-3db272fcb48f_11.jpg> (referer: None)
2025-12-03 10:02:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 3be68c4d-e2c9-554b-a455-fb6bef1ee29d with identifier: 2416699
2025-12-03 10:02:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 3be68c4d-e2c9-554b-a455-fb6bef1ee29d with identifier: 2416699
2025-12-03 10:02:27 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 193914 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    193914
2025-12-03 10:02:27 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 3be68c4d-e2c9-554b-a455-fb6bef1ee29d spider: manheim.gb
2025-12-03 10:02:27 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 3be68c4d-e2c9-554b-a455-fb6bef1ee29d due to rule: high_mileage_for_country.json, error: 193914 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    193914
{'auction_title': '',
 'c_o_2_emission_value': 179,
 'car_expert_report_source_url': None,
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '2.2L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '3be68c4d-e2c9-554b-a455-fb6bef1ee29d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'SJ10TZE',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/LAND%20ROVER/FREELANDER?id=2416699',
 'listing': 'auction',
 'location': 'Leeds',
 'make': 'LAND ROVER',
 'model': 'FREELANDER',
 'odometer': 120493,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 26,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3be68c4d-e2c9-554b-a455-fb6bef1ee29d/3be68c4d-e2c9-554b-a455-fb6bef1ee29d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 214550,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c5b188d8-c1cf-4de1-9d39-75495263ecc8_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3be68c4d-e2c9-554b-a455-fb6bef1ee29d/3be68c4d-e2c9-554b-a455-fb6bef1ee29d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 214550,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c5b188d8-c1cf-4de1-9d39-75495263ecc8_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3be68c4d-e2c9-554b-a455-fb6bef1ee29d/3be68c4d-e2c9-554b-a455-fb6bef1ee29d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 228331,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c5b188d8-c1cf-4de1-9d39-75495263ecc8_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3be68c4d-e2c9-554b-a455-fb6bef1ee29d/3be68c4d-e2c9-554b-a455-fb6bef1ee29d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 191860,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c5b188d8-c1cf-4de1-9d39-75495263ecc8_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3be68c4d-e2c9-554b-a455-fb6bef1ee29d/3be68c4d-e2c9-554b-a455-fb6bef1ee29d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 208982,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c5b188d8-c1cf-4de1-9d39-75495263ecc8_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3be68c4d-e2c9-554b-a455-fb6bef1ee29d/3be68c4d-e2c9-554b-a455-fb6bef1ee29d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 215246,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c5b188d8-c1cf-4de1-9d39-75495263ecc8_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3be68c4d-e2c9-554b-a455-fb6bef1ee29d/3be68c4d-e2c9-554b-a455-fb6bef1ee29d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 195879,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c5b188d8-c1cf-4de1-9d39-75495263ecc8_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3be68c4d-e2c9-554b-a455-fb6bef1ee29d/3be68c4d-e2c9-554b-a455-fb6bef1ee29d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 213811,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c5b188d8-c1cf-4de1-9d39-75495263ecc8_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3be68c4d-e2c9-554b-a455-fb6bef1ee29d/3be68c4d-e2c9-554b-a455-fb6bef1ee29d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 228686,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c5b188d8-c1cf-4de1-9d39-75495263ecc8_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3be68c4d-e2c9-554b-a455-fb6bef1ee29d/3be68c4d-e2c9-554b-a455-fb6bef1ee29d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 255451,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c5b188d8-c1cf-4de1-9d39-75495263ecc8_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3be68c4d-e2c9-554b-a455-fb6bef1ee29d/3be68c4d-e2c9-554b-a455-fb6bef1ee29d_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 211773,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c5b188d8-c1cf-4de1-9d39-75495263ecc8_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3be68c4d-e2c9-554b-a455-fb6bef1ee29d/3be68c4d-e2c9-554b-a455-fb6bef1ee29d_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 205465,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c5b188d8-c1cf-4de1-9d39-75495263ecc8_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3be68c4d-e2c9-554b-a455-fb6bef1ee29d/3be68c4d-e2c9-554b-a455-fb6bef1ee29d_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 263109,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/c5b188d8-c1cf-4de1-9d39-75495263ecc8_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3be68c4d-e2c9-554b-a455-fb6bef1ee29d/3be68c4d-e2c9-554b-a455-fb6bef1ee29d_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 258544,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2416699-4006031-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3be68c4d-e2c9-554b-a455-fb6bef1ee29d/3be68c4d-e2c9-554b-a455-fb6bef1ee29d_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 264294,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2416699-4006031-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3be68c4d-e2c9-554b-a455-fb6bef1ee29d/3be68c4d-e2c9-554b-a455-fb6bef1ee29d_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 182605,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2416699-4006031-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3be68c4d-e2c9-554b-a455-fb6bef1ee29d/3be68c4d-e2c9-554b-a455-fb6bef1ee29d_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 258003,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2416699-4006031-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3be68c4d-e2c9-554b-a455-fb6bef1ee29d/3be68c4d-e2c9-554b-a455-fb6bef1ee29d_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 327533,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2416699-4006031-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3be68c4d-e2c9-554b-a455-fb6bef1ee29d/3be68c4d-e2c9-554b-a455-fb6bef1ee29d_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 259606,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2416699-4006031-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3be68c4d-e2c9-554b-a455-fb6bef1ee29d/3be68c4d-e2c9-554b-a455-fb6bef1ee29d_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 222689,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2416699-4006031-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-19',
 'seller_name': 'Motor Range',
 'title': 'LAND ROVER FREELANDER 2.2 Td4 e GS 5dr',
 'transmission': 'manual',
 'trim': '2.2 Td4 e GS 5dr',
 'year': 2010}
2025-12-03 10:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272416699%27 HTTP/1.1" 200 None
2025-12-03 10:02:27 [manheim.gb] INFO: Saving data for 2416699: {'created_time': 1764756147.918897, 'last_price_update_time': 1764756147.918908, 'auction_closing_time': 1764838800.0}
2025-12-03 10:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2416699') HTTP/1.1" 204 0
2025-12-03 10:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/original/d94f615f-d952-4208-a39a-3db272fcb48f_ext_7.jpg> (referer: None)
2025-12-03 10:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd94f615f-d952-4208-a39a-3db272fcb48f_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d94f615f-d952-4208-a39a-3db272fcb48f_ext_3.jpg not downloaded yet
2025-12-03 10:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d94f615f-d952-4208-a39a-3db272fcb48f_10.jpg> (referer: None)
2025-12-03 10:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d94f615f-d952-4208-a39a-3db272fcb48f_9.jpg> (referer: None)
2025-12-03 10:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd94f615f-d952-4208-a39a-3db272fcb48f_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d94f615f-d952-4208-a39a-3db272fcb48f_ext_4.jpg not downloaded yet
2025-12-03 10:02:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa276151d90>
2025-12-03 10:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 10:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b53128c4-e05d-54e6-a7ad-dd80dd9160fe/b53128c4-e05d-54e6-a7ad-dd80dd9160fe_image_4.jpg HTTP/1.1" 201 0
2025-12-03 10:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd94f615f-d952-4208-a39a-3db272fcb48f_4.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d94f615f-d952-4208-a39a-3db272fcb48f_4.jpg saved to cache
2025-12-03 10:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b53128c4-e05d-54e6-a7ad-dd80dd9160fe
2025-12-03 10:02:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9a11238-6fab-52cc-a442-64773473b1b4 with identifier: 2443557
2025-12-03 10:02:28 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item e9a11238-6fab-52cc-a442-64773473b1b4
2025-12-03 10:02:28 [manheim.gb] INFO: Found listing with ID: 3017186
2025-12-03 10:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273017186%27 HTTP/1.1" 200 None
2025-12-03 10:02:28 [manheim.gb] INFO: Scrape type for 3017186: 1
2025-12-03 10:02:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8407ec67-9543-55d0-b4e2-0d1fb23b6f9c with identifier: 269980
2025-12-03 10:02:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8407ec67-9543-55d0-b4e2-0d1fb23b6f9c with scrape type 1
2025-12-03 10:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 19 photos for item 8407ec67-9543-55d0-b4e2-0d1fb23b6f9c
2025-12-03 10:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fawaiting-image-002.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/awaiting-image-002.jpg already downloaded
2025-12-03 10:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fawaiting-image-002.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/awaiting-image-002.jpg already downloaded
2025-12-03 10:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-269980-4006154-3.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-269980-4006154-3.jpg not downloaded yet
2025-12-03 10:02:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa27580cd10>
2025-12-03 10:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 10:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b53128c4-e05d-54e6-a7ad-dd80dd9160fe/b53128c4-e05d-54e6-a7ad-dd80dd9160fe_image_5.jpg HTTP/1.1" 201 0
2025-12-03 10:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd94f615f-d952-4208-a39a-3db272fcb48f_11.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d94f615f-d952-4208-a39a-3db272fcb48f_11.jpg saved to cache
2025-12-03 10:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b53128c4-e05d-54e6-a7ad-dd80dd9160fe
2025-12-03 10:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d94f615f-d952-4208-a39a-3db272fcb48f_ext_2.jpg> (referer: None)
2025-12-03 10:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2456004-4005794-13.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2456004-4005794-13.jpg not downloaded yet
2025-12-03 10:02:28 [manheim.gb] INFO: Found listing with ID: 3046148
2025-12-03 10:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273046148%27 HTTP/1.1" 200 None
2025-12-03 10:02:28 [manheim.gb] INFO: Scrape type for 3046148: 1
2025-12-03 10:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-269980-4006154-13.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-269980-4006154-13.jpg not downloaded yet
2025-12-03 10:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2456004-4005794-1000.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2456004-4005794-1000.jpg not downloaded yet
2025-12-03 10:02:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 10:02:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa27580e210>
2025-12-03 10:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 10:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b53128c4-e05d-54e6-a7ad-dd80dd9160fe/b53128c4-e05d-54e6-a7ad-dd80dd9160fe_image_1.jpg HTTP/1.1" 201 0
2025-12-03 10:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Foriginal%252Fd94f615f-d952-4208-a39a-3db272fcb48f_ext_7.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/original/d94f615f-d952-4208-a39a-3db272fcb48f_ext_7.jpg saved to cache
2025-12-03 10:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b53128c4-e05d-54e6-a7ad-dd80dd9160fe
2025-12-03 10:02:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa277034e50>
2025-12-03 10:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 10:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b53128c4-e05d-54e6-a7ad-dd80dd9160fe/b53128c4-e05d-54e6-a7ad-dd80dd9160fe_image_6.jpg HTTP/1.1" 201 0
2025-12-03 10:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd94f615f-d952-4208-a39a-3db272fcb48f_10.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d94f615f-d952-4208-a39a-3db272fcb48f_10.jpg saved to cache
2025-12-03 10:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b53128c4-e05d-54e6-a7ad-dd80dd9160fe
2025-12-03 10:02:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa2771f5e10>
2025-12-03 10:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 10:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b53128c4-e05d-54e6-a7ad-dd80dd9160fe/b53128c4-e05d-54e6-a7ad-dd80dd9160fe_image_7.jpg HTTP/1.1" 201 0
2025-12-03 10:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd94f615f-d952-4208-a39a-3db272fcb48f_9.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d94f615f-d952-4208-a39a-3db272fcb48f_9.jpg saved to cache
2025-12-03 10:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b53128c4-e05d-54e6-a7ad-dd80dd9160fe
2025-12-03 10:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d94f615f-d952-4208-a39a-3db272fcb48f_ext_5.jpg> (referer: None)
2025-12-03 10:02:29 [manheim.gb] INFO: Found listing with ID: 3052566
2025-12-03 10:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273052566%27 HTTP/1.1" 200 None
2025-12-03 10:02:29 [manheim.gb] INFO: Scrape type for 3052566: 1
2025-12-03 10:02:29 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field odometer is not nullable
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/manheim.py", line 201, in parse_listings
    scraped_item = self._extract_listing_item(item, expiration_date)
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/manheim.py", line 281, in _extract_listing_item
    item["odometer"] = odometer
    ~~~~^^^^^^^^^^^^
  File "/usr/src/app/crawlers/items.py", line 115, in __setitem__
    raise ValueError(f"Field {key} is not nullable")
ValueError: Field odometer is not nullable
2025-12-03 10:02:29 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field odometer is not nullable
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/manheim.py", line 201, in parse_listings
    scraped_item = self._extract_listing_item(item, expiration_date)
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/manheim.py", line 281, in _extract_listing_item
    item["odometer"] = odometer
    ~~~~^^^^^^^^^^^^
  File "/usr/src/app/crawlers/items.py", line 115, in __setitem__
    raise ValueError(f"Field {key} is not nullable")
ValueError: Field odometer is not nullable
2025-12-03 10:02:29 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field odometer is not nullable
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/manheim.py", line 201, in parse_listings
    scraped_item = self._extract_listing_item(item, expiration_date)
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/manheim.py", line 281, in _extract_listing_item
    item["odometer"] = odometer
    ~~~~^^^^^^^^^^^^
  File "/usr/src/app/crawlers/items.py", line 115, in __setitem__
    raise ValueError(f"Field {key} is not nullable")
ValueError: Field odometer is not nullable
2025-12-03 10:02:29 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field odometer is not nullable
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/manheim.py", line 201, in parse_listings
    scraped_item = self._extract_listing_item(item, expiration_date)
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/manheim.py", line 281, in _extract_listing_item
    item["odometer"] = odometer
    ~~~~^^^^^^^^^^^^
  File "/usr/src/app/crawlers/items.py", line 115, in __setitem__
    raise ValueError(f"Field {key} is not nullable")
ValueError: Field odometer is not nullable
2025-12-03 10:02:30 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field odometer is not nullable
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/manheim.py", line 201, in parse_listings
    scraped_item = self._extract_listing_item(item, expiration_date)
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/manheim.py", line 281, in _extract_listing_item
    item["odometer"] = odometer
    ~~~~^^^^^^^^^^^^
  File "/usr/src/app/crawlers/items.py", line 115, in __setitem__
    raise ValueError(f"Field {key} is not nullable")
ValueError: Field odometer is not nullable
2025-12-03 10:02:30 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field odometer is not nullable
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/manheim.py", line 201, in parse_listings
    scraped_item = self._extract_listing_item(item, expiration_date)
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/manheim.py", line 281, in _extract_listing_item
    item["odometer"] = odometer
    ~~~~^^^^^^^^^^^^
  File "/usr/src/app/crawlers/items.py", line 115, in __setitem__
    raise ValueError(f"Field {key} is not nullable")
ValueError: Field odometer is not nullable
2025-12-03 10:02:30 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field odometer is not nullable
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/manheim.py", line 201, in parse_listings
    scraped_item = self._extract_listing_item(item, expiration_date)
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/manheim.py", line 281, in _extract_listing_item
    item["odometer"] = odometer
    ~~~~^^^^^^^^^^^^
  File "/usr/src/app/crawlers/items.py", line 115, in __setitem__
    raise ValueError(f"Field {key} is not nullable")
ValueError: Field odometer is not nullable
2025-12-03 10:02:30 [scrapy.core.scraper] ERROR: Spider error processing <POST https://www.manheim.co.uk/search/refine> (referer: https://www.manheim.co.uk/search)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 295, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 374, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 355, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 374, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 355, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy_zyte_api/_middlewares.py", line 206, in process_spider_output_async
    async for item_or_request in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/manheim.py", line 201, in parse_listings
    scraped_item = self._extract_listing_item(item, expiration_date)
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/manheim.py", line 281, in _extract_listing_item
    item["odometer"] = odometer
    ~~~~^^^^^^^^^^^^
  File "/usr/src/app/crawlers/items.py", line 115, in __setitem__
    raise ValueError(f"Field {key} is not nullable")
ValueError: Field odometer is not nullable
2025-12-03 10:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-269980-4006154-1000.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-269980-4006154-1000.jpg not downloaded yet
2025-12-03 10:02:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-03 10:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2456004-4005794-1001.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2456004-4005794-1001.jpg not downloaded yet
2025-12-03 10:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-269980-4006154-1001.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-269980-4006154-1001.jpg not downloaded yet
2025-12-03 10:02:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa27712cb50>
2025-12-03 10:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 10:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b53128c4-e05d-54e6-a7ad-dd80dd9160fe/b53128c4-e05d-54e6-a7ad-dd80dd9160fe_image_8.jpg HTTP/1.1" 201 0
2025-12-03 10:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd94f615f-d952-4208-a39a-3db272fcb48f_ext_2.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d94f615f-d952-4208-a39a-3db272fcb48f_ext_2.jpg saved to cache
2025-12-03 10:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b53128c4-e05d-54e6-a7ad-dd80dd9160fe
2025-12-03 10:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d94f615f-d952-4208-a39a-3db272fcb48f_ext_3.jpg> (referer: None)
2025-12-03 10:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d94f615f-d952-4208-a39a-3db272fcb48f_ext_4.jpg> (referer: None)
2025-12-03 10:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2456004-4005794-1002.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2456004-4005794-1002.jpg not downloaded yet
2025-12-03 10:02:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa276f17890>
2025-12-03 10:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 10:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b53128c4-e05d-54e6-a7ad-dd80dd9160fe/b53128c4-e05d-54e6-a7ad-dd80dd9160fe_image_9.jpg HTTP/1.1" 201 0
2025-12-03 10:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd94f615f-d952-4208-a39a-3db272fcb48f_ext_5.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d94f615f-d952-4208-a39a-3db272fcb48f_ext_5.jpg saved to cache
2025-12-03 10:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b53128c4-e05d-54e6-a7ad-dd80dd9160fe
2025-12-03 10:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-269980-4006154-1002.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-269980-4006154-1002.jpg not downloaded yet
2025-12-03 10:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-269980-4006154-3.jpg> (referer: None)
2025-12-03 10:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/ACLASS?id=2590049&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232590049&indx=155> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 10:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2456004-4005794-13.jpg> (referer: None)
2025-12-03 10:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-269980-4006154-1003.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-269980-4006154-1003.jpg not downloaded yet
2025-12-03 10:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2456004-4005794-1000.jpg> (referer: None)
2025-12-03 10:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-269980-4006154-13.jpg> (referer: None)
2025-12-03 10:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-269980-4006154-1004.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-269980-4006154-1004.jpg not downloaded yet
2025-12-03 10:02:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa27712e890>
2025-12-03 10:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 10:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b53128c4-e05d-54e6-a7ad-dd80dd9160fe/b53128c4-e05d-54e6-a7ad-dd80dd9160fe_image_10.jpg HTTP/1.1" 201 0
2025-12-03 10:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd94f615f-d952-4208-a39a-3db272fcb48f_ext_3.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d94f615f-d952-4208-a39a-3db272fcb48f_ext_3.jpg saved to cache
2025-12-03 10:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item b53128c4-e05d-54e6-a7ad-dd80dd9160fe
2025-12-03 10:02:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa276f49d90>
2025-12-03 10:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 10:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b53128c4-e05d-54e6-a7ad-dd80dd9160fe/b53128c4-e05d-54e6-a7ad-dd80dd9160fe_image_11.jpg HTTP/1.1" 201 0
2025-12-03 10:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd94f615f-d952-4208-a39a-3db272fcb48f_ext_4.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d94f615f-d952-4208-a39a-3db272fcb48f_ext_4.jpg saved to cache
2025-12-03 10:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item b53128c4-e05d-54e6-a7ad-dd80dd9160fe
2025-12-03 10:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-269980-4006154-1000.jpg> (referer: None)
2025-12-03 10:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-269980-4006154-1005.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-269980-4006154-1005.jpg not downloaded yet
2025-12-03 10:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2456004-4005794-1001.jpg> (referer: None)
2025-12-03 10:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-269980-4006154-1002.jpg> (referer: None)
2025-12-03 10:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-269980-4006154-1006.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-269980-4006154-1006.jpg not downloaded yet
2025-12-03 10:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2456004-4005794-1002.jpg> (referer: None)
2025-12-03 10:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-269980-4006154-1001.jpg> (referer: None)
2025-12-03 10:02:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa276ae32d0>
2025-12-03 10:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 10:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8407ec67-9543-55d0-b4e2-0d1fb23b6f9c/8407ec67-9543-55d0-b4e2-0d1fb23b6f9c_image_2.jpg HTTP/1.1" 201 0
2025-12-03 10:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-269980-4006154-3.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-269980-4006154-3.jpg saved to cache
2025-12-03 10:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8407ec67-9543-55d0-b4e2-0d1fb23b6f9c
2025-12-03 10:02:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc2682fe-56ca-516e-bc52-bfedae204133 with identifier: 2590049
2025-12-03 10:02:32 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item fc2682fe-56ca-516e-bc52-bfedae204133
2025-12-03 10:02:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa278740e90>
2025-12-03 10:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 10:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b53128c4-e05d-54e6-a7ad-dd80dd9160fe/b53128c4-e05d-54e6-a7ad-dd80dd9160fe_image_12.jpg HTTP/1.1" 201 0
2025-12-03 10:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2456004-4005794-13.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2456004-4005794-13.jpg saved to cache
2025-12-03 10:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item b53128c4-e05d-54e6-a7ad-dd80dd9160fe
2025-12-03 10:02:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa276146110>
2025-12-03 10:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 10:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b53128c4-e05d-54e6-a7ad-dd80dd9160fe/b53128c4-e05d-54e6-a7ad-dd80dd9160fe_image_13.jpg HTTP/1.1" 201 0
2025-12-03 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2456004-4005794-1000.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2456004-4005794-1000.jpg saved to cache
2025-12-03 10:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item b53128c4-e05d-54e6-a7ad-dd80dd9160fe
2025-12-03 10:02:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa2770d5950>
2025-12-03 10:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 10:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8407ec67-9543-55d0-b4e2-0d1fb23b6f9c/8407ec67-9543-55d0-b4e2-0d1fb23b6f9c_image_3.jpg HTTP/1.1" 201 0
2025-12-03 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-269980-4006154-13.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-269980-4006154-13.jpg saved to cache
2025-12-03 10:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8407ec67-9543-55d0-b4e2-0d1fb23b6f9c
2025-12-03 10:02:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa2772c7550>
2025-12-03 10:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 10:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8407ec67-9543-55d0-b4e2-0d1fb23b6f9c/8407ec67-9543-55d0-b4e2-0d1fb23b6f9c_image_4.jpg HTTP/1.1" 201 0
2025-12-03 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-269980-4006154-1000.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-269980-4006154-1000.jpg saved to cache
2025-12-03 10:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8407ec67-9543-55d0-b4e2-0d1fb23b6f9c
2025-12-03 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-269980-4006154-1007.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-269980-4006154-1007.jpg not downloaded yet
2025-12-03 10:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-269980-4006154-1003.jpg> (referer: None)
2025-12-03 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-269980-4006154-1008.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-269980-4006154-1008.jpg not downloaded yet
2025-12-03 10:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-269980-4006154-1004.jpg> (referer: None)
2025-12-03 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-269980-4006154-1009.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-269980-4006154-1009.jpg not downloaded yet
2025-12-03 10:02:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa27610f450>
2025-12-03 10:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 10:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b53128c4-e05d-54e6-a7ad-dd80dd9160fe/b53128c4-e05d-54e6-a7ad-dd80dd9160fe_image_14.jpg HTTP/1.1" 201 0
2025-12-03 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2456004-4005794-1001.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2456004-4005794-1001.jpg saved to cache
2025-12-03 10:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item b53128c4-e05d-54e6-a7ad-dd80dd9160fe
2025-12-03 10:02:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa27702e210>
2025-12-03 10:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 10:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8407ec67-9543-55d0-b4e2-0d1fb23b6f9c/8407ec67-9543-55d0-b4e2-0d1fb23b6f9c_image_6.jpg HTTP/1.1" 201 0
2025-12-03 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-269980-4006154-1002.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-269980-4006154-1002.jpg saved to cache
2025-12-03 10:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8407ec67-9543-55d0-b4e2-0d1fb23b6f9c
2025-12-03 10:02:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa27702c790>
2025-12-03 10:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 10:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b53128c4-e05d-54e6-a7ad-dd80dd9160fe/b53128c4-e05d-54e6-a7ad-dd80dd9160fe_image_15.jpg HTTP/1.1" 201 0
2025-12-03 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2456004-4005794-1002.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2456004-4005794-1002.jpg saved to cache
2025-12-03 10:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item b53128c4-e05d-54e6-a7ad-dd80dd9160fe
2025-12-03 10:02:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b53128c4-e05d-54e6-a7ad-dd80dd9160fe, skipping ID generation
2025-12-03 10:02:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b53128c4-e05d-54e6-a7ad-dd80dd9160fe with scrape type 1
2025-12-03 10:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b53128c4-e05d-54e6-a7ad-dd80dd9160fe from tracking dictionaries
2025-12-03 10:02:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b53128c4-e05d-54e6-a7ad-dd80dd9160fe sending to next pipeline
2025-12-03 10:02:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: b53128c4-e05d-54e6-a7ad-dd80dd9160fe, identifier: 2456004
2025-12-03 10:02:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa277180090>
2025-12-03 10:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 10:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8407ec67-9543-55d0-b4e2-0d1fb23b6f9c/8407ec67-9543-55d0-b4e2-0d1fb23b6f9c_image_5.jpg HTTP/1.1" 201 0
2025-12-03 10:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-269980-4006154-1001.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-269980-4006154-1001.jpg saved to cache
2025-12-03 10:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8407ec67-9543-55d0-b4e2-0d1fb23b6f9c
2025-12-03 10:02:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: b53128c4-e05d-54e6-a7ad-dd80dd9160fe with identifier: 2456004
2025-12-03 10:02:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: b53128c4-e05d-54e6-a7ad-dd80dd9160fe with identifier: 2456004
2025-12-03 10:02:35 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: b53128c4-e05d-54e6-a7ad-dd80dd9160fe with identifier: 2456004 to the API
2025-12-03 10:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 10:02:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 10:02:36 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/insp-0001-2456004-4005794-1002.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'car_expert_report_source_url': None,
 'color': 'SILVER',
 'currency': 'GBP',
 'engine': '1.0L',
 'expiration_date': '2025-12-05T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'b53128c4-e05d-54e6-a7ad-dd80dd9160fe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'WT19LFA',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FORD/FOCUS?id=2456004',
 'listing': 'auction',
 'location': 'Washington',
 'make': 'FORD',
 'model': 'FOCUS',
 'odometer': 40337,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b53128c4-e05d-54e6-a7ad-dd80dd9160fe/b53128c4-e05d-54e6-a7ad-dd80dd9160fe_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 177401,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d94f615f-d952-4208-a39a-3db272fcb48f_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b53128c4-e05d-54e6-a7ad-dd80dd9160fe/b53128c4-e05d-54e6-a7ad-dd80dd9160fe_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 535482,
             'Height': 1753,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/original/d94f615f-d952-4208-a39a-3db272fcb48f_ext_7.jpg',
             'Width': 2338},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b53128c4-e05d-54e6-a7ad-dd80dd9160fe/b53128c4-e05d-54e6-a7ad-dd80dd9160fe_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 157467,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d94f615f-d952-4208-a39a-3db272fcb48f_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b53128c4-e05d-54e6-a7ad-dd80dd9160fe/b53128c4-e05d-54e6-a7ad-dd80dd9160fe_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 187848,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d94f615f-d952-4208-a39a-3db272fcb48f_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b53128c4-e05d-54e6-a7ad-dd80dd9160fe/b53128c4-e05d-54e6-a7ad-dd80dd9160fe_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 173192,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d94f615f-d952-4208-a39a-3db272fcb48f_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b53128c4-e05d-54e6-a7ad-dd80dd9160fe/b53128c4-e05d-54e6-a7ad-dd80dd9160fe_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 178127,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d94f615f-d952-4208-a39a-3db272fcb48f_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b53128c4-e05d-54e6-a7ad-dd80dd9160fe/b53128c4-e05d-54e6-a7ad-dd80dd9160fe_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 162742,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d94f615f-d952-4208-a39a-3db272fcb48f_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b53128c4-e05d-54e6-a7ad-dd80dd9160fe/b53128c4-e05d-54e6-a7ad-dd80dd9160fe_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 180069,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d94f615f-d952-4208-a39a-3db272fcb48f_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b53128c4-e05d-54e6-a7ad-dd80dd9160fe/b53128c4-e05d-54e6-a7ad-dd80dd9160fe_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 205082,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d94f615f-d952-4208-a39a-3db272fcb48f_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b53128c4-e05d-54e6-a7ad-dd80dd9160fe/b53128c4-e05d-54e6-a7ad-dd80dd9160fe_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 142951,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d94f615f-d952-4208-a39a-3db272fcb48f_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b53128c4-e05d-54e6-a7ad-dd80dd9160fe/b53128c4-e05d-54e6-a7ad-dd80dd9160fe_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 150241,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d94f615f-d952-4208-a39a-3db272fcb48f_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b53128c4-e05d-54e6-a7ad-dd80dd9160fe/b53128c4-e05d-54e6-a7ad-dd80dd9160fe_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 164403,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d94f615f-d952-4208-a39a-3db272fcb48f_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b53128c4-e05d-54e6-a7ad-dd80dd9160fe/b53128c4-e05d-54e6-a7ad-dd80dd9160fe_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 323334,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2456004-4005794-13.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b53128c4-e05d-54e6-a7ad-dd80dd9160fe/b53128c4-e05d-54e6-a7ad-dd80dd9160fe_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 202271,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2456004-4005794-1000.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b53128c4-e05d-54e6-a7ad-dd80dd9160fe/b53128c4-e05d-54e6-a7ad-dd80dd9160fe_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 187951,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2456004-4005794-1001.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b53128c4-e05d-54e6-a7ad-dd80dd9160fe/b53128c4-e05d-54e6-a7ad-dd80dd9160fe_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 215135,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2456004-4005794-1002.jpg',
             'Width': 1500}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-30',
 'seller_name': 'Available Car',
 'title': 'FORD FOCUS 1.0 EcoBoost 125 Titanium 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.0 EcoBoost 125 Titanium 5dr Auto',
 'year': 2019}
2025-12-03 10:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272456004%27 HTTP/1.1" 200 None
2025-12-03 10:02:36 [manheim.gb] INFO: Saving data for 2456004: {'created_time': 1764756156.073772, 'last_price_update_time': 1764756156.073783, 'auction_closing_time': 1764925200.0}
2025-12-03 10:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2456004') HTTP/1.1" 204 0
2025-12-03 10:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0002492073-01990231-002.pdf> (referer: None)
2025-12-03 10:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-269980-4006154-1010.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-269980-4006154-1010.jpg not downloaded yet
2025-12-03 10:02:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa2770f0250>
2025-12-03 10:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 10:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8407ec67-9543-55d0-b4e2-0d1fb23b6f9c/8407ec67-9543-55d0-b4e2-0d1fb23b6f9c_image_7.jpg HTTP/1.1" 201 0
2025-12-03 10:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-269980-4006154-1003.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-269980-4006154-1003.jpg saved to cache
2025-12-03 10:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8407ec67-9543-55d0-b4e2-0d1fb23b6f9c
2025-12-03 10:02:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa276f0a690>
2025-12-03 10:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 10:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8407ec67-9543-55d0-b4e2-0d1fb23b6f9c/8407ec67-9543-55d0-b4e2-0d1fb23b6f9c_image_8.jpg HTTP/1.1" 201 0
2025-12-03 10:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-269980-4006154-1004.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-269980-4006154-1004.jpg saved to cache
2025-12-03 10:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8407ec67-9543-55d0-b4e2-0d1fb23b6f9c
2025-12-03 10:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-269980-4006154-1011.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-269980-4006154-1011.jpg not downloaded yet
2025-12-03 10:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-269980-4006154-1007.jpg> (referer: None)
2025-12-03 10:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-269980-4006154-1006.jpg> (referer: None)
2025-12-03 10:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-269980-4006154-1005.jpg> (referer: None)
2025-12-03 10:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-269980-4006154-1008.jpg> (referer: None)
2025-12-03 10:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-269980-4006154-1012.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-269980-4006154-1012.jpg not downloaded yet
2025-12-03 10:02:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa2773de210>
2025-12-03 10:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 10:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ce25d2b-dcfb-56ac-81f0-cbc5540866a4/8ce25d2b-dcfb-56ac-81f0-cbc5540866a4_expert_report_file_d5b34e28-3a35-4783-9826-c8f8940f31d6.pdf HTTP/1.1" 201 0
2025-12-03 10:02:37 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 8ce25d2b-dcfb-56ac-81f0-cbc5540866a4
2025-12-03 10:02:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8ce25d2b-dcfb-56ac-81f0-cbc5540866a4, skipping ID generation
2025-12-03 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 8ce25d2b-dcfb-56ac-81f0-cbc5540866a4
2025-12-03 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_ext_7.jpg not downloaded yet
2025-12-03 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-269980-4006154-1013.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-269980-4006154-1013.jpg not downloaded yet
2025-12-03 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_ext_7.jpg not downloaded yet
2025-12-03 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-269980-4006154-1014.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-269980-4006154-1014.jpg not downloaded yet
2025-12-03 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_ext_6.jpg not downloaded yet
2025-12-03 10:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-269980-4006154-1010.jpg> (referer: None)
2025-12-03 10:02:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa2761bd5d0>
2025-12-03 10:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 10:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8407ec67-9543-55d0-b4e2-0d1fb23b6f9c/8407ec67-9543-55d0-b4e2-0d1fb23b6f9c_image_11.jpg HTTP/1.1" 201 0
2025-12-03 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-269980-4006154-1007.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-269980-4006154-1007.jpg saved to cache
2025-12-03 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 8407ec67-9543-55d0-b4e2-0d1fb23b6f9c
2025-12-03 10:02:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa2770779d0>
2025-12-03 10:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 10:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8407ec67-9543-55d0-b4e2-0d1fb23b6f9c/8407ec67-9543-55d0-b4e2-0d1fb23b6f9c_image_10.jpg HTTP/1.1" 201 0
2025-12-03 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-269980-4006154-1006.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-269980-4006154-1006.jpg saved to cache
2025-12-03 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 8407ec67-9543-55d0-b4e2-0d1fb23b6f9c
2025-12-03 10:02:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa2772d1dd0>
2025-12-03 10:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 10:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8407ec67-9543-55d0-b4e2-0d1fb23b6f9c/8407ec67-9543-55d0-b4e2-0d1fb23b6f9c_image_9.jpg HTTP/1.1" 201 0
2025-12-03 10:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-269980-4006154-1005.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-269980-4006154-1005.jpg saved to cache
2025-12-03 10:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8407ec67-9543-55d0-b4e2-0d1fb23b6f9c
2025-12-03 10:02:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa27613b190>
2025-12-03 10:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 10:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8407ec67-9543-55d0-b4e2-0d1fb23b6f9c/8407ec67-9543-55d0-b4e2-0d1fb23b6f9c_image_12.jpg HTTP/1.1" 201 0
2025-12-03 10:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-269980-4006154-1008.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-269980-4006154-1008.jpg saved to cache
2025-12-03 10:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 8407ec67-9543-55d0-b4e2-0d1fb23b6f9c
2025-12-03 10:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-269980-4006154-1009.jpg> (referer: None)
2025-12-03 10:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_ext_1.jpg not downloaded yet
2025-12-03 10:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_5.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_5.jpg not downloaded yet
2025-12-03 10:02:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa27702fcd0>
2025-12-03 10:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 10:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8407ec67-9543-55d0-b4e2-0d1fb23b6f9c/8407ec67-9543-55d0-b4e2-0d1fb23b6f9c_image_14.jpg HTTP/1.1" 201 0
2025-12-03 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-269980-4006154-1010.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-269980-4006154-1010.jpg saved to cache
2025-12-03 10:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 8407ec67-9543-55d0-b4e2-0d1fb23b6f9c
2025-12-03 10:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-269980-4006154-1011.jpg> (referer: None)
2025-12-03 10:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002492073-01990231-002.pdf)
2025-12-03 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_4.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_4.jpg not downloaded yet
2025-12-03 10:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-269980-4006154-1012.jpg> (referer: None)
2025-12-03 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_11.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_11.jpg not downloaded yet
2025-12-03 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_10.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_10.jpg not downloaded yet
2025-12-03 10:02:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa277077550>
2025-12-03 10:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 10:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8407ec67-9543-55d0-b4e2-0d1fb23b6f9c/8407ec67-9543-55d0-b4e2-0d1fb23b6f9c_image_13.jpg HTTP/1.1" 201 0
2025-12-03 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-269980-4006154-1009.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-269980-4006154-1009.jpg saved to cache
2025-12-03 10:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 8407ec67-9543-55d0-b4e2-0d1fb23b6f9c
2025-12-03 10:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002492073-01990231-002.pdf)
2025-12-03 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_9.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_9.jpg not downloaded yet
2025-12-03 10:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-269980-4006154-1013.jpg> (referer: None)
2025-12-03 10:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-269980-4006154-1014.jpg> (referer: None)
2025-12-03 10:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002492073-01990231-002.pdf)
2025-12-03 10:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002492073-01990231-002.pdf)
2025-12-03 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_ext_2.jpg not downloaded yet
2025-12-03 10:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002492073-01990231-002.pdf)
2025-12-03 10:02:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa27708e350>
2025-12-03 10:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 10:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8407ec67-9543-55d0-b4e2-0d1fb23b6f9c/8407ec67-9543-55d0-b4e2-0d1fb23b6f9c_image_15.jpg HTTP/1.1" 201 0
2025-12-03 10:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-269980-4006154-1011.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-269980-4006154-1011.jpg saved to cache
2025-12-03 10:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 8407ec67-9543-55d0-b4e2-0d1fb23b6f9c
2025-12-03 10:02:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa276f49650>
2025-12-03 10:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 10:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ce25d2b-dcfb-56ac-81f0-cbc5540866a4/8ce25d2b-dcfb-56ac-81f0-cbc5540866a4_image_0.jpg HTTP/1.1" 201 0
2025-12-03 10:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_ext_7.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_ext_7.jpg saved to cache
2025-12-03 10:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8ce25d2b-dcfb-56ac-81f0-cbc5540866a4
2025-12-03 10:02:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa2773de210>
2025-12-03 10:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 10:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8407ec67-9543-55d0-b4e2-0d1fb23b6f9c/8407ec67-9543-55d0-b4e2-0d1fb23b6f9c_image_16.jpg HTTP/1.1" 201 0
2025-12-03 10:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-269980-4006154-1012.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-269980-4006154-1012.jpg saved to cache
2025-12-03 10:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 8407ec67-9543-55d0-b4e2-0d1fb23b6f9c
2025-12-03 10:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002492073-01990231-002.pdf)
2025-12-03 10:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_ext_5.jpg not downloaded yet
2025-12-03 10:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_ext_3.jpg not downloaded yet
2025-12-03 10:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002492073-01990231-002.pdf)
2025-12-03 10:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002492073-01990231-002.pdf)
2025-12-03 10:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_ext_4.jpg not downloaded yet
2025-12-03 10:02:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa27580c510>
2025-12-03 10:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 10:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ce25d2b-dcfb-56ac-81f0-cbc5540866a4/8ce25d2b-dcfb-56ac-81f0-cbc5540866a4_image_2.jpg HTTP/1.1" 201 0
2025-12-03 10:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_ext_6.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_ext_6.jpg saved to cache
2025-12-03 10:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8ce25d2b-dcfb-56ac-81f0-cbc5540866a4
2025-12-03 10:02:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa2771e2350>
2025-12-03 10:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 10:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8407ec67-9543-55d0-b4e2-0d1fb23b6f9c/8407ec67-9543-55d0-b4e2-0d1fb23b6f9c_image_17.jpg HTTP/1.1" 201 0
2025-12-03 10:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-269980-4006154-1013.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-269980-4006154-1013.jpg saved to cache
2025-12-03 10:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 8407ec67-9543-55d0-b4e2-0d1fb23b6f9c
2025-12-03 10:02:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa276116350>
2025-12-03 10:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 10:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8407ec67-9543-55d0-b4e2-0d1fb23b6f9c/8407ec67-9543-55d0-b4e2-0d1fb23b6f9c_image_18.jpg HTTP/1.1" 201 0
2025-12-03 10:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-269980-4006154-1014.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-269980-4006154-1014.jpg saved to cache
2025-12-03 10:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 8407ec67-9543-55d0-b4e2-0d1fb23b6f9c
2025-12-03 10:02:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8407ec67-9543-55d0-b4e2-0d1fb23b6f9c, skipping ID generation
2025-12-03 10:02:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8407ec67-9543-55d0-b4e2-0d1fb23b6f9c with scrape type 1
2025-12-03 10:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 8407ec67-9543-55d0-b4e2-0d1fb23b6f9c from tracking dictionaries
2025-12-03 10:02:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8407ec67-9543-55d0-b4e2-0d1fb23b6f9c sending to next pipeline
2025-12-03 10:02:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 8407ec67-9543-55d0-b4e2-0d1fb23b6f9c, identifier: 269980
2025-12-03 10:02:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa2770b6450>
2025-12-03 10:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 10:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ce25d2b-dcfb-56ac-81f0-cbc5540866a4/8ce25d2b-dcfb-56ac-81f0-cbc5540866a4_image_4.jpg HTTP/1.1" 201 0
2025-12-03 10:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_5.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_5.jpg saved to cache
2025-12-03 10:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8ce25d2b-dcfb-56ac-81f0-cbc5540866a4
2025-12-03 10:02:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa27731c410>
2025-12-03 10:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 10:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ce25d2b-dcfb-56ac-81f0-cbc5540866a4/8ce25d2b-dcfb-56ac-81f0-cbc5540866a4_image_5.jpg HTTP/1.1" 201 0
2025-12-03 10:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_4.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_4.jpg saved to cache
2025-12-03 10:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8ce25d2b-dcfb-56ac-81f0-cbc5540866a4
2025-12-03 10:02:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa276f4fd10>
2025-12-03 10:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 10:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ce25d2b-dcfb-56ac-81f0-cbc5540866a4/8ce25d2b-dcfb-56ac-81f0-cbc5540866a4_image_1.jpg HTTP/1.1" 201 0
2025-12-03 10:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_ext_7.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_ext_7.jpg saved to cache
2025-12-03 10:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8ce25d2b-dcfb-56ac-81f0-cbc5540866a4
2025-12-03 10:02:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 8407ec67-9543-55d0-b4e2-0d1fb23b6f9c with identifier: 269980
2025-12-03 10:02:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 8407ec67-9543-55d0-b4e2-0d1fb23b6f9c with identifier: 269980
2025-12-03 10:02:42 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 183500 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    183500
2025-12-03 10:02:42 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 8407ec67-9543-55d0-b4e2-0d1fb23b6f9c spider: manheim.gb
2025-12-03 10:02:42 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 8407ec67-9543-55d0-b4e2-0d1fb23b6f9c due to rule: high_mileage_for_country.json, error: 183500 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    183500
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'car_expert_report_source_url': None,
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '8407ec67-9543-55d0-b4e2-0d1fb23b6f9c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'VE12YNL',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/PASSAT%20CC?id=269980',
 'listing': 'auction',
 'location': 'Northampton',
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT CC',
 'odometer': 114022,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4622c3ba-5515-5758-814e-2f49e4247fa1/4622c3ba-5515-5758-814e-2f49e4247fa1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72484,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/awaiting-image-002.jpg',
             'Width': 1322},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4622c3ba-5515-5758-814e-2f49e4247fa1/4622c3ba-5515-5758-814e-2f49e4247fa1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72484,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/awaiting-image-002.jpg',
             'Width': 1322},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8407ec67-9543-55d0-b4e2-0d1fb23b6f9c/8407ec67-9543-55d0-b4e2-0d1fb23b6f9c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 216542,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-269980-4006154-3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8407ec67-9543-55d0-b4e2-0d1fb23b6f9c/8407ec67-9543-55d0-b4e2-0d1fb23b6f9c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 289810,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-269980-4006154-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8407ec67-9543-55d0-b4e2-0d1fb23b6f9c/8407ec67-9543-55d0-b4e2-0d1fb23b6f9c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 295289,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-269980-4006154-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8407ec67-9543-55d0-b4e2-0d1fb23b6f9c/8407ec67-9543-55d0-b4e2-0d1fb23b6f9c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 245367,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-269980-4006154-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8407ec67-9543-55d0-b4e2-0d1fb23b6f9c/8407ec67-9543-55d0-b4e2-0d1fb23b6f9c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 185623,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-269980-4006154-1002.jpg',
             'Width': 749},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8407ec67-9543-55d0-b4e2-0d1fb23b6f9c/8407ec67-9543-55d0-b4e2-0d1fb23b6f9c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 238003,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-269980-4006154-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8407ec67-9543-55d0-b4e2-0d1fb23b6f9c/8407ec67-9543-55d0-b4e2-0d1fb23b6f9c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 225648,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-269980-4006154-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8407ec67-9543-55d0-b4e2-0d1fb23b6f9c/8407ec67-9543-55d0-b4e2-0d1fb23b6f9c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 319561,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-269980-4006154-1005.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8407ec67-9543-55d0-b4e2-0d1fb23b6f9c/8407ec67-9543-55d0-b4e2-0d1fb23b6f9c_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 227072,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-269980-4006154-1006.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8407ec67-9543-55d0-b4e2-0d1fb23b6f9c/8407ec67-9543-55d0-b4e2-0d1fb23b6f9c_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 207242,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-269980-4006154-1007.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8407ec67-9543-55d0-b4e2-0d1fb23b6f9c/8407ec67-9543-55d0-b4e2-0d1fb23b6f9c_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 242621,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-269980-4006154-1008.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8407ec67-9543-55d0-b4e2-0d1fb23b6f9c/8407ec67-9543-55d0-b4e2-0d1fb23b6f9c_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 269482,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-269980-4006154-1009.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8407ec67-9543-55d0-b4e2-0d1fb23b6f9c/8407ec67-9543-55d0-b4e2-0d1fb23b6f9c_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 232182,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-269980-4006154-1010.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8407ec67-9543-55d0-b4e2-0d1fb23b6f9c/8407ec67-9543-55d0-b4e2-0d1fb23b6f9c_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 245207,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-269980-4006154-1011.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8407ec67-9543-55d0-b4e2-0d1fb23b6f9c/8407ec67-9543-55d0-b4e2-0d1fb23b6f9c_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 273189,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-269980-4006154-1012.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8407ec67-9543-55d0-b4e2-0d1fb23b6f9c/8407ec67-9543-55d0-b4e2-0d1fb23b6f9c_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 298648,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-269980-4006154-1013.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8407ec67-9543-55d0-b4e2-0d1fb23b6f9c/8407ec67-9543-55d0-b4e2-0d1fb23b6f9c_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 187309,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-269980-4006154-1014.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-29',
 'seller_name': 'Vindis Group',
 'title': 'VOLKSWAGEN PASSAT CC 2.0 TDI BlueMotion Tech GT 4dr',
 'transmission': 'manual',
 'trim': '2.0 TDI BlueMotion Tech GT 4dr',
 'year': 2012}
2025-12-03 10:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27269980%27 HTTP/1.1" 200 None
2025-12-03 10:02:43 [manheim.gb] INFO: Saving data for 269980: {'created_time': 1764756163.006946, 'last_price_update_time': 1764756163.006954, 'auction_closing_time': 1764838800.0}
2025-12-03 10:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='269980') HTTP/1.1" 204 0
2025-12-03 10:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2492073-4005807-13.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2492073-4005807-13.jpg not downloaded yet
2025-12-03 10:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002492073-01990231-002.pdf)
2025-12-03 10:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002492073-01990231-002.pdf)
2025-12-03 10:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2492073-4005807-1000.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2492073-4005807-1000.jpg not downloaded yet
2025-12-03 10:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002492073-01990231-002.pdf)
2025-12-03 10:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002492073-01990231-002.pdf)
2025-12-03 10:02:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa277085490>
2025-12-03 10:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 10:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ce25d2b-dcfb-56ac-81f0-cbc5540866a4/8ce25d2b-dcfb-56ac-81f0-cbc5540866a4_image_3.jpg HTTP/1.1" 201 0
2025-12-03 10:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_ext_1.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_ext_1.jpg saved to cache
2025-12-03 10:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8ce25d2b-dcfb-56ac-81f0-cbc5540866a4
2025-12-03 10:02:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa27712e590>
2025-12-03 10:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 10:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ce25d2b-dcfb-56ac-81f0-cbc5540866a4/8ce25d2b-dcfb-56ac-81f0-cbc5540866a4_image_6.jpg HTTP/1.1" 201 0
2025-12-03 10:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_11.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_11.jpg saved to cache
2025-12-03 10:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8ce25d2b-dcfb-56ac-81f0-cbc5540866a4
2025-12-03 10:02:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa277182290>
2025-12-03 10:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 10:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ce25d2b-dcfb-56ac-81f0-cbc5540866a4/8ce25d2b-dcfb-56ac-81f0-cbc5540866a4_image_7.jpg HTTP/1.1" 201 0
2025-12-03 10:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_10.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_10.jpg saved to cache
2025-12-03 10:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8ce25d2b-dcfb-56ac-81f0-cbc5540866a4
2025-12-03 10:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2492073-4005807-1001.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2492073-4005807-1001.jpg not downloaded yet
2025-12-03 10:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2492073-4005807-1002.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2492073-4005807-1002.jpg not downloaded yet
2025-12-03 10:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/MAZDA/CX5?id=3004217&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233004217&indx=199> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 10:02:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa27712e210>
2025-12-03 10:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 10:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ce25d2b-dcfb-56ac-81f0-cbc5540866a4/8ce25d2b-dcfb-56ac-81f0-cbc5540866a4_image_8.jpg HTTP/1.1" 201 0
2025-12-03 10:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_9.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_9.jpg saved to cache
2025-12-03 10:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8ce25d2b-dcfb-56ac-81f0-cbc5540866a4
2025-12-03 10:02:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa2761e9dd0>
2025-12-03 10:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 10:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ce25d2b-dcfb-56ac-81f0-cbc5540866a4/8ce25d2b-dcfb-56ac-81f0-cbc5540866a4_image_10.jpg HTTP/1.1" 201 0
2025-12-03 10:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_ext_5.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_ext_5.jpg saved to cache
2025-12-03 10:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 8ce25d2b-dcfb-56ac-81f0-cbc5540866a4
2025-12-03 10:02:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa276ad7050>
2025-12-03 10:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 10:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ce25d2b-dcfb-56ac-81f0-cbc5540866a4/8ce25d2b-dcfb-56ac-81f0-cbc5540866a4_image_9.jpg HTTP/1.1" 201 0
2025-12-03 10:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_ext_2.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_ext_2.jpg saved to cache
2025-12-03 10:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8ce25d2b-dcfb-56ac-81f0-cbc5540866a4
2025-12-03 10:02:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa2772540d0>
2025-12-03 10:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 10:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ce25d2b-dcfb-56ac-81f0-cbc5540866a4/8ce25d2b-dcfb-56ac-81f0-cbc5540866a4_image_11.jpg HTTP/1.1" 201 0
2025-12-03 10:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_ext_3.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_ext_3.jpg saved to cache
2025-12-03 10:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 8ce25d2b-dcfb-56ac-81f0-cbc5540866a4
2025-12-03 10:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002492073-01990231-002.pdf)
2025-12-03 10:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2492073-4005807-1003.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2492073-4005807-1003.jpg not downloaded yet
2025-12-03 10:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2492073-4005807-1004.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2492073-4005807-1004.jpg not downloaded yet
2025-12-03 10:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0002443557-01988504-001.pdf> (referer: None)
2025-12-03 10:02:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0c54a04-921a-5d40-8011-f4191f63cc27 with identifier: 3004217
2025-12-03 10:02:45 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item b0c54a04-921a-5d40-8011-f4191f63cc27
2025-12-03 10:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0002590049-01989186-003.pdf> (referer: None)
2025-12-03 10:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2492073-4005807-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002492073-01990231-002.pdf)
2025-12-03 10:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2492073-4005807-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002492073-01990231-002.pdf)
2025-12-03 10:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2492073-4005807-1005.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2492073-4005807-1005.jpg not downloaded yet
2025-12-03 10:02:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa27702fb50>
2025-12-03 10:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 10:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ce25d2b-dcfb-56ac-81f0-cbc5540866a4/8ce25d2b-dcfb-56ac-81f0-cbc5540866a4_image_12.jpg HTTP/1.1" 201 0
2025-12-03 10:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_ext_4.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_ext_4.jpg saved to cache
2025-12-03 10:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 8ce25d2b-dcfb-56ac-81f0-cbc5540866a4
2025-12-03 10:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2492073-4005807-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002492073-01990231-002.pdf)
2025-12-03 10:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2492073-4005807-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002492073-01990231-002.pdf)
2025-12-03 10:02:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa2761c3790>
2025-12-03 10:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 10:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_expert_report_file_46175b41-9ecf-4698-bd09-60e7614c4d9b.pdf HTTP/1.1" 201 0
2025-12-03 10:02:45 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item e9a11238-6fab-52cc-a442-64773473b1b4
2025-12-03 10:02:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e9a11238-6fab-52cc-a442-64773473b1b4, skipping ID generation
2025-12-03 10:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item e9a11238-6fab-52cc-a442-64773473b1b4
2025-12-03 10:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdee9f423-3183-474e-a5c4-fb85328bfdb7_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_ext_7.jpg not downloaded yet
2025-12-03 10:02:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa27610c590>
2025-12-03 10:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 10:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc2682fe-56ca-516e-bc52-bfedae204133/fc2682fe-56ca-516e-bc52-bfedae204133_expert_report_file_561fdc5e-b7a3-4943-80a9-0b751f9aa823.pdf HTTP/1.1" 201 0
2025-12-03 10:02:46 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item fc2682fe-56ca-516e-bc52-bfedae204133
2025-12-03 10:02:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fc2682fe-56ca-516e-bc52-bfedae204133, skipping ID generation
2025-12-03 10:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item fc2682fe-56ca-516e-bc52-bfedae204133
2025-12-03 10:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0aa4a40a-15d7-44c3-aec4-626646ac73ea_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0aa4a40a-15d7-44c3-aec4-626646ac73ea_ext_7.jpg not downloaded yet
2025-12-03 10:02:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa2761d3f10>
2025-12-03 10:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 10:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ce25d2b-dcfb-56ac-81f0-cbc5540866a4/8ce25d2b-dcfb-56ac-81f0-cbc5540866a4_image_13.jpg HTTP/1.1" 201 0
2025-12-03 10:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2492073-4005807-13.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2492073-4005807-13.jpg saved to cache
2025-12-03 10:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 8ce25d2b-dcfb-56ac-81f0-cbc5540866a4
2025-12-03 10:02:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa2770770d0>
2025-12-03 10:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 10:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ce25d2b-dcfb-56ac-81f0-cbc5540866a4/8ce25d2b-dcfb-56ac-81f0-cbc5540866a4_image_14.jpg HTTP/1.1" 201 0
2025-12-03 10:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2492073-4005807-1000.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2492073-4005807-1000.jpg saved to cache
2025-12-03 10:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 8ce25d2b-dcfb-56ac-81f0-cbc5540866a4
2025-12-03 10:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdee9f423-3183-474e-a5c4-fb85328bfdb7_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_ext_7.jpg not downloaded yet
2025-12-03 10:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0aa4a40a-15d7-44c3-aec4-626646ac73ea_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0aa4a40a-15d7-44c3-aec4-626646ac73ea_ext_7.jpg not downloaded yet
2025-12-03 10:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdee9f423-3183-474e-a5c4-fb85328bfdb7_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_ext_6.jpg not downloaded yet
2025-12-03 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0aa4a40a-15d7-44c3-aec4-626646ac73ea_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0aa4a40a-15d7-44c3-aec4-626646ac73ea_ext_6.jpg not downloaded yet
2025-12-03 10:02:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa2761e5ed0>
2025-12-03 10:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 10:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ce25d2b-dcfb-56ac-81f0-cbc5540866a4/8ce25d2b-dcfb-56ac-81f0-cbc5540866a4_image_15.jpg HTTP/1.1" 201 0
2025-12-03 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2492073-4005807-1001.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2492073-4005807-1001.jpg saved to cache
2025-12-03 10:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 8ce25d2b-dcfb-56ac-81f0-cbc5540866a4
2025-12-03 10:02:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa2761d3210>
2025-12-03 10:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 10:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ce25d2b-dcfb-56ac-81f0-cbc5540866a4/8ce25d2b-dcfb-56ac-81f0-cbc5540866a4_image_16.jpg HTTP/1.1" 201 0
2025-12-03 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2492073-4005807-1002.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2492073-4005807-1002.jpg saved to cache
2025-12-03 10:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 8ce25d2b-dcfb-56ac-81f0-cbc5540866a4
2025-12-03 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdee9f423-3183-474e-a5c4-fb85328bfdb7_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_ext_1.jpg not downloaded yet
2025-12-03 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0aa4a40a-15d7-44c3-aec4-626646ac73ea_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0aa4a40a-15d7-44c3-aec4-626646ac73ea_ext_1.jpg not downloaded yet
2025-12-03 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdee9f423-3183-474e-a5c4-fb85328bfdb7_5.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_5.jpg not downloaded yet
2025-12-03 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0aa4a40a-15d7-44c3-aec4-626646ac73ea_5.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0aa4a40a-15d7-44c3-aec4-626646ac73ea_5.jpg not downloaded yet
2025-12-03 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdee9f423-3183-474e-a5c4-fb85328bfdb7_4.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_4.jpg not downloaded yet
2025-12-03 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0aa4a40a-15d7-44c3-aec4-626646ac73ea_4.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0aa4a40a-15d7-44c3-aec4-626646ac73ea_4.jpg not downloaded yet
2025-12-03 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdee9f423-3183-474e-a5c4-fb85328bfdb7_11.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_11.jpg not downloaded yet
2025-12-03 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0aa4a40a-15d7-44c3-aec4-626646ac73ea_11.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0aa4a40a-15d7-44c3-aec4-626646ac73ea_11.jpg not downloaded yet
2025-12-03 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdee9f423-3183-474e-a5c4-fb85328bfdb7_10.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_10.jpg not downloaded yet
2025-12-03 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0aa4a40a-15d7-44c3-aec4-626646ac73ea_10.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0aa4a40a-15d7-44c3-aec4-626646ac73ea_10.jpg not downloaded yet
2025-12-03 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdee9f423-3183-474e-a5c4-fb85328bfdb7_9.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_9.jpg not downloaded yet
2025-12-03 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0aa4a40a-15d7-44c3-aec4-626646ac73ea_9.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0aa4a40a-15d7-44c3-aec4-626646ac73ea_9.jpg not downloaded yet
2025-12-03 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdee9f423-3183-474e-a5c4-fb85328bfdb7_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_ext_2.jpg not downloaded yet
2025-12-03 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0aa4a40a-15d7-44c3-aec4-626646ac73ea_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0aa4a40a-15d7-44c3-aec4-626646ac73ea_ext_2.jpg not downloaded yet
2025-12-03 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdee9f423-3183-474e-a5c4-fb85328bfdb7_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_ext_5.jpg not downloaded yet
2025-12-03 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0aa4a40a-15d7-44c3-aec4-626646ac73ea_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0aa4a40a-15d7-44c3-aec4-626646ac73ea_ext_5.jpg not downloaded yet
2025-12-03 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdee9f423-3183-474e-a5c4-fb85328bfdb7_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_ext_3.jpg not downloaded yet
2025-12-03 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0aa4a40a-15d7-44c3-aec4-626646ac73ea_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0aa4a40a-15d7-44c3-aec4-626646ac73ea_ext_3.jpg not downloaded yet
2025-12-03 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdee9f423-3183-474e-a5c4-fb85328bfdb7_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_ext_4.jpg not downloaded yet
2025-12-03 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0aa4a40a-15d7-44c3-aec4-626646ac73ea_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0aa4a40a-15d7-44c3-aec4-626646ac73ea_ext_4.jpg not downloaded yet
2025-12-03 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2443557-4005940-13.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2443557-4005940-13.jpg not downloaded yet
2025-12-03 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2590049-4005895-13.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2590049-4005895-13.jpg not downloaded yet
2025-12-03 10:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2443557-4005940-1000.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2443557-4005940-1000.jpg not downloaded yet
2025-12-03 10:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2590049-4005895-1000.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2590049-4005895-1000.jpg not downloaded yet
2025-12-03 10:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2443557-4005940-1001.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2443557-4005940-1001.jpg not downloaded yet
2025-12-03 10:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2590049-4005895-1001.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2590049-4005895-1001.jpg not downloaded yet
2025-12-03 10:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2443557-4005940-1002.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2443557-4005940-1002.jpg not downloaded yet
2025-12-03 10:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2590049-4005895-1002.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2590049-4005895-1002.jpg not downloaded yet
2025-12-03 10:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2443557-4005940-1003.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2443557-4005940-1003.jpg not downloaded yet
2025-12-03 10:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2590049-4005895-1003.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2590049-4005895-1003.jpg not downloaded yet
2025-12-03 10:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2443557-4005940-1004.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2443557-4005940-1004.jpg not downloaded yet
2025-12-03 10:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2590049-4005895-1004.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2590049-4005895-1004.jpg not downloaded yet
2025-12-03 10:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2443557-4005940-1005.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2443557-4005940-1005.jpg not downloaded yet
2025-12-03 10:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2590049-4005895-1005.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2590049-4005895-1005.jpg not downloaded yet
2025-12-03 10:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2590049-4005895-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002590049-01989186-003.pdf)
2025-12-03 10:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2443557-4005940-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002443557-01988504-001.pdf)
2025-12-03 10:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2590049-4005895-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002590049-01989186-003.pdf)
2025-12-03 10:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2590049-4005895-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002590049-01989186-003.pdf)
2025-12-03 10:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2443557-4005940-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002443557-01988504-001.pdf)
2025-12-03 10:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2443557-4005940-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002443557-01988504-001.pdf)
2025-12-03 10:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2590049-4005895-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002590049-01989186-003.pdf)
2025-12-03 10:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2443557-4005940-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002443557-01988504-001.pdf)
2025-12-03 10:02:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa277063d50>
2025-12-03 10:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 10:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc2682fe-56ca-516e-bc52-bfedae204133/fc2682fe-56ca-516e-bc52-bfedae204133_image_17.jpg HTTP/1.1" 201 0
2025-12-03 10:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2590049-4005895-1003.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2590049-4005895-1003.jpg saved to cache
2025-12-03 10:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item fc2682fe-56ca-516e-bc52-bfedae204133
2025-12-03 10:02:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa276aa6c10>
2025-12-03 10:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 10:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_16.jpg HTTP/1.1" 201 0
2025-12-03 10:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2443557-4005940-1002.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2443557-4005940-1002.jpg saved to cache
2025-12-03 10:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item e9a11238-6fab-52cc-a442-64773473b1b4
2025-12-03 10:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2443557-4005940-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002443557-01988504-001.pdf)
2025-12-03 10:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2590049-4005895-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002590049-01989186-003.pdf)
2025-12-03 10:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2590049-4005895-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002590049-01989186-003.pdf)
2025-12-03 10:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2443557-4005940-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002443557-01988504-001.pdf)
2025-12-03 10:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2590049-4005895-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002590049-01989186-003.pdf)
2025-12-03 10:02:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa2770b4450>
2025-12-03 10:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 10:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc2682fe-56ca-516e-bc52-bfedae204133/fc2682fe-56ca-516e-bc52-bfedae204133_image_19.jpg HTTP/1.1" 201 0
2025-12-03 10:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2590049-4005895-1005.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2590049-4005895-1005.jpg saved to cache
2025-12-03 10:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item fc2682fe-56ca-516e-bc52-bfedae204133
2025-12-03 10:02:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa2761e4ed0>
2025-12-03 10:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 10:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc2682fe-56ca-516e-bc52-bfedae204133/fc2682fe-56ca-516e-bc52-bfedae204133_image_18.jpg HTTP/1.1" 201 0
2025-12-03 10:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2590049-4005895-1004.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2590049-4005895-1004.jpg saved to cache
2025-12-03 10:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item fc2682fe-56ca-516e-bc52-bfedae204133
2025-12-03 10:02:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa277062490>
2025-12-03 10:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 10:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_18.jpg HTTP/1.1" 201 0
2025-12-03 10:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2443557-4005940-1004.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2443557-4005940-1004.jpg saved to cache
2025-12-03 10:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item e9a11238-6fab-52cc-a442-64773473b1b4
2025-12-03 10:02:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa276fd3790>
2025-12-03 10:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 10:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_17.jpg HTTP/1.1" 201 0
2025-12-03 10:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2443557-4005940-1003.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2443557-4005940-1003.jpg saved to cache
2025-12-03 10:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item e9a11238-6fab-52cc-a442-64773473b1b4
2025-12-03 10:02:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa2761149d0>
2025-12-03 10:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 10:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc2682fe-56ca-516e-bc52-bfedae204133/fc2682fe-56ca-516e-bc52-bfedae204133_image_16.jpg HTTP/1.1" 201 0
2025-12-03 10:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2590049-4005895-1002.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2590049-4005895-1002.jpg saved to cache
2025-12-03 10:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item fc2682fe-56ca-516e-bc52-bfedae204133
2025-12-03 10:02:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa27733f790>
2025-12-03 10:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 10:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_19.jpg HTTP/1.1" 201 0
2025-12-03 10:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2443557-4005940-1005.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2443557-4005940-1005.jpg saved to cache
2025-12-03 10:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item e9a11238-6fab-52cc-a442-64773473b1b4
2025-12-03 10:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002443557-01988504-001.pdf)
2025-12-03 10:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2443557-4005940-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002443557-01988504-001.pdf)
2025-12-03 10:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0aa4a40a-15d7-44c3-aec4-626646ac73ea_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002590049-01989186-003.pdf)
2025-12-03 10:02:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa2770d64d0>
2025-12-03 10:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 10:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_15.jpg HTTP/1.1" 201 0
2025-12-03 10:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2443557-4005940-1001.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2443557-4005940-1001.jpg saved to cache
2025-12-03 10:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item e9a11238-6fab-52cc-a442-64773473b1b4
2025-12-03 10:02:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa2770f03d0>
2025-12-03 10:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 10:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc2682fe-56ca-516e-bc52-bfedae204133/fc2682fe-56ca-516e-bc52-bfedae204133_image_14.jpg HTTP/1.1" 201 0
2025-12-03 10:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2590049-4005895-1000.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2590049-4005895-1000.jpg saved to cache
2025-12-03 10:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item fc2682fe-56ca-516e-bc52-bfedae204133
2025-12-03 10:02:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa277491a90>
2025-12-03 10:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 10:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc2682fe-56ca-516e-bc52-bfedae204133/fc2682fe-56ca-516e-bc52-bfedae204133_image_15.jpg HTTP/1.1" 201 0
2025-12-03 10:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2590049-4005895-1001.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2590049-4005895-1001.jpg saved to cache
2025-12-03 10:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item fc2682fe-56ca-516e-bc52-bfedae204133
2025-12-03 10:02:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa277461350>
2025-12-03 10:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 10:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_14.jpg HTTP/1.1" 201 0
2025-12-03 10:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2443557-4005940-1000.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2443557-4005940-1000.jpg saved to cache
2025-12-03 10:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item e9a11238-6fab-52cc-a442-64773473b1b4
2025-12-03 10:02:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa27700ff50>
2025-12-03 10:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 10:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc2682fe-56ca-516e-bc52-bfedae204133/fc2682fe-56ca-516e-bc52-bfedae204133_image_13.jpg HTTP/1.1" 201 0
2025-12-03 10:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2590049-4005895-13.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2590049-4005895-13.jpg saved to cache
2025-12-03 10:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item fc2682fe-56ca-516e-bc52-bfedae204133
2025-12-03 10:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0aa4a40a-15d7-44c3-aec4-626646ac73ea_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002590049-01989186-003.pdf)
2025-12-03 10:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002443557-01988504-001.pdf)
2025-12-03 10:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0aa4a40a-15d7-44c3-aec4-626646ac73ea_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002590049-01989186-003.pdf)
2025-12-03 10:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002443557-01988504-001.pdf)
2025-12-03 10:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0aa4a40a-15d7-44c3-aec4-626646ac73ea_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002590049-01989186-003.pdf)
2025-12-03 10:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002443557-01988504-001.pdf)
2025-12-03 10:02:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa277054910>
2025-12-03 10:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 10:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_12.jpg HTTP/1.1" 201 0
2025-12-03 10:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdee9f423-3183-474e-a5c4-fb85328bfdb7_ext_4.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_ext_4.jpg saved to cache
2025-12-03 10:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item e9a11238-6fab-52cc-a442-64773473b1b4
2025-12-03 10:02:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa27721a790>
2025-12-03 10:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 10:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_13.jpg HTTP/1.1" 201 0
2025-12-03 10:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2443557-4005940-13.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2443557-4005940-13.jpg saved to cache
2025-12-03 10:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item e9a11238-6fab-52cc-a442-64773473b1b4
2025-12-03 10:02:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa277472250>
2025-12-03 10:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 10:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc2682fe-56ca-516e-bc52-bfedae204133/fc2682fe-56ca-516e-bc52-bfedae204133_image_12.jpg HTTP/1.1" 201 0
2025-12-03 10:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0aa4a40a-15d7-44c3-aec4-626646ac73ea_ext_4.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0aa4a40a-15d7-44c3-aec4-626646ac73ea_ext_4.jpg saved to cache
2025-12-03 10:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item fc2682fe-56ca-516e-bc52-bfedae204133
2025-12-03 10:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002443557-01988504-001.pdf)
2025-12-03 10:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0aa4a40a-15d7-44c3-aec4-626646ac73ea_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002590049-01989186-003.pdf)
2025-12-03 10:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002443557-01988504-001.pdf)
2025-12-03 10:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0aa4a40a-15d7-44c3-aec4-626646ac73ea_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002590049-01989186-003.pdf)
2025-12-03 10:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0aa4a40a-15d7-44c3-aec4-626646ac73ea_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002590049-01989186-003.pdf)
2025-12-03 10:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002443557-01988504-001.pdf)
2025-12-03 10:02:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa276faac50>
2025-12-03 10:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 10:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc2682fe-56ca-516e-bc52-bfedae204133/fc2682fe-56ca-516e-bc52-bfedae204133_image_11.jpg HTTP/1.1" 201 0
2025-12-03 10:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0aa4a40a-15d7-44c3-aec4-626646ac73ea_ext_3.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0aa4a40a-15d7-44c3-aec4-626646ac73ea_ext_3.jpg saved to cache
2025-12-03 10:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item fc2682fe-56ca-516e-bc52-bfedae204133
2025-12-03 10:02:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa27706d450>
2025-12-03 10:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 10:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_11.jpg HTTP/1.1" 201 0
2025-12-03 10:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdee9f423-3183-474e-a5c4-fb85328bfdb7_ext_3.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_ext_3.jpg saved to cache
2025-12-03 10:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item e9a11238-6fab-52cc-a442-64773473b1b4
2025-12-03 10:02:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa27736bfd0>
2025-12-03 10:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 10:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc2682fe-56ca-516e-bc52-bfedae204133/fc2682fe-56ca-516e-bc52-bfedae204133_image_8.jpg HTTP/1.1" 201 0
2025-12-03 10:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0aa4a40a-15d7-44c3-aec4-626646ac73ea_9.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0aa4a40a-15d7-44c3-aec4-626646ac73ea_9.jpg saved to cache
2025-12-03 10:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fc2682fe-56ca-516e-bc52-bfedae204133
2025-12-03 10:02:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa27706c210>
2025-12-03 10:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 10:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_8.jpg HTTP/1.1" 201 0
2025-12-03 10:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdee9f423-3183-474e-a5c4-fb85328bfdb7_9.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_9.jpg saved to cache
2025-12-03 10:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e9a11238-6fab-52cc-a442-64773473b1b4
2025-12-03 10:02:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa27612d450>
2025-12-03 10:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 10:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc2682fe-56ca-516e-bc52-bfedae204133/fc2682fe-56ca-516e-bc52-bfedae204133_image_9.jpg HTTP/1.1" 201 0
2025-12-03 10:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0aa4a40a-15d7-44c3-aec4-626646ac73ea_ext_2.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0aa4a40a-15d7-44c3-aec4-626646ac73ea_ext_2.jpg saved to cache
2025-12-03 10:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fc2682fe-56ca-516e-bc52-bfedae204133
2025-12-03 10:02:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa276f8a0d0>
2025-12-03 10:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 10:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_9.jpg HTTP/1.1" 201 0
2025-12-03 10:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdee9f423-3183-474e-a5c4-fb85328bfdb7_ext_2.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_ext_2.jpg saved to cache
2025-12-03 10:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e9a11238-6fab-52cc-a442-64773473b1b4
2025-12-03 10:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002443557-01988504-001.pdf)
2025-12-03 10:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0aa4a40a-15d7-44c3-aec4-626646ac73ea_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002590049-01989186-003.pdf)
2025-12-03 10:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002443557-01988504-001.pdf)
2025-12-03 10:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0aa4a40a-15d7-44c3-aec4-626646ac73ea_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002590049-01989186-003.pdf)
2025-12-03 10:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002443557-01988504-001.pdf)
2025-12-03 10:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0aa4a40a-15d7-44c3-aec4-626646ac73ea_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002590049-01989186-003.pdf)
2025-12-03 10:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0aa4a40a-15d7-44c3-aec4-626646ac73ea_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002590049-01989186-003.pdf)
2025-12-03 10:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002443557-01988504-001.pdf)
2025-12-03 10:02:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa2761bd5d0>
2025-12-03 10:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 10:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_10.jpg HTTP/1.1" 201 0
2025-12-03 10:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdee9f423-3183-474e-a5c4-fb85328bfdb7_ext_5.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_ext_5.jpg saved to cache
2025-12-03 10:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item e9a11238-6fab-52cc-a442-64773473b1b4
2025-12-03 10:02:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa276147650>
2025-12-03 10:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 10:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc2682fe-56ca-516e-bc52-bfedae204133/fc2682fe-56ca-516e-bc52-bfedae204133_image_10.jpg HTTP/1.1" 201 0
2025-12-03 10:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0aa4a40a-15d7-44c3-aec4-626646ac73ea_ext_5.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0aa4a40a-15d7-44c3-aec4-626646ac73ea_ext_5.jpg saved to cache
2025-12-03 10:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item fc2682fe-56ca-516e-bc52-bfedae204133
2025-12-03 10:02:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa277113850>
2025-12-03 10:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 10:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_7.jpg HTTP/1.1" 201 0
2025-12-03 10:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdee9f423-3183-474e-a5c4-fb85328bfdb7_10.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_10.jpg saved to cache
2025-12-03 10:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e9a11238-6fab-52cc-a442-64773473b1b4
2025-12-03 10:02:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa2774f0190>
2025-12-03 10:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 10:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc2682fe-56ca-516e-bc52-bfedae204133/fc2682fe-56ca-516e-bc52-bfedae204133_image_7.jpg HTTP/1.1" 201 0
2025-12-03 10:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0aa4a40a-15d7-44c3-aec4-626646ac73ea_10.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0aa4a40a-15d7-44c3-aec4-626646ac73ea_10.jpg saved to cache
2025-12-03 10:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fc2682fe-56ca-516e-bc52-bfedae204133
2025-12-03 10:02:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa276146ed0>
2025-12-03 10:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 10:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc2682fe-56ca-516e-bc52-bfedae204133/fc2682fe-56ca-516e-bc52-bfedae204133_image_6.jpg HTTP/1.1" 201 0
2025-12-03 10:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0aa4a40a-15d7-44c3-aec4-626646ac73ea_11.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0aa4a40a-15d7-44c3-aec4-626646ac73ea_11.jpg saved to cache
2025-12-03 10:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fc2682fe-56ca-516e-bc52-bfedae204133
2025-12-03 10:02:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa276f68b50>
2025-12-03 10:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 10:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_6.jpg HTTP/1.1" 201 0
2025-12-03 10:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdee9f423-3183-474e-a5c4-fb85328bfdb7_11.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_11.jpg saved to cache
2025-12-03 10:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e9a11238-6fab-52cc-a442-64773473b1b4
2025-12-03 10:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0aa4a40a-15d7-44c3-aec4-626646ac73ea_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002590049-01989186-003.pdf)
2025-12-03 10:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002443557-01988504-001.pdf)
2025-12-03 10:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0aa4a40a-15d7-44c3-aec4-626646ac73ea_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002590049-01989186-003.pdf)
2025-12-03 10:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002443557-01988504-001.pdf)
2025-12-03 10:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2492073-4005807-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002492073-01990231-002.pdf)
2025-12-03 10:02:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa276f93a90>
2025-12-03 10:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 10:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_4.jpg HTTP/1.1" 201 0
2025-12-03 10:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdee9f423-3183-474e-a5c4-fb85328bfdb7_5.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_5.jpg saved to cache
2025-12-03 10:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e9a11238-6fab-52cc-a442-64773473b1b4
2025-12-03 10:02:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa2770b3810>
2025-12-03 10:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 10:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc2682fe-56ca-516e-bc52-bfedae204133/fc2682fe-56ca-516e-bc52-bfedae204133_image_4.jpg HTTP/1.1" 201 0
2025-12-03 10:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0aa4a40a-15d7-44c3-aec4-626646ac73ea_5.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0aa4a40a-15d7-44c3-aec4-626646ac73ea_5.jpg saved to cache
2025-12-03 10:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fc2682fe-56ca-516e-bc52-bfedae204133
2025-12-03 10:02:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa276ae8990>
2025-12-03 10:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 10:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_5.jpg HTTP/1.1" 201 0
2025-12-03 10:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdee9f423-3183-474e-a5c4-fb85328bfdb7_4.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_4.jpg saved to cache
2025-12-03 10:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e9a11238-6fab-52cc-a442-64773473b1b4
2025-12-03 10:02:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa27709f350>
2025-12-03 10:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 10:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc2682fe-56ca-516e-bc52-bfedae204133/fc2682fe-56ca-516e-bc52-bfedae204133_image_5.jpg HTTP/1.1" 201 0
2025-12-03 10:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0aa4a40a-15d7-44c3-aec4-626646ac73ea_4.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0aa4a40a-15d7-44c3-aec4-626646ac73ea_4.jpg saved to cache
2025-12-03 10:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fc2682fe-56ca-516e-bc52-bfedae204133
2025-12-03 10:02:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa2770bcc10>
2025-12-03 10:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 10:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_3.jpg HTTP/1.1" 201 0
2025-12-03 10:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdee9f423-3183-474e-a5c4-fb85328bfdb7_ext_1.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_ext_1.jpg saved to cache
2025-12-03 10:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e9a11238-6fab-52cc-a442-64773473b1b4
2025-12-03 10:02:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa276a8b050>
2025-12-03 10:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 10:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc2682fe-56ca-516e-bc52-bfedae204133/fc2682fe-56ca-516e-bc52-bfedae204133_image_3.jpg HTTP/1.1" 201 0
2025-12-03 10:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0aa4a40a-15d7-44c3-aec4-626646ac73ea_ext_1.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0aa4a40a-15d7-44c3-aec4-626646ac73ea_ext_1.jpg saved to cache
2025-12-03 10:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fc2682fe-56ca-516e-bc52-bfedae204133
2025-12-03 10:02:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa276f90310>
2025-12-03 10:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:02:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 10:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc2682fe-56ca-516e-bc52-bfedae204133/fc2682fe-56ca-516e-bc52-bfedae204133_image_2.jpg HTTP/1.1" 201 0
2025-12-03 10:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0aa4a40a-15d7-44c3-aec4-626646ac73ea_ext_6.jpg') HTTP/1.1" 204 0
2025-12-03 10:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0aa4a40a-15d7-44c3-aec4-626646ac73ea_ext_6.jpg saved to cache
2025-12-03 10:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fc2682fe-56ca-516e-bc52-bfedae204133
2025-12-03 10:02:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:02:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa277026950>
2025-12-03 10:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:03:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 10:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_2.jpg HTTP/1.1" 201 0
2025-12-03 10:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdee9f423-3183-474e-a5c4-fb85328bfdb7_ext_6.jpg') HTTP/1.1" 204 0
2025-12-03 10:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_ext_6.jpg saved to cache
2025-12-03 10:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e9a11238-6fab-52cc-a442-64773473b1b4
2025-12-03 10:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/PEUGEOT/2008?id=3017186&returnUrl=%2Fsearch%3FPage%3D3%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233017186&indx=200> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 10:03:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:03:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa2771a3fd0>
2025-12-03 10:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:03:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 10:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc2682fe-56ca-516e-bc52-bfedae204133/fc2682fe-56ca-516e-bc52-bfedae204133_image_0.jpg HTTP/1.1" 201 0
2025-12-03 10:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0aa4a40a-15d7-44c3-aec4-626646ac73ea_ext_7.jpg') HTTP/1.1" 204 0
2025-12-03 10:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0aa4a40a-15d7-44c3-aec4-626646ac73ea_ext_7.jpg saved to cache
2025-12-03 10:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fc2682fe-56ca-516e-bc52-bfedae204133
2025-12-03 10:03:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:03:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa276fabf50>
2025-12-03 10:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:03:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 10:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_0.jpg HTTP/1.1" 201 0
2025-12-03 10:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdee9f423-3183-474e-a5c4-fb85328bfdb7_ext_7.jpg') HTTP/1.1" 204 0
2025-12-03 10:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_ext_7.jpg saved to cache
2025-12-03 10:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e9a11238-6fab-52cc-a442-64773473b1b4
2025-12-03 10:03:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:03:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa276aa0c10>
2025-12-03 10:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:03:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 10:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc2682fe-56ca-516e-bc52-bfedae204133/fc2682fe-56ca-516e-bc52-bfedae204133_image_1.jpg HTTP/1.1" 201 0
2025-12-03 10:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0aa4a40a-15d7-44c3-aec4-626646ac73ea_ext_7.jpg') HTTP/1.1" 204 0
2025-12-03 10:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0aa4a40a-15d7-44c3-aec4-626646ac73ea_ext_7.jpg saved to cache
2025-12-03 10:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fc2682fe-56ca-516e-bc52-bfedae204133
2025-12-03 10:03:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fc2682fe-56ca-516e-bc52-bfedae204133, skipping ID generation
2025-12-03 10:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Removing item fc2682fe-56ca-516e-bc52-bfedae204133 from tracking dictionaries
2025-12-03 10:03:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fc2682fe-56ca-516e-bc52-bfedae204133 sending to next pipeline
2025-12-03 10:03:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: fc2682fe-56ca-516e-bc52-bfedae204133, identifier: 2590049
2025-12-03 10:03:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:03:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa277248210>
2025-12-03 10:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:03:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 10:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:03:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_1.jpg HTTP/1.1" 201 0
2025-12-03 10:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fdee9f423-3183-474e-a5c4-fb85328bfdb7_ext_7.jpg') HTTP/1.1" 204 0
2025-12-03 10:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_ext_7.jpg saved to cache
2025-12-03 10:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e9a11238-6fab-52cc-a442-64773473b1b4
2025-12-03 10:03:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e9a11238-6fab-52cc-a442-64773473b1b4, skipping ID generation
2025-12-03 10:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e9a11238-6fab-52cc-a442-64773473b1b4 from tracking dictionaries
2025-12-03 10:03:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e9a11238-6fab-52cc-a442-64773473b1b4 sending to next pipeline
2025-12-03 10:03:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: e9a11238-6fab-52cc-a442-64773473b1b4, identifier: 2443557
2025-12-03 10:03:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:03:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:03:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:03:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa27728ae50>
2025-12-03 10:03:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:03:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 10:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:03:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ce25d2b-dcfb-56ac-81f0-cbc5540866a4/8ce25d2b-dcfb-56ac-81f0-cbc5540866a4_image_19.jpg HTTP/1.1" 201 0
2025-12-03 10:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2492073-4005807-1005.jpg') HTTP/1.1" 204 0
2025-12-03 10:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2492073-4005807-1005.jpg saved to cache
2025-12-03 10:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 8ce25d2b-dcfb-56ac-81f0-cbc5540866a4
2025-12-03 10:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2492073-4005807-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002492073-01990231-002.pdf)
2025-12-03 10:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2492073-4005807-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002492073-01990231-002.pdf)
2025-12-03 10:03:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: fc2682fe-56ca-516e-bc52-bfedae204133 with identifier: 2590049
2025-12-03 10:03:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: fc2682fe-56ca-516e-bc52-bfedae204133 with identifier: 2590049
2025-12-03 10:03:02 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 194364 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    194364
2025-12-03 10:03:02 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: fc2682fe-56ca-516e-bc52-bfedae204133 spider: manheim.gb
2025-12-03 10:03:02 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: fc2682fe-56ca-516e-bc52-bfedae204133 due to rule: high_mileage_for_country.json, error: 194364 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    194364
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc2682fe-56ca-516e-bc52-bfedae204133/fc2682fe-56ca-516e-bc52-bfedae204133_expert_report_file_561fdc5e-b7a3-4943-80a9-0b751f9aa823.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002590049-01989186-003.pdf',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '1.5L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'fc2682fe-56ca-516e-bc52-bfedae204133',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'K800CNH',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/A%20CLASS?id=2590049',
 'listing': 'auction',
 'location': 'Leeds',
 'make': 'MERCEDES-BENZ',
 'model': 'A CLASS',
 'odometer': 120773,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 30,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc2682fe-56ca-516e-bc52-bfedae204133/fc2682fe-56ca-516e-bc52-bfedae204133_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 192243,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0aa4a40a-15d7-44c3-aec4-626646ac73ea_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc2682fe-56ca-516e-bc52-bfedae204133/fc2682fe-56ca-516e-bc52-bfedae204133_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 192243,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0aa4a40a-15d7-44c3-aec4-626646ac73ea_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc2682fe-56ca-516e-bc52-bfedae204133/fc2682fe-56ca-516e-bc52-bfedae204133_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 241227,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0aa4a40a-15d7-44c3-aec4-626646ac73ea_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc2682fe-56ca-516e-bc52-bfedae204133/fc2682fe-56ca-516e-bc52-bfedae204133_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 173790,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0aa4a40a-15d7-44c3-aec4-626646ac73ea_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc2682fe-56ca-516e-bc52-bfedae204133/fc2682fe-56ca-516e-bc52-bfedae204133_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 168522,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0aa4a40a-15d7-44c3-aec4-626646ac73ea_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc2682fe-56ca-516e-bc52-bfedae204133/fc2682fe-56ca-516e-bc52-bfedae204133_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 186211,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0aa4a40a-15d7-44c3-aec4-626646ac73ea_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc2682fe-56ca-516e-bc52-bfedae204133/fc2682fe-56ca-516e-bc52-bfedae204133_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 162860,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0aa4a40a-15d7-44c3-aec4-626646ac73ea_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc2682fe-56ca-516e-bc52-bfedae204133/fc2682fe-56ca-516e-bc52-bfedae204133_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 171982,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0aa4a40a-15d7-44c3-aec4-626646ac73ea_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc2682fe-56ca-516e-bc52-bfedae204133/fc2682fe-56ca-516e-bc52-bfedae204133_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 184061,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0aa4a40a-15d7-44c3-aec4-626646ac73ea_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc2682fe-56ca-516e-bc52-bfedae204133/fc2682fe-56ca-516e-bc52-bfedae204133_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 207870,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0aa4a40a-15d7-44c3-aec4-626646ac73ea_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc2682fe-56ca-516e-bc52-bfedae204133/fc2682fe-56ca-516e-bc52-bfedae204133_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 263941,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0aa4a40a-15d7-44c3-aec4-626646ac73ea_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc2682fe-56ca-516e-bc52-bfedae204133/fc2682fe-56ca-516e-bc52-bfedae204133_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 265577,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0aa4a40a-15d7-44c3-aec4-626646ac73ea_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc2682fe-56ca-516e-bc52-bfedae204133/fc2682fe-56ca-516e-bc52-bfedae204133_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 320600,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0aa4a40a-15d7-44c3-aec4-626646ac73ea_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc2682fe-56ca-516e-bc52-bfedae204133/fc2682fe-56ca-516e-bc52-bfedae204133_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 228861,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2590049-4005895-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc2682fe-56ca-516e-bc52-bfedae204133/fc2682fe-56ca-516e-bc52-bfedae204133_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 190816,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2590049-4005895-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc2682fe-56ca-516e-bc52-bfedae204133/fc2682fe-56ca-516e-bc52-bfedae204133_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 213593,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2590049-4005895-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc2682fe-56ca-516e-bc52-bfedae204133/fc2682fe-56ca-516e-bc52-bfedae204133_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 273338,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2590049-4005895-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc2682fe-56ca-516e-bc52-bfedae204133/fc2682fe-56ca-516e-bc52-bfedae204133_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 173807,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2590049-4005895-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc2682fe-56ca-516e-bc52-bfedae204133/fc2682fe-56ca-516e-bc52-bfedae204133_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 150872,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2590049-4005895-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc2682fe-56ca-516e-bc52-bfedae204133/fc2682fe-56ca-516e-bc52-bfedae204133_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98251,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2590049-4005895-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-30',
 'seller_name': 'Big Motoring World Ltd',
 'title': 'MERCEDES-BENZ A CLASS A180d AMG Line 5dr',
 'transmission': 'manual',
 'trim': 'A180d AMG Line 5dr',
 'year': 2017}
2025-12-03 10:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272590049%27 HTTP/1.1" 200 None
2025-12-03 10:03:02 [manheim.gb] INFO: Saving data for 2590049: {'created_time': 1764756182.853128, 'last_price_update_time': 1764756182.853138, 'auction_closing_time': 1765184400.0}
2025-12-03 10:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2590049') HTTP/1.1" 204 0
2025-12-03 10:03:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: e9a11238-6fab-52cc-a442-64773473b1b4 with identifier: 2443557
2025-12-03 10:03:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: e9a11238-6fab-52cc-a442-64773473b1b4 with identifier: 2443557
2025-12-03 10:03:03 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 35, 'seller_name': 'sytner', 'price_includes_vat': False, 'title': 'mercedes-benz a class a180d se executive 5dr', 'price': 0, 'currency': 'gbp', 'make': 'mercedes-benz', 'model': 'a class', 'transmission': 'manual', 'engine': '1.5l', 'fuel_type': 'diesel', 'odometer': 148524, 'odometer_reading_unit': 'mi', 'registration_date': '2017-06-14', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/mercedes-benz/a%20class?id=2443557', 'location': 'leeds', 'origin_country_code': 'gb', 'trim': 'a180d se executive 5dr', 'license_plate': 'pj17vjp', 'year': 2017, 'listing': 'auction', 'c_o_2_emission_value': 89, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002443557-01988504-001.pdf', 'expiration_date': '2025-12-04t09:00:00z', 'is_vat_deductible': True, 'is_vat_included': False, 'id': 'e9a11238-6fab-52cc-a442-64773473b1b4', 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_expert_report_file_46175b41-9ecf-4698-bd09-60e7614c4d9b.pdf', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_0.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_ext_7.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 185119}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_1.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_ext_7.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 185119}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_2.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_ext_6.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 218888}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_3.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_ext_1.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 151175}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_4.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 165235}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_5.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 178796}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_6.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_11.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 154151}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_7.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_10.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 175370}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_8.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_9.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 169242}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_9.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_ext_2.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 250211}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_10.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_ext_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 282087}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_11.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_ext_3.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 286428}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_12.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_ext_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 197055}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_13.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2443557-4005940-13.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 328352}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_14.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2443557-4005940-1000.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 231598}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_15.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2443557-4005940-1001.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 168642}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_16.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2443557-4005940-1002.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 213543}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_17.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2443557-4005940-1003.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 391605}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_18.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2443557-4005940-1004.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 166795}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_19.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2443557-4005940-1005.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 315068}], 'current_year_diff': 8, 'age_in_months': 101, 'make_model': 'mercedes-benz a class', 'sanitized_make': 'mercedesbenz', 'odometer_in_km': 239025}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 101,
     'auction_title': '',
     'c_o_2_emission_value': 89,
     'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_expert_report_file_46175b41-9ecf-4698-bd09-60e7614c4d9b.pdf',
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002443557-01988504-001.pdf',
     'color': 'white',
     'currency': 'gbp',
     'current_year_diff': 8,
     'engine': '1.5l',
     'expiration_date': '2025-12-04t09:00:00z',
     'fuel_type': 'diesel',
     'id': 'e9a11238-6fab-52cc-a442-64773473b1b4',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'pj17vjp',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/mercedes-benz/a%20class?id=2443557',
     'listing': 'auction',
     'location': 'leeds',
     'make': 'mercedes-benz',
     'make_model': 'mercedes-benz a class',
     'model': 'a class',
     'odometer': 148524,
     'odometer_in_km': 239025,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 35,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 185119,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_ext_7.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 185119,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_ext_7.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 218888,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_ext_6.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 151175,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_ext_1.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 165235,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_5.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 178796,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_4.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 154151,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_11.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 175370,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_10.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 169242,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_9.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 250211,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_ext_2.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 282087,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_ext_5.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 286428,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_ext_3.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 197055,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_ext_4.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 328352,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2443557-4005940-13.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 231598,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2443557-4005940-1000.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_15.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 168642,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2443557-4005940-1001.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_16.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 213543,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2443557-4005940-1002.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_17.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 391605,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2443557-4005940-1003.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_18.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 166795,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2443557-4005940-1004.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_19.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 315068,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2443557-4005940-1005.jpg',
                 'Width': 1333}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2017-06-14',
     'sanitized_make': 'mercedesbenz',
     'seller_name': 'sytner',
     'title': 'mercedes-benz a class a180d se executive 5dr',
     'transmission': 'manual',
     'trim': 'a180d se executive 5dr',
     'year': 2017}
2025-12-03 10:03:03 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: e9a11238-6fab-52cc-a442-64773473b1b4 spider: manheim.gb
2025-12-03 10:03:03 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: e9a11238-6fab-52cc-a442-64773473b1b4 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 35, 'seller_name': 'sytner', 'price_includes_vat': False, 'title': 'mercedes-benz a class a180d se executive 5dr', 'price': 0, 'currency': 'gbp', 'make': 'mercedes-benz', 'model': 'a class', 'transmission': 'manual', 'engine': '1.5l', 'fuel_type': 'diesel', 'odometer': 148524, 'odometer_reading_unit': 'mi', 'registration_date': '2017-06-14', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/mercedes-benz/a%20class?id=2443557', 'location': 'leeds', 'origin_country_code': 'gb', 'trim': 'a180d se executive 5dr', 'license_plate': 'pj17vjp', 'year': 2017, 'listing': 'auction', 'c_o_2_emission_value': 89, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002443557-01988504-001.pdf', 'expiration_date': '2025-12-04t09:00:00z', 'is_vat_deductible': True, 'is_vat_included': False, 'id': 'e9a11238-6fab-52cc-a442-64773473b1b4', 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_expert_report_file_46175b41-9ecf-4698-bd09-60e7614c4d9b.pdf', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_0.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_ext_7.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 185119}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_1.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_ext_7.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 185119}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_2.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_ext_6.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 218888}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_3.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_ext_1.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 151175}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_4.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 165235}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_5.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 178796}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_6.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_11.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 154151}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_7.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_10.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 175370}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_8.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_9.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 169242}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_9.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_ext_2.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 250211}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_10.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_ext_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 282087}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_11.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_ext_3.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 286428}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_12.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_ext_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 197055}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_13.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2443557-4005940-13.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 328352}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_14.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2443557-4005940-1000.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 231598}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_15.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2443557-4005940-1001.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 168642}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_16.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2443557-4005940-1002.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 213543}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_17.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2443557-4005940-1003.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 391605}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_18.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2443557-4005940-1004.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 166795}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_19.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2443557-4005940-1005.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 315068}], 'current_year_diff': 8, 'age_in_months': 101, 'make_model': 'mercedes-benz a class', 'sanitized_make': 'mercedesbenz', 'odometer_in_km': 239025}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 101,
     'auction_title': '',
     'c_o_2_emission_value': 89,
     'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_expert_report_file_46175b41-9ecf-4698-bd09-60e7614c4d9b.pdf',
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002443557-01988504-001.pdf',
     'color': 'white',
     'currency': 'gbp',
     'current_year_diff': 8,
     'engine': '1.5l',
     'expiration_date': '2025-12-04t09:00:00z',
     'fuel_type': 'diesel',
     'id': 'e9a11238-6fab-52cc-a442-64773473b1b4',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'pj17vjp',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/mercedes-benz/a%20class?id=2443557',
     'listing': 'auction',
     'location': 'leeds',
     'make': 'mercedes-benz',
     'make_model': 'mercedes-benz a class',
     'model': 'a class',
     'odometer': 148524,
     'odometer_in_km': 239025,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 35,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 185119,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_ext_7.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 185119,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_ext_7.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 218888,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_ext_6.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 151175,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_ext_1.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 165235,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_5.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 178796,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_4.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 154151,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_11.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 175370,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_10.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 169242,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_9.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 250211,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_ext_2.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 282087,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_ext_5.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 286428,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_ext_3.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 197055,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_ext_4.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 328352,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2443557-4005940-13.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 231598,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2443557-4005940-1000.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_15.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 168642,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2443557-4005940-1001.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_16.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 213543,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2443557-4005940-1002.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_17.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 391605,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2443557-4005940-1003.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_18.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 166795,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2443557-4005940-1004.jpg',
                 'Width': 1333},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_19.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 315068,
                 'Height': 1000,
                 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2443557-4005940-1005.jpg',
                 'Width': 1333}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2017-06-14',
     'sanitized_make': 'mercedesbenz',
     'seller_name': 'sytner',
     'title': 'mercedes-benz a class a180d se executive 5dr',
     'transmission': 'manual',
     'trim': 'a180d se executive 5dr',
     'year': 2017}
{'auction_title': '',
 'c_o_2_emission_value': 89,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_expert_report_file_46175b41-9ecf-4698-bd09-60e7614c4d9b.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002443557-01988504-001.pdf',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '1.5L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'e9a11238-6fab-52cc-a442-64773473b1b4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'PJ17VJP',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/A%20CLASS?id=2443557',
 'listing': 'auction',
 'location': 'Leeds',
 'make': 'MERCEDES-BENZ',
 'model': 'A CLASS',
 'odometer': 148524,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 35,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 185119,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 185119,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 218888,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 151175,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 165235,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 178796,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 154151,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 175370,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 169242,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 250211,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 282087,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 286428,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 197055,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/dee9f423-3183-474e-a5c4-fb85328bfdb7_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328352,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2443557-4005940-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 231598,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2443557-4005940-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 168642,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2443557-4005940-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 213543,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2443557-4005940-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 391605,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2443557-4005940-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 166795,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2443557-4005940-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9a11238-6fab-52cc-a442-64773473b1b4/e9a11238-6fab-52cc-a442-64773473b1b4_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 315068,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2443557-4005940-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-14',
 'seller_name': 'Sytner',
 'title': 'MERCEDES-BENZ A CLASS A180d SE Executive 5dr',
 'transmission': 'manual',
 'trim': 'A180d SE Executive 5dr',
 'year': 2017}
2025-12-03 10:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272443557%27 HTTP/1.1" 200 None
2025-12-03 10:03:03 [manheim.gb] INFO: Saving data for 2443557: {'created_time': 1764756183.12732, 'last_price_update_time': 1764756183.127331, 'auction_closing_time': 1764838800.0}
2025-12-03 10:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2443557') HTTP/1.1" 204 0
2025-12-03 10:03:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 735dda5c-9a02-59fc-9457-d3988eccaae5 with identifier: 3017186
2025-12-03 10:03:03 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 735dda5c-9a02-59fc-9457-d3988eccaae5
2025-12-03 10:03:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:03:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa27718f650>
2025-12-03 10:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:03:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 10:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ce25d2b-dcfb-56ac-81f0-cbc5540866a4/8ce25d2b-dcfb-56ac-81f0-cbc5540866a4_image_17.jpg HTTP/1.1" 201 0
2025-12-03 10:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2492073-4005807-1003.jpg') HTTP/1.1" 204 0
2025-12-03 10:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2492073-4005807-1003.jpg saved to cache
2025-12-03 10:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 8ce25d2b-dcfb-56ac-81f0-cbc5540866a4
2025-12-03 10:03:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:03:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa276af7e10>
2025-12-03 10:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:03:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 10:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ce25d2b-dcfb-56ac-81f0-cbc5540866a4/8ce25d2b-dcfb-56ac-81f0-cbc5540866a4_image_18.jpg HTTP/1.1" 201 0
2025-12-03 10:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2492073-4005807-1004.jpg') HTTP/1.1" 204 0
2025-12-03 10:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2492073-4005807-1004.jpg saved to cache
2025-12-03 10:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 8ce25d2b-dcfb-56ac-81f0-cbc5540866a4
2025-12-03 10:03:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8ce25d2b-dcfb-56ac-81f0-cbc5540866a4, skipping ID generation
2025-12-03 10:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 8ce25d2b-dcfb-56ac-81f0-cbc5540866a4 from tracking dictionaries
2025-12-03 10:03:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8ce25d2b-dcfb-56ac-81f0-cbc5540866a4 sending to next pipeline
2025-12-03 10:03:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 8ce25d2b-dcfb-56ac-81f0-cbc5540866a4, identifier: 2492073
2025-12-03 10:03:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 8ce25d2b-dcfb-56ac-81f0-cbc5540866a4 with identifier: 2492073
2025-12-03 10:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-03 10:03:04 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=ORANGE HTTP/1.1" 200 None
2025-12-03 10:03:04 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-03 10:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-03 10:03:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 8ce25d2b-dcfb-56ac-81f0-cbc5540866a4 with identifier: 2492073
2025-12-03 10:03:04 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 132139 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    132139
2025-12-03 10:03:04 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 8ce25d2b-dcfb-56ac-81f0-cbc5540866a4 spider: manheim.gb
2025-12-03 10:03:04 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 8ce25d2b-dcfb-56ac-81f0-cbc5540866a4 due to rule: high_mileage_for_make.json, error: 132139 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    132139
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ce25d2b-dcfb-56ac-81f0-cbc5540866a4/8ce25d2b-dcfb-56ac-81f0-cbc5540866a4_expert_report_file_d5b34e28-3a35-4783-9826-c8f8940f31d6.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002492073-01990231-002.pdf',
 'color': 'ORANGE',
 'currency': 'GBP',
 'engine': '1.5L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '8ce25d2b-dcfb-56ac-81f0-cbc5540866a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'DY67CSX',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MINI/HATCHBACK?id=2492073',
 'listing': 'auction',
 'location': 'Bristol',
 'make': 'MINI',
 'model': 'HATCHBACK',
 'odometer': 82108,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 25,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ce25d2b-dcfb-56ac-81f0-cbc5540866a4/8ce25d2b-dcfb-56ac-81f0-cbc5540866a4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 225951,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ce25d2b-dcfb-56ac-81f0-cbc5540866a4/8ce25d2b-dcfb-56ac-81f0-cbc5540866a4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 225951,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ce25d2b-dcfb-56ac-81f0-cbc5540866a4/8ce25d2b-dcfb-56ac-81f0-cbc5540866a4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 199776,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ce25d2b-dcfb-56ac-81f0-cbc5540866a4/8ce25d2b-dcfb-56ac-81f0-cbc5540866a4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 312361,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ce25d2b-dcfb-56ac-81f0-cbc5540866a4/8ce25d2b-dcfb-56ac-81f0-cbc5540866a4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 188723,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ce25d2b-dcfb-56ac-81f0-cbc5540866a4/8ce25d2b-dcfb-56ac-81f0-cbc5540866a4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 189477,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ce25d2b-dcfb-56ac-81f0-cbc5540866a4/8ce25d2b-dcfb-56ac-81f0-cbc5540866a4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 187055,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ce25d2b-dcfb-56ac-81f0-cbc5540866a4/8ce25d2b-dcfb-56ac-81f0-cbc5540866a4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 186713,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ce25d2b-dcfb-56ac-81f0-cbc5540866a4/8ce25d2b-dcfb-56ac-81f0-cbc5540866a4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 159937,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ce25d2b-dcfb-56ac-81f0-cbc5540866a4/8ce25d2b-dcfb-56ac-81f0-cbc5540866a4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 230222,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ce25d2b-dcfb-56ac-81f0-cbc5540866a4/8ce25d2b-dcfb-56ac-81f0-cbc5540866a4_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 186003,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ce25d2b-dcfb-56ac-81f0-cbc5540866a4/8ce25d2b-dcfb-56ac-81f0-cbc5540866a4_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 188900,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ce25d2b-dcfb-56ac-81f0-cbc5540866a4/8ce25d2b-dcfb-56ac-81f0-cbc5540866a4_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 231128,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3dc045f1-538d-4bcb-bc32-a5f88e66c1d1_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ce25d2b-dcfb-56ac-81f0-cbc5540866a4/8ce25d2b-dcfb-56ac-81f0-cbc5540866a4_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 282408,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2492073-4005807-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ce25d2b-dcfb-56ac-81f0-cbc5540866a4/8ce25d2b-dcfb-56ac-81f0-cbc5540866a4_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 321576,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2492073-4005807-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ce25d2b-dcfb-56ac-81f0-cbc5540866a4/8ce25d2b-dcfb-56ac-81f0-cbc5540866a4_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 167939,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2492073-4005807-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ce25d2b-dcfb-56ac-81f0-cbc5540866a4/8ce25d2b-dcfb-56ac-81f0-cbc5540866a4_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 189375,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2492073-4005807-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ce25d2b-dcfb-56ac-81f0-cbc5540866a4/8ce25d2b-dcfb-56ac-81f0-cbc5540866a4_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 154840,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2492073-4005807-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ce25d2b-dcfb-56ac-81f0-cbc5540866a4/8ce25d2b-dcfb-56ac-81f0-cbc5540866a4_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 176645,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2492073-4005807-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ce25d2b-dcfb-56ac-81f0-cbc5540866a4/8ce25d2b-dcfb-56ac-81f0-cbc5540866a4_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 258109,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2492073-4005807-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-08',
 'seller_name': 'Mon Motors',
 'title': 'MINI HATCHBACK 1.5 Cooper 3dr',
 'transmission': 'manual',
 'trim': '1.5 Cooper 3dr',
 'year': 2017}
2025-12-03 10:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272492073%27 HTTP/1.1" 200 None
2025-12-03 10:03:04 [manheim.gb] INFO: Saving data for 2492073: {'created_time': 1764756184.407593, 'last_price_update_time': 1764756184.407604, 'auction_closing_time': 1764838800.0}
2025-12-03 10:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2492073') HTTP/1.1" 204 0
2025-12-03 10:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=2976938&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232976938&indx=197> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 10:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003017186-01988386-005.pdf> (referer: None)
2025-12-03 10:03:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 688868aa-228f-5a4c-af61-ab1f8c51287a with identifier: 2976938
2025-12-03 10:03:04 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 688868aa-228f-5a4c-af61-ab1f8c51287a
2025-12-03 10:03:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:03:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa277499d10>
2025-12-03 10:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:03:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 10:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_735dda5c-9a02-59fc-9457-d3988eccaae5/735dda5c-9a02-59fc-9457-d3988eccaae5_expert_report_file_81c6e962-1ad1-42d9-a26e-6cdec9265bc7.pdf HTTP/1.1" 201 0
2025-12-03 10:03:05 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 735dda5c-9a02-59fc-9457-d3988eccaae5
2025-12-03 10:03:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 735dda5c-9a02-59fc-9457-d3988eccaae5, skipping ID generation
2025-12-03 10:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 735dda5c-9a02-59fc-9457-d3988eccaae5
2025-12-03 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_ext_7.jpg not downloaded yet
2025-12-03 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_ext_7.jpg not downloaded yet
2025-12-03 10:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/FORD/FOCUS?id=3046148&returnUrl=%2Fsearch%3FPage%3D3%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233046148&indx=202> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-03 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_ext_6.jpg not downloaded yet
2025-12-03 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_ext_1.jpg not downloaded yet
2025-12-03 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_5.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_5.jpg not downloaded yet
2025-12-03 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_4.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_4.jpg not downloaded yet
2025-12-03 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_11.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_11.jpg not downloaded yet
2025-12-03 10:03:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e0f346b-7415-543f-b77a-e7cf41a9044a with identifier: 3046148
2025-12-03 10:03:05 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 8e0f346b-7415-543f-b77a-e7cf41a9044a
2025-12-03 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_10.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_10.jpg not downloaded yet
2025-12-03 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_9.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_9.jpg not downloaded yet
2025-12-03 10:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003004217-01989667-002.pdf> (referer: None)
2025-12-03 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_ext_2.jpg not downloaded yet
2025-12-03 10:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003017186-01988386-005.pdf)
2025-12-03 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_ext_5.jpg not downloaded yet
2025-12-03 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_ext_3.jpg not downloaded yet
2025-12-03 10:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003017186-01988386-005.pdf)
2025-12-03 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_ext_4.jpg not downloaded yet
2025-12-03 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3017186-4001924-13.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3017186-4001924-13.jpg not downloaded yet
2025-12-03 10:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003017186-01988386-005.pdf)
2025-12-03 10:03:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:03:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa2771f69d0>
2025-12-03 10:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:03:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 10:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0c54a04-921a-5d40-8011-f4191f63cc27/b0c54a04-921a-5d40-8011-f4191f63cc27_expert_report_file_661ba74f-7553-4c62-954e-747a0774e6d7.pdf HTTP/1.1" 201 0
2025-12-03 10:03:05 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item b0c54a04-921a-5d40-8011-f4191f63cc27
2025-12-03 10:03:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b0c54a04-921a-5d40-8011-f4191f63cc27, skipping ID generation
2025-12-03 10:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item b0c54a04-921a-5d40-8011-f4191f63cc27
2025-12-03 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d70341d-8b2e-43bb-8d34-14045297dce4_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d70341d-8b2e-43bb-8d34-14045297dce4_ext_7.jpg not downloaded yet
2025-12-03 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3017186-4001924-1000.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3017186-4001924-1000.jpg not downloaded yet
2025-12-03 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d70341d-8b2e-43bb-8d34-14045297dce4_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d70341d-8b2e-43bb-8d34-14045297dce4_ext_7.jpg not downloaded yet
2025-12-03 10:03:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:03:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa2761b3fd0>
2025-12-03 10:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:03:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 10:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_735dda5c-9a02-59fc-9457-d3988eccaae5/735dda5c-9a02-59fc-9457-d3988eccaae5_image_0.jpg HTTP/1.1" 201 0
2025-12-03 10:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_ext_7.jpg') HTTP/1.1" 204 0
2025-12-03 10:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_ext_7.jpg saved to cache
2025-12-03 10:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 735dda5c-9a02-59fc-9457-d3988eccaae5
2025-12-03 10:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003017186-01988386-005.pdf)
2025-12-03 10:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3017186-4001924-1001.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3017186-4001924-1001.jpg not downloaded yet
2025-12-03 10:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003017186-01988386-005.pdf)
2025-12-03 10:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003017186-01988386-005.pdf)
2025-12-03 10:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d70341d-8b2e-43bb-8d34-14045297dce4_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d70341d-8b2e-43bb-8d34-14045297dce4_ext_6.jpg not downloaded yet
2025-12-03 10:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003017186-01988386-005.pdf)
2025-12-03 10:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003017186-01988386-005.pdf)
2025-12-03 10:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3017186-4001924-1002.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3017186-4001924-1002.jpg not downloaded yet
2025-12-03 10:03:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:03:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa2774b02d0>
2025-12-03 10:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:03:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 10:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_735dda5c-9a02-59fc-9457-d3988eccaae5/735dda5c-9a02-59fc-9457-d3988eccaae5_image_1.jpg HTTP/1.1" 201 0
2025-12-03 10:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_ext_7.jpg') HTTP/1.1" 204 0
2025-12-03 10:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_ext_7.jpg saved to cache
2025-12-03 10:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 735dda5c-9a02-59fc-9457-d3988eccaae5
2025-12-03 10:03:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:03:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa2788bba90>
2025-12-03 10:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:03:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 10:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_735dda5c-9a02-59fc-9457-d3988eccaae5/735dda5c-9a02-59fc-9457-d3988eccaae5_image_3.jpg HTTP/1.1" 201 0
2025-12-03 10:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_ext_1.jpg') HTTP/1.1" 204 0
2025-12-03 10:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_ext_1.jpg saved to cache
2025-12-03 10:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 735dda5c-9a02-59fc-9457-d3988eccaae5
2025-12-03 10:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d70341d-8b2e-43bb-8d34-14045297dce4_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d70341d-8b2e-43bb-8d34-14045297dce4_ext_1.jpg not downloaded yet
2025-12-03 10:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3017186-4001924-1003.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3017186-4001924-1003.jpg not downloaded yet
2025-12-03 10:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d70341d-8b2e-43bb-8d34-14045297dce4_5.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d70341d-8b2e-43bb-8d34-14045297dce4_5.jpg not downloaded yet
2025-12-03 10:03:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:03:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa277255ad0>
2025-12-03 10:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:03:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 10:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_735dda5c-9a02-59fc-9457-d3988eccaae5/735dda5c-9a02-59fc-9457-d3988eccaae5_image_2.jpg HTTP/1.1" 201 0
2025-12-03 10:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_ext_6.jpg') HTTP/1.1" 204 0
2025-12-03 10:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_ext_6.jpg saved to cache
2025-12-03 10:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 735dda5c-9a02-59fc-9457-d3988eccaae5
2025-12-03 10:03:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:03:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa27701ce90>
2025-12-03 10:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:03:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 10:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_735dda5c-9a02-59fc-9457-d3988eccaae5/735dda5c-9a02-59fc-9457-d3988eccaae5_image_4.jpg HTTP/1.1" 201 0
2025-12-03 10:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_5.jpg') HTTP/1.1" 204 0
2025-12-03 10:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_5.jpg saved to cache
2025-12-03 10:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 735dda5c-9a02-59fc-9457-d3988eccaae5
2025-12-03 10:03:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:03:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa2774faa90>
2025-12-03 10:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:03:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 10:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_735dda5c-9a02-59fc-9457-d3988eccaae5/735dda5c-9a02-59fc-9457-d3988eccaae5_image_5.jpg HTTP/1.1" 201 0
2025-12-03 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_4.jpg') HTTP/1.1" 204 0
2025-12-03 10:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_4.jpg saved to cache
2025-12-03 10:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 735dda5c-9a02-59fc-9457-d3988eccaae5
2025-12-03 10:03:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:03:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa276f68f90>
2025-12-03 10:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:03:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 10:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_735dda5c-9a02-59fc-9457-d3988eccaae5/735dda5c-9a02-59fc-9457-d3988eccaae5_image_6.jpg HTTP/1.1" 201 0
2025-12-03 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_11.jpg') HTTP/1.1" 204 0
2025-12-03 10:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_11.jpg saved to cache
2025-12-03 10:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 735dda5c-9a02-59fc-9457-d3988eccaae5
2025-12-03 10:03:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:03:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa276f90250>
2025-12-03 10:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:03:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 10:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_735dda5c-9a02-59fc-9457-d3988eccaae5/735dda5c-9a02-59fc-9457-d3988eccaae5_image_7.jpg HTTP/1.1" 201 0
2025-12-03 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_10.jpg') HTTP/1.1" 204 0
2025-12-03 10:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_10.jpg saved to cache
2025-12-03 10:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 735dda5c-9a02-59fc-9457-d3988eccaae5
2025-12-03 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3017186-4001924-1004.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3017186-4001924-1004.jpg not downloaded yet
2025-12-03 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d70341d-8b2e-43bb-8d34-14045297dce4_4.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d70341d-8b2e-43bb-8d34-14045297dce4_4.jpg not downloaded yet
2025-12-03 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3017186-4001924-1005.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3017186-4001924-1005.jpg not downloaded yet
2025-12-03 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d70341d-8b2e-43bb-8d34-14045297dce4_11.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d70341d-8b2e-43bb-8d34-14045297dce4_11.jpg not downloaded yet
2025-12-03 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d70341d-8b2e-43bb-8d34-14045297dce4_10.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d70341d-8b2e-43bb-8d34-14045297dce4_10.jpg not downloaded yet
2025-12-03 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d70341d-8b2e-43bb-8d34-14045297dce4_9.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d70341d-8b2e-43bb-8d34-14045297dce4_9.jpg not downloaded yet
2025-12-03 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d70341d-8b2e-43bb-8d34-14045297dce4_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d70341d-8b2e-43bb-8d34-14045297dce4_ext_2.jpg not downloaded yet
2025-12-03 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d70341d-8b2e-43bb-8d34-14045297dce4_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d70341d-8b2e-43bb-8d34-14045297dce4_ext_5.jpg not downloaded yet
2025-12-03 10:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0002976938-01947791-001.pdf> (referer: None)
2025-12-03 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d70341d-8b2e-43bb-8d34-14045297dce4_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d70341d-8b2e-43bb-8d34-14045297dce4_ext_3.jpg not downloaded yet
2025-12-03 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d70341d-8b2e-43bb-8d34-14045297dce4_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d70341d-8b2e-43bb-8d34-14045297dce4_ext_4.jpg not downloaded yet
2025-12-03 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3004217-4005654-13.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3004217-4005654-13.jpg not downloaded yet
2025-12-03 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3004217-4005654-1000.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3004217-4005654-1000.jpg not downloaded yet
2025-12-03 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3004217-4005654-1001.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3004217-4005654-1001.jpg not downloaded yet
2025-12-03 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3004217-4005654-1002.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3004217-4005654-1002.jpg not downloaded yet
2025-12-03 10:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003046148-01980592-004.pdf> (referer: None)
2025-12-03 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3004217-4005654-1003.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3004217-4005654-1003.jpg not downloaded yet
2025-12-03 10:03:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:03:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa2770d4790>
2025-12-03 10:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:03:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 10:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_688868aa-228f-5a4c-af61-ab1f8c51287a/688868aa-228f-5a4c-af61-ab1f8c51287a_expert_report_file_749ac21b-4b07-4158-87c5-e48a052587fe.pdf HTTP/1.1" 201 0
2025-12-03 10:03:09 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 688868aa-228f-5a4c-af61-ab1f8c51287a
2025-12-03 10:03:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 688868aa-228f-5a4c-af61-ab1f8c51287a, skipping ID generation
2025-12-03 10:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 688868aa-228f-5a4c-af61-ab1f8c51287a
2025-12-03 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9575cbdd-7f1e-4688-af19-030ef22f8668_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9575cbdd-7f1e-4688-af19-030ef22f8668_ext_7.jpg already downloaded
2025-12-03 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9575cbdd-7f1e-4688-af19-030ef22f8668_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9575cbdd-7f1e-4688-af19-030ef22f8668_ext_7.jpg already downloaded
2025-12-03 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9575cbdd-7f1e-4688-af19-030ef22f8668_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9575cbdd-7f1e-4688-af19-030ef22f8668_ext_6.jpg already downloaded
2025-12-03 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9575cbdd-7f1e-4688-af19-030ef22f8668_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9575cbdd-7f1e-4688-af19-030ef22f8668_ext_1.jpg already downloaded
2025-12-03 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9575cbdd-7f1e-4688-af19-030ef22f8668_5.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9575cbdd-7f1e-4688-af19-030ef22f8668_5.jpg already downloaded
2025-12-03 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9575cbdd-7f1e-4688-af19-030ef22f8668_4.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9575cbdd-7f1e-4688-af19-030ef22f8668_4.jpg already downloaded
2025-12-03 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9575cbdd-7f1e-4688-af19-030ef22f8668_11.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9575cbdd-7f1e-4688-af19-030ef22f8668_11.jpg already downloaded
2025-12-03 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9575cbdd-7f1e-4688-af19-030ef22f8668_10.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9575cbdd-7f1e-4688-af19-030ef22f8668_10.jpg already downloaded
2025-12-03 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9575cbdd-7f1e-4688-af19-030ef22f8668_9.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9575cbdd-7f1e-4688-af19-030ef22f8668_9.jpg already downloaded
2025-12-03 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9575cbdd-7f1e-4688-af19-030ef22f8668_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9575cbdd-7f1e-4688-af19-030ef22f8668_ext_2.jpg already downloaded
2025-12-03 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9575cbdd-7f1e-4688-af19-030ef22f8668_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9575cbdd-7f1e-4688-af19-030ef22f8668_ext_5.jpg already downloaded
2025-12-03 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9575cbdd-7f1e-4688-af19-030ef22f8668_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9575cbdd-7f1e-4688-af19-030ef22f8668_ext_3.jpg already downloaded
2025-12-03 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9575cbdd-7f1e-4688-af19-030ef22f8668_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9575cbdd-7f1e-4688-af19-030ef22f8668_ext_4.jpg already downloaded
2025-12-03 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2976938-3964917-13.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2976938-3964917-13.jpg already downloaded
2025-12-03 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2976938-3964917-1000.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2976938-3964917-1000.jpg already downloaded
2025-12-03 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2976938-3964917-1001.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2976938-3964917-1001.jpg already downloaded
2025-12-03 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2976938-3964917-1002.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2976938-3964917-1002.jpg already downloaded
2025-12-03 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2976938-3964917-1003.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2976938-3964917-1003.jpg already downloaded
2025-12-03 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2976938-3964917-1004.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2976938-3964917-1004.jpg already downloaded
2025-12-03 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2976938-3964917-1005.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2976938-3964917-1005.jpg already downloaded
2025-12-03 10:03:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 688868aa-228f-5a4c-af61-ab1f8c51287a, identifier: 2976938
2025-12-03 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3004217-4005654-1004.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3004217-4005654-1004.jpg not downloaded yet
2025-12-03 10:03:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 688868aa-228f-5a4c-af61-ab1f8c51287a with identifier: 2976938
2025-12-03 10:03:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 688868aa-228f-5a4c-af61-ab1f8c51287a with identifier: 2976938
2025-12-03 10:03:10 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 164962 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    164962
2025-12-03 10:03:10 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 688868aa-228f-5a4c-af61-ab1f8c51287a spider: manheim.gb
2025-12-03 10:03:10 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 688868aa-228f-5a4c-af61-ab1f8c51287a due to rule: high_mileage_for_country.json, error: 164962 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    164962
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_688868aa-228f-5a4c-af61-ab1f8c51287a/688868aa-228f-5a4c-af61-ab1f8c51287a_expert_report_file_749ac21b-4b07-4158-87c5-e48a052587fe.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002976938-01947791-001.pdf',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '1.3L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '688868aa-228f-5a4c-af61-ab1f8c51287a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'YF69WDY',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=2976938',
 'listing': 'auction',
 'location': 'Leeds',
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 102503,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 30,
 'photo_urls': ['http://images.manheim.co.uk/images/units/zoom/9575cbdd-7f1e-4688-af19-030ef22f8668_ext_7.jpg',
                'http://images.manheim.co.uk/images/units/zoom/9575cbdd-7f1e-4688-af19-030ef22f8668_ext_7.jpg',
                'http://images.manheim.co.uk/images/units/zoom/9575cbdd-7f1e-4688-af19-030ef22f8668_ext_6.jpg',
                'http://images.manheim.co.uk/images/units/zoom/9575cbdd-7f1e-4688-af19-030ef22f8668_ext_1.jpg',
                'http://images.manheim.co.uk/images/units/zoom/9575cbdd-7f1e-4688-af19-030ef22f8668_5.jpg',
                'http://images.manheim.co.uk/images/units/zoom/9575cbdd-7f1e-4688-af19-030ef22f8668_4.jpg',
                'http://images.manheim.co.uk/images/units/zoom/9575cbdd-7f1e-4688-af19-030ef22f8668_11.jpg',
                'http://images.manheim.co.uk/images/units/zoom/9575cbdd-7f1e-4688-af19-030ef22f8668_10.jpg',
                'http://images.manheim.co.uk/images/units/zoom/9575cbdd-7f1e-4688-af19-030ef22f8668_9.jpg',
                'http://images.manheim.co.uk/images/units/zoom/9575cbdd-7f1e-4688-af19-030ef22f8668_ext_2.jpg',
                'http://images.manheim.co.uk/images/units/zoom/9575cbdd-7f1e-4688-af19-030ef22f8668_ext_5.jpg',
                'http://images.manheim.co.uk/images/units/zoom/9575cbdd-7f1e-4688-af19-030ef22f8668_ext_3.jpg',
                'http://images.manheim.co.uk/images/units/zoom/9575cbdd-7f1e-4688-af19-030ef22f8668_ext_4.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-2976938-3964917-13.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-2976938-3964917-1000.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-2976938-3964917-1001.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-2976938-3964917-1002.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-2976938-3964917-1003.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-2976938-3964917-1004.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-2976938-3964917-1005.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_688868aa-228f-5a4c-af61-ab1f8c51287a/688868aa-228f-5a4c-af61-ab1f8c51287a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 189987,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9575cbdd-7f1e-4688-af19-030ef22f8668_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_688868aa-228f-5a4c-af61-ab1f8c51287a/688868aa-228f-5a4c-af61-ab1f8c51287a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 189987,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9575cbdd-7f1e-4688-af19-030ef22f8668_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_688868aa-228f-5a4c-af61-ab1f8c51287a/688868aa-228f-5a4c-af61-ab1f8c51287a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 267088,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9575cbdd-7f1e-4688-af19-030ef22f8668_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_688868aa-228f-5a4c-af61-ab1f8c51287a/688868aa-228f-5a4c-af61-ab1f8c51287a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 201248,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9575cbdd-7f1e-4688-af19-030ef22f8668_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_688868aa-228f-5a4c-af61-ab1f8c51287a/688868aa-228f-5a4c-af61-ab1f8c51287a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 188963,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9575cbdd-7f1e-4688-af19-030ef22f8668_5.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_688868aa-228f-5a4c-af61-ab1f8c51287a/688868aa-228f-5a4c-af61-ab1f8c51287a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 193220,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9575cbdd-7f1e-4688-af19-030ef22f8668_4.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_688868aa-228f-5a4c-af61-ab1f8c51287a/688868aa-228f-5a4c-af61-ab1f8c51287a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 179600,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9575cbdd-7f1e-4688-af19-030ef22f8668_11.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_688868aa-228f-5a4c-af61-ab1f8c51287a/688868aa-228f-5a4c-af61-ab1f8c51287a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 187262,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9575cbdd-7f1e-4688-af19-030ef22f8668_10.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_688868aa-228f-5a4c-af61-ab1f8c51287a/688868aa-228f-5a4c-af61-ab1f8c51287a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 202007,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9575cbdd-7f1e-4688-af19-030ef22f8668_9.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_688868aa-228f-5a4c-af61-ab1f8c51287a/688868aa-228f-5a4c-af61-ab1f8c51287a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 275343,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9575cbdd-7f1e-4688-af19-030ef22f8668_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_688868aa-228f-5a4c-af61-ab1f8c51287a/688868aa-228f-5a4c-af61-ab1f8c51287a_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 229132,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9575cbdd-7f1e-4688-af19-030ef22f8668_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_688868aa-228f-5a4c-af61-ab1f8c51287a/688868aa-228f-5a4c-af61-ab1f8c51287a_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 225452,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9575cbdd-7f1e-4688-af19-030ef22f8668_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_688868aa-228f-5a4c-af61-ab1f8c51287a/688868aa-228f-5a4c-af61-ab1f8c51287a_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 223308,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9575cbdd-7f1e-4688-af19-030ef22f8668_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_688868aa-228f-5a4c-af61-ab1f8c51287a/688868aa-228f-5a4c-af61-ab1f8c51287a_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 242446,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2976938-3964917-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_688868aa-228f-5a4c-af61-ab1f8c51287a/688868aa-228f-5a4c-af61-ab1f8c51287a_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 208880,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2976938-3964917-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_688868aa-228f-5a4c-af61-ab1f8c51287a/688868aa-228f-5a4c-af61-ab1f8c51287a_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 233023,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2976938-3964917-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_688868aa-228f-5a4c-af61-ab1f8c51287a/688868aa-228f-5a4c-af61-ab1f8c51287a_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 204507,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2976938-3964917-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_688868aa-228f-5a4c-af61-ab1f8c51287a/688868aa-228f-5a4c-af61-ab1f8c51287a_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 243297,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2976938-3964917-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_688868aa-228f-5a4c-af61-ab1f8c51287a/688868aa-228f-5a4c-af61-ab1f8c51287a_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 228029,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2976938-3964917-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_688868aa-228f-5a4c-af61-ab1f8c51287a/688868aa-228f-5a4c-af61-ab1f8c51287a_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 220300,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2976938-3964917-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-29',
 'seller_name': 'Mobilize Financial Services',
 'title': 'NISSAN QASHQAI 1.3 DiG-T Acenta Premium 5dr',
 'transmission': 'manual',
 'trim': '1.3 DiG-T Acenta Premium 5dr',
 'year': 2019}
2025-12-03 10:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272976938%27 HTTP/1.1" 200 None
2025-12-03 10:03:10 [manheim.gb] INFO: Saving data for 2976938: {'created_time': 1764756190.256305, 'last_price_update_time': 1764756190.256314, 'auction_closing_time': 1765184400.0}
2025-12-03 10:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2976938') HTTP/1.1" 204 0
2025-12-03 10:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3004217-4005654-1005.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3004217-4005654-1005.jpg not downloaded yet
2025-12-03 10:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0d70341d-8b2e-43bb-8d34-14045297dce4_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003004217-01989667-002.pdf)
2025-12-03 10:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0d70341d-8b2e-43bb-8d34-14045297dce4_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003004217-01989667-002.pdf)
2025-12-03 10:03:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:03:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa276115390>
2025-12-03 10:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:03:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 10:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e0f346b-7415-543f-b77a-e7cf41a9044a/8e0f346b-7415-543f-b77a-e7cf41a9044a_expert_report_file_bc6a500e-3e7f-497b-9c6e-f02f0dd44169.pdf HTTP/1.1" 201 0
2025-12-03 10:03:10 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 8e0f346b-7415-543f-b77a-e7cf41a9044a
2025-12-03 10:03:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8e0f346b-7415-543f-b77a-e7cf41a9044a, skipping ID generation
2025-12-03 10:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 8e0f346b-7415-543f-b77a-e7cf41a9044a
2025-12-03 10:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff9af9736-a54e-48c2-bc4a-41aee3f1875f_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f9af9736-a54e-48c2-bc4a-41aee3f1875f_ext_7.jpg not downloaded yet
2025-12-03 10:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3017186-4001924-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003017186-01988386-005.pdf)
2025-12-03 10:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0d70341d-8b2e-43bb-8d34-14045297dce4_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003004217-01989667-002.pdf)
2025-12-03 10:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0d70341d-8b2e-43bb-8d34-14045297dce4_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003004217-01989667-002.pdf)
2025-12-03 10:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0d70341d-8b2e-43bb-8d34-14045297dce4_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003004217-01989667-002.pdf)
2025-12-03 10:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3017186-4001924-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003017186-01988386-005.pdf)
2025-12-03 10:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff9af9736-a54e-48c2-bc4a-41aee3f1875f_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f9af9736-a54e-48c2-bc4a-41aee3f1875f_ext_7.jpg not downloaded yet
2025-12-03 10:03:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:03:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa2773cc0d0>
2025-12-03 10:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:03:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 10:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0c54a04-921a-5d40-8011-f4191f63cc27/b0c54a04-921a-5d40-8011-f4191f63cc27_image_4.jpg HTTP/1.1" 201 0
2025-12-03 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d70341d-8b2e-43bb-8d34-14045297dce4_5.jpg') HTTP/1.1" 204 0
2025-12-03 10:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d70341d-8b2e-43bb-8d34-14045297dce4_5.jpg saved to cache
2025-12-03 10:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b0c54a04-921a-5d40-8011-f4191f63cc27
2025-12-03 10:03:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:03:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa27731d810>
2025-12-03 10:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:03:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 10:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0c54a04-921a-5d40-8011-f4191f63cc27/b0c54a04-921a-5d40-8011-f4191f63cc27_image_3.jpg HTTP/1.1" 201 0
2025-12-03 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d70341d-8b2e-43bb-8d34-14045297dce4_ext_1.jpg') HTTP/1.1" 204 0
2025-12-03 10:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d70341d-8b2e-43bb-8d34-14045297dce4_ext_1.jpg saved to cache
2025-12-03 10:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b0c54a04-921a-5d40-8011-f4191f63cc27
2025-12-03 10:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3017186-4001924-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003017186-01988386-005.pdf)
2025-12-03 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff9af9736-a54e-48c2-bc4a-41aee3f1875f_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f9af9736-a54e-48c2-bc4a-41aee3f1875f_ext_6.jpg not downloaded yet
2025-12-03 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff9af9736-a54e-48c2-bc4a-41aee3f1875f_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f9af9736-a54e-48c2-bc4a-41aee3f1875f_ext_1.jpg not downloaded yet
2025-12-03 10:03:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:03:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa276fcbfd0>
2025-12-03 10:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:03:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 10:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_735dda5c-9a02-59fc-9457-d3988eccaae5/735dda5c-9a02-59fc-9457-d3988eccaae5_image_17.jpg HTTP/1.1" 201 0
2025-12-03 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3017186-4001924-1003.jpg') HTTP/1.1" 204 0
2025-12-03 10:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3017186-4001924-1003.jpg saved to cache
2025-12-03 10:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 735dda5c-9a02-59fc-9457-d3988eccaae5
2025-12-03 10:03:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:03:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa276f4f010>
2025-12-03 10:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:03:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 10:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0c54a04-921a-5d40-8011-f4191f63cc27/b0c54a04-921a-5d40-8011-f4191f63cc27_image_5.jpg HTTP/1.1" 201 0
2025-12-03 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d70341d-8b2e-43bb-8d34-14045297dce4_4.jpg') HTTP/1.1" 204 0
2025-12-03 10:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d70341d-8b2e-43bb-8d34-14045297dce4_4.jpg saved to cache
2025-12-03 10:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b0c54a04-921a-5d40-8011-f4191f63cc27
2025-12-03 10:03:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:03:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa276139110>
2025-12-03 10:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:03:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 10:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0c54a04-921a-5d40-8011-f4191f63cc27/b0c54a04-921a-5d40-8011-f4191f63cc27_image_7.jpg HTTP/1.1" 201 0
2025-12-03 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d70341d-8b2e-43bb-8d34-14045297dce4_10.jpg') HTTP/1.1" 204 0
2025-12-03 10:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d70341d-8b2e-43bb-8d34-14045297dce4_10.jpg saved to cache
2025-12-03 10:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b0c54a04-921a-5d40-8011-f4191f63cc27
2025-12-03 10:03:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:03:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa27725c810>
2025-12-03 10:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:03:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 10:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0c54a04-921a-5d40-8011-f4191f63cc27/b0c54a04-921a-5d40-8011-f4191f63cc27_image_6.jpg HTTP/1.1" 201 0
2025-12-03 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d70341d-8b2e-43bb-8d34-14045297dce4_11.jpg') HTTP/1.1" 204 0
2025-12-03 10:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d70341d-8b2e-43bb-8d34-14045297dce4_11.jpg saved to cache
2025-12-03 10:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b0c54a04-921a-5d40-8011-f4191f63cc27
2025-12-03 10:03:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:03:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa2774f3fd0>
2025-12-03 10:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:03:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 10:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_735dda5c-9a02-59fc-9457-d3988eccaae5/735dda5c-9a02-59fc-9457-d3988eccaae5_image_18.jpg HTTP/1.1" 201 0
2025-12-03 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3017186-4001924-1004.jpg') HTTP/1.1" 204 0
2025-12-03 10:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3017186-4001924-1004.jpg saved to cache
2025-12-03 10:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 735dda5c-9a02-59fc-9457-d3988eccaae5
2025-12-03 10:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0d70341d-8b2e-43bb-8d34-14045297dce4_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003004217-01989667-002.pdf)
2025-12-03 10:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0d70341d-8b2e-43bb-8d34-14045297dce4_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003004217-01989667-002.pdf)
2025-12-03 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff9af9736-a54e-48c2-bc4a-41aee3f1875f_5.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f9af9736-a54e-48c2-bc4a-41aee3f1875f_5.jpg not downloaded yet
2025-12-03 10:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3017186-4001924-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003017186-01988386-005.pdf)
2025-12-03 10:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0d70341d-8b2e-43bb-8d34-14045297dce4_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003004217-01989667-002.pdf)
2025-12-03 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff9af9736-a54e-48c2-bc4a-41aee3f1875f_4.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f9af9736-a54e-48c2-bc4a-41aee3f1875f_4.jpg not downloaded yet
2025-12-03 10:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f9af9736-a54e-48c2-bc4a-41aee3f1875f_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003046148-01980592-004.pdf)
2025-12-03 10:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f9af9736-a54e-48c2-bc4a-41aee3f1875f_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003046148-01980592-004.pdf)
2025-12-03 10:03:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:03:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa2772d3fd0>
2025-12-03 10:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:03:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 10:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_735dda5c-9a02-59fc-9457-d3988eccaae5/735dda5c-9a02-59fc-9457-d3988eccaae5_image_19.jpg HTTP/1.1" 201 0
2025-12-03 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3017186-4001924-1005.jpg') HTTP/1.1" 204 0
2025-12-03 10:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3017186-4001924-1005.jpg saved to cache
2025-12-03 10:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 735dda5c-9a02-59fc-9457-d3988eccaae5
2025-12-03 10:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3017186-4001924-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003017186-01988386-005.pdf)
2025-12-03 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff9af9736-a54e-48c2-bc4a-41aee3f1875f_11.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f9af9736-a54e-48c2-bc4a-41aee3f1875f_11.jpg not downloaded yet
2025-12-03 10:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3017186-4001924-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003017186-01988386-005.pdf)
2025-12-03 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff9af9736-a54e-48c2-bc4a-41aee3f1875f_10.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f9af9736-a54e-48c2-bc4a-41aee3f1875f_10.jpg not downloaded yet
2025-12-03 10:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3004217-4005654-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003004217-01989667-002.pdf)
2025-12-03 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff9af9736-a54e-48c2-bc4a-41aee3f1875f_9.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f9af9736-a54e-48c2-bc4a-41aee3f1875f_9.jpg not downloaded yet
2025-12-03 10:03:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:03:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa277255010>
2025-12-03 10:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:03:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 10:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0c54a04-921a-5d40-8011-f4191f63cc27/b0c54a04-921a-5d40-8011-f4191f63cc27_image_0.jpg HTTP/1.1" 201 0
2025-12-03 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d70341d-8b2e-43bb-8d34-14045297dce4_ext_7.jpg') HTTP/1.1" 204 0
2025-12-03 10:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d70341d-8b2e-43bb-8d34-14045297dce4_ext_7.jpg saved to cache
2025-12-03 10:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b0c54a04-921a-5d40-8011-f4191f63cc27
2025-12-03 10:03:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:03:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa2761d2890>
2025-12-03 10:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:03:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 10:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0c54a04-921a-5d40-8011-f4191f63cc27/b0c54a04-921a-5d40-8011-f4191f63cc27_image_1.jpg HTTP/1.1" 201 0
2025-12-03 10:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d70341d-8b2e-43bb-8d34-14045297dce4_ext_7.jpg') HTTP/1.1" 204 0
2025-12-03 10:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d70341d-8b2e-43bb-8d34-14045297dce4_ext_7.jpg saved to cache
2025-12-03 10:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b0c54a04-921a-5d40-8011-f4191f63cc27
2025-12-03 10:03:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:03:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa276ab1b10>
2025-12-03 10:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:03:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 10:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_735dda5c-9a02-59fc-9457-d3988eccaae5/735dda5c-9a02-59fc-9457-d3988eccaae5_image_16.jpg HTTP/1.1" 201 0
2025-12-03 10:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3017186-4001924-1002.jpg') HTTP/1.1" 204 0
2025-12-03 10:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3017186-4001924-1002.jpg saved to cache
2025-12-03 10:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 735dda5c-9a02-59fc-9457-d3988eccaae5
2025-12-03 10:03:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:03:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa2761d38d0>
2025-12-03 10:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:03:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 10:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0c54a04-921a-5d40-8011-f4191f63cc27/b0c54a04-921a-5d40-8011-f4191f63cc27_image_2.jpg HTTP/1.1" 201 0
2025-12-03 10:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d70341d-8b2e-43bb-8d34-14045297dce4_ext_6.jpg') HTTP/1.1" 204 0
2025-12-03 10:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d70341d-8b2e-43bb-8d34-14045297dce4_ext_6.jpg saved to cache
2025-12-03 10:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b0c54a04-921a-5d40-8011-f4191f63cc27
2025-12-03 10:03:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:03:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa27733d390>
2025-12-03 10:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:03:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 10:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e0f346b-7415-543f-b77a-e7cf41a9044a/8e0f346b-7415-543f-b77a-e7cf41a9044a_image_0.jpg HTTP/1.1" 201 0
2025-12-03 10:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff9af9736-a54e-48c2-bc4a-41aee3f1875f_ext_7.jpg') HTTP/1.1" 204 0
2025-12-03 10:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f9af9736-a54e-48c2-bc4a-41aee3f1875f_ext_7.jpg saved to cache
2025-12-03 10:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8e0f346b-7415-543f-b77a-e7cf41a9044a
2025-12-03 10:03:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:03:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa277085250>
2025-12-03 10:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:03:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 10:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e0f346b-7415-543f-b77a-e7cf41a9044a/8e0f346b-7415-543f-b77a-e7cf41a9044a_image_1.jpg HTTP/1.1" 201 0
2025-12-03 10:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff9af9736-a54e-48c2-bc4a-41aee3f1875f_ext_7.jpg') HTTP/1.1" 204 0
2025-12-03 10:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f9af9736-a54e-48c2-bc4a-41aee3f1875f_ext_7.jpg saved to cache
2025-12-03 10:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8e0f346b-7415-543f-b77a-e7cf41a9044a
2025-12-03 10:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3004217-4005654-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003004217-01989667-002.pdf)
2025-12-03 10:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3004217-4005654-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003004217-01989667-002.pdf)
2025-12-03 10:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3004217-4005654-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003004217-01989667-002.pdf)
2025-12-03 10:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff9af9736-a54e-48c2-bc4a-41aee3f1875f_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f9af9736-a54e-48c2-bc4a-41aee3f1875f_ext_2.jpg not downloaded yet
2025-12-03 10:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f9af9736-a54e-48c2-bc4a-41aee3f1875f_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003046148-01980592-004.pdf)
2025-12-03 10:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3004217-4005654-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003004217-01989667-002.pdf)
2025-12-03 10:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff9af9736-a54e-48c2-bc4a-41aee3f1875f_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f9af9736-a54e-48c2-bc4a-41aee3f1875f_ext_5.jpg not downloaded yet
2025-12-03 10:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0d70341d-8b2e-43bb-8d34-14045297dce4_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003004217-01989667-002.pdf)
2025-12-03 10:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3004217-4005654-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003004217-01989667-002.pdf)
2025-12-03 10:03:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:03:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa277256410>
2025-12-03 10:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:03:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 10:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_735dda5c-9a02-59fc-9457-d3988eccaae5/735dda5c-9a02-59fc-9457-d3988eccaae5_image_15.jpg HTTP/1.1" 201 0
2025-12-03 10:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3017186-4001924-1001.jpg') HTTP/1.1" 204 0
2025-12-03 10:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3017186-4001924-1001.jpg saved to cache
2025-12-03 10:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 735dda5c-9a02-59fc-9457-d3988eccaae5
2025-12-03 10:03:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:03:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa277076210>
2025-12-03 10:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:03:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 10:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_735dda5c-9a02-59fc-9457-d3988eccaae5/735dda5c-9a02-59fc-9457-d3988eccaae5_image_14.jpg HTTP/1.1" 201 0
2025-12-03 10:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3017186-4001924-1000.jpg') HTTP/1.1" 204 0
2025-12-03 10:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3017186-4001924-1000.jpg saved to cache
2025-12-03 10:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 735dda5c-9a02-59fc-9457-d3988eccaae5
2025-12-03 10:03:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:03:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa27718cc10>
2025-12-03 10:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:03:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 10:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0c54a04-921a-5d40-8011-f4191f63cc27/b0c54a04-921a-5d40-8011-f4191f63cc27_image_18.jpg HTTP/1.1" 201 0
2025-12-03 10:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3004217-4005654-1004.jpg') HTTP/1.1" 204 0
2025-12-03 10:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3004217-4005654-1004.jpg saved to cache
2025-12-03 10:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item b0c54a04-921a-5d40-8011-f4191f63cc27
2025-12-03 10:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3004217-4005654-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003004217-01989667-002.pdf)
2025-12-03 10:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff9af9736-a54e-48c2-bc4a-41aee3f1875f_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f9af9736-a54e-48c2-bc4a-41aee3f1875f_ext_3.jpg not downloaded yet
2025-12-03 10:03:16 [scrapy.extensions.logstats] INFO: Crawled 47 pages (at 27 pages/min), scraped 6 items (at 2 items/min)
2025-12-03 10:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff9af9736-a54e-48c2-bc4a-41aee3f1875f_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f9af9736-a54e-48c2-bc4a-41aee3f1875f_ext_4.jpg not downloaded yet
2025-12-03 10:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f9af9736-a54e-48c2-bc4a-41aee3f1875f_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003046148-01980592-004.pdf)
2025-12-03 10:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f9af9736-a54e-48c2-bc4a-41aee3f1875f_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003046148-01980592-004.pdf)
2025-12-03 10:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3046148-4001338-13.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3046148-4001338-13.jpg not downloaded yet
2025-12-03 10:03:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:03:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa27703df50>
2025-12-03 10:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:03:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 10:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0c54a04-921a-5d40-8011-f4191f63cc27/b0c54a04-921a-5d40-8011-f4191f63cc27_image_19.jpg HTTP/1.1" 201 0
2025-12-03 10:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3004217-4005654-1005.jpg') HTTP/1.1" 204 0
2025-12-03 10:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3004217-4005654-1005.jpg saved to cache
2025-12-03 10:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item b0c54a04-921a-5d40-8011-f4191f63cc27
2025-12-03 10:03:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:03:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa277473410>
2025-12-03 10:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:03:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 10:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0c54a04-921a-5d40-8011-f4191f63cc27/b0c54a04-921a-5d40-8011-f4191f63cc27_image_17.jpg HTTP/1.1" 201 0
2025-12-03 10:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3004217-4005654-1003.jpg') HTTP/1.1" 204 0
2025-12-03 10:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3004217-4005654-1003.jpg saved to cache
2025-12-03 10:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item b0c54a04-921a-5d40-8011-f4191f63cc27
2025-12-03 10:03:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:03:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa276f48a10>
2025-12-03 10:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:03:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 10:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0c54a04-921a-5d40-8011-f4191f63cc27/b0c54a04-921a-5d40-8011-f4191f63cc27_image_16.jpg HTTP/1.1" 201 0
2025-12-03 10:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3004217-4005654-1002.jpg') HTTP/1.1" 204 0
2025-12-03 10:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3004217-4005654-1002.jpg saved to cache
2025-12-03 10:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item b0c54a04-921a-5d40-8011-f4191f63cc27
2025-12-03 10:03:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:03:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa27716eb90>
2025-12-03 10:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:03:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 10:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e0f346b-7415-543f-b77a-e7cf41a9044a/8e0f346b-7415-543f-b77a-e7cf41a9044a_image_3.jpg HTTP/1.1" 201 0
2025-12-03 10:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff9af9736-a54e-48c2-bc4a-41aee3f1875f_ext_1.jpg') HTTP/1.1" 204 0
2025-12-03 10:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f9af9736-a54e-48c2-bc4a-41aee3f1875f_ext_1.jpg saved to cache
2025-12-03 10:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8e0f346b-7415-543f-b77a-e7cf41a9044a
2025-12-03 10:03:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:03:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa2771c5bd0>
2025-12-03 10:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:03:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 10:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0c54a04-921a-5d40-8011-f4191f63cc27/b0c54a04-921a-5d40-8011-f4191f63cc27_image_15.jpg HTTP/1.1" 201 0
2025-12-03 10:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3004217-4005654-1001.jpg') HTTP/1.1" 204 0
2025-12-03 10:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3004217-4005654-1001.jpg saved to cache
2025-12-03 10:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item b0c54a04-921a-5d40-8011-f4191f63cc27
2025-12-03 10:03:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:03:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa2772c5210>
2025-12-03 10:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:03:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 10:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0c54a04-921a-5d40-8011-f4191f63cc27/b0c54a04-921a-5d40-8011-f4191f63cc27_image_12.jpg HTTP/1.1" 201 0
2025-12-03 10:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d70341d-8b2e-43bb-8d34-14045297dce4_ext_4.jpg') HTTP/1.1" 204 0
2025-12-03 10:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d70341d-8b2e-43bb-8d34-14045297dce4_ext_4.jpg saved to cache
2025-12-03 10:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item b0c54a04-921a-5d40-8011-f4191f63cc27
2025-12-03 10:03:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:03:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa277363490>
2025-12-03 10:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:03:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 10:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0c54a04-921a-5d40-8011-f4191f63cc27/b0c54a04-921a-5d40-8011-f4191f63cc27_image_13.jpg HTTP/1.1" 201 0
2025-12-03 10:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3004217-4005654-13.jpg') HTTP/1.1" 204 0
2025-12-03 10:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3004217-4005654-13.jpg saved to cache
2025-12-03 10:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item b0c54a04-921a-5d40-8011-f4191f63cc27
2025-12-03 10:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0d70341d-8b2e-43bb-8d34-14045297dce4_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003004217-01989667-002.pdf)
2025-12-03 10:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0d70341d-8b2e-43bb-8d34-14045297dce4_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003004217-01989667-002.pdf)
2025-12-03 10:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0d70341d-8b2e-43bb-8d34-14045297dce4_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003004217-01989667-002.pdf)
2025-12-03 10:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3046148-4001338-1000.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3046148-4001338-1000.jpg not downloaded yet
2025-12-03 10:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3046148-4001338-1001.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3046148-4001338-1001.jpg not downloaded yet
2025-12-03 10:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f9af9736-a54e-48c2-bc4a-41aee3f1875f_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003046148-01980592-004.pdf)
2025-12-03 10:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f9af9736-a54e-48c2-bc4a-41aee3f1875f_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003046148-01980592-004.pdf)
2025-12-03 10:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f9af9736-a54e-48c2-bc4a-41aee3f1875f_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003046148-01980592-004.pdf)
2025-12-03 10:03:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:03:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa275819390>
2025-12-03 10:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:03:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 10:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0c54a04-921a-5d40-8011-f4191f63cc27/b0c54a04-921a-5d40-8011-f4191f63cc27_image_14.jpg HTTP/1.1" 201 0
2025-12-03 10:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3004217-4005654-1000.jpg') HTTP/1.1" 204 0
2025-12-03 10:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3004217-4005654-1000.jpg saved to cache
2025-12-03 10:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item b0c54a04-921a-5d40-8011-f4191f63cc27
2025-12-03 10:03:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:03:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa2771b6210>
2025-12-03 10:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:03:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 10:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:03:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e0f346b-7415-543f-b77a-e7cf41a9044a/8e0f346b-7415-543f-b77a-e7cf41a9044a_image_2.jpg HTTP/1.1" 201 0
2025-12-03 10:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff9af9736-a54e-48c2-bc4a-41aee3f1875f_ext_6.jpg') HTTP/1.1" 204 0
2025-12-03 10:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f9af9736-a54e-48c2-bc4a-41aee3f1875f_ext_6.jpg saved to cache
2025-12-03 10:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8e0f346b-7415-543f-b77a-e7cf41a9044a
2025-12-03 10:03:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:03:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:03:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:03:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa2770aa990>
2025-12-03 10:03:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:03:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 10:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:03:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e0f346b-7415-543f-b77a-e7cf41a9044a/8e0f346b-7415-543f-b77a-e7cf41a9044a_image_4.jpg HTTP/1.1" 201 0
2025-12-03 10:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff9af9736-a54e-48c2-bc4a-41aee3f1875f_5.jpg') HTTP/1.1" 204 0
2025-12-03 10:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f9af9736-a54e-48c2-bc4a-41aee3f1875f_5.jpg saved to cache
2025-12-03 10:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8e0f346b-7415-543f-b77a-e7cf41a9044a
2025-12-03 10:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3046148-4001338-1002.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3046148-4001338-1002.jpg not downloaded yet
2025-12-03 10:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3046148-4001338-1003.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3046148-4001338-1003.jpg not downloaded yet
2025-12-03 10:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f9af9736-a54e-48c2-bc4a-41aee3f1875f_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003046148-01980592-004.pdf)
2025-12-03 10:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f9af9736-a54e-48c2-bc4a-41aee3f1875f_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003046148-01980592-004.pdf)
2025-12-03 10:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0d70341d-8b2e-43bb-8d34-14045297dce4_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003004217-01989667-002.pdf)
2025-12-03 10:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003017186-01988386-005.pdf)
2025-12-03 10:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3046148-4001338-1004.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3046148-4001338-1004.jpg not downloaded yet
2025-12-03 10:03:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:03:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:03:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:03:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa27749b450>
2025-12-03 10:03:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:03:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 10:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:03:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0c54a04-921a-5d40-8011-f4191f63cc27/b0c54a04-921a-5d40-8011-f4191f63cc27_image_9.jpg HTTP/1.1" 201 0
2025-12-03 10:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d70341d-8b2e-43bb-8d34-14045297dce4_ext_2.jpg') HTTP/1.1" 204 0
2025-12-03 10:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d70341d-8b2e-43bb-8d34-14045297dce4_ext_2.jpg saved to cache
2025-12-03 10:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b0c54a04-921a-5d40-8011-f4191f63cc27
2025-12-03 10:03:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:03:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:03:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:03:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa2761253d0>
2025-12-03 10:03:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:03:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 10:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0c54a04-921a-5d40-8011-f4191f63cc27/b0c54a04-921a-5d40-8011-f4191f63cc27_image_11.jpg HTTP/1.1" 201 0
2025-12-03 10:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d70341d-8b2e-43bb-8d34-14045297dce4_ext_3.jpg') HTTP/1.1" 204 0
2025-12-03 10:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d70341d-8b2e-43bb-8d34-14045297dce4_ext_3.jpg saved to cache
2025-12-03 10:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item b0c54a04-921a-5d40-8011-f4191f63cc27
2025-12-03 10:03:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:03:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa27703c350>
2025-12-03 10:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:03:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 10:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0c54a04-921a-5d40-8011-f4191f63cc27/b0c54a04-921a-5d40-8011-f4191f63cc27_image_10.jpg HTTP/1.1" 201 0
2025-12-03 10:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d70341d-8b2e-43bb-8d34-14045297dce4_ext_5.jpg') HTTP/1.1" 204 0
2025-12-03 10:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d70341d-8b2e-43bb-8d34-14045297dce4_ext_5.jpg saved to cache
2025-12-03 10:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item b0c54a04-921a-5d40-8011-f4191f63cc27
2025-12-03 10:03:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:03:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa27749be50>
2025-12-03 10:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:03:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 10:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e0f346b-7415-543f-b77a-e7cf41a9044a/8e0f346b-7415-543f-b77a-e7cf41a9044a_image_5.jpg HTTP/1.1" 201 0
2025-12-03 10:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff9af9736-a54e-48c2-bc4a-41aee3f1875f_4.jpg') HTTP/1.1" 204 0
2025-12-03 10:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f9af9736-a54e-48c2-bc4a-41aee3f1875f_4.jpg saved to cache
2025-12-03 10:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8e0f346b-7415-543f-b77a-e7cf41a9044a
2025-12-03 10:03:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:03:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa27718ea50>
2025-12-03 10:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:03:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 10:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e0f346b-7415-543f-b77a-e7cf41a9044a/8e0f346b-7415-543f-b77a-e7cf41a9044a_image_6.jpg HTTP/1.1" 201 0
2025-12-03 10:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff9af9736-a54e-48c2-bc4a-41aee3f1875f_11.jpg') HTTP/1.1" 204 0
2025-12-03 10:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f9af9736-a54e-48c2-bc4a-41aee3f1875f_11.jpg saved to cache
2025-12-03 10:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8e0f346b-7415-543f-b77a-e7cf41a9044a
2025-12-03 10:03:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:03:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa27718ea50>
2025-12-03 10:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:03:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 10:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e0f346b-7415-543f-b77a-e7cf41a9044a/8e0f346b-7415-543f-b77a-e7cf41a9044a_image_7.jpg HTTP/1.1" 201 0
2025-12-03 10:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff9af9736-a54e-48c2-bc4a-41aee3f1875f_10.jpg') HTTP/1.1" 204 0
2025-12-03 10:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f9af9736-a54e-48c2-bc4a-41aee3f1875f_10.jpg saved to cache
2025-12-03 10:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8e0f346b-7415-543f-b77a-e7cf41a9044a
2025-12-03 10:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3046148-4001338-1005.jpg%27 HTTP/1.1" 200 None
2025-12-03 10:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3046148-4001338-1005.jpg not downloaded yet
2025-12-03 10:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3017186-4001924-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003017186-01988386-005.pdf)
2025-12-03 10:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f9af9736-a54e-48c2-bc4a-41aee3f1875f_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003046148-01980592-004.pdf)
2025-12-03 10:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003017186-01988386-005.pdf)
2025-12-03 10:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f9af9736-a54e-48c2-bc4a-41aee3f1875f_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003046148-01980592-004.pdf)
2025-12-03 10:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f9af9736-a54e-48c2-bc4a-41aee3f1875f_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003046148-01980592-004.pdf)
2025-12-03 10:03:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:03:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa276f4f1d0>
2025-12-03 10:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:03:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 10:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e0f346b-7415-543f-b77a-e7cf41a9044a/8e0f346b-7415-543f-b77a-e7cf41a9044a_image_11.jpg HTTP/1.1" 201 0
2025-12-03 10:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff9af9736-a54e-48c2-bc4a-41aee3f1875f_ext_3.jpg') HTTP/1.1" 204 0
2025-12-03 10:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f9af9736-a54e-48c2-bc4a-41aee3f1875f_ext_3.jpg saved to cache
2025-12-03 10:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 8e0f346b-7415-543f-b77a-e7cf41a9044a
2025-12-03 10:03:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:03:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa2771bd450>
2025-12-03 10:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:03:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 10:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e0f346b-7415-543f-b77a-e7cf41a9044a/8e0f346b-7415-543f-b77a-e7cf41a9044a_image_8.jpg HTTP/1.1" 201 0
2025-12-03 10:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff9af9736-a54e-48c2-bc4a-41aee3f1875f_9.jpg') HTTP/1.1" 204 0
2025-12-03 10:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f9af9736-a54e-48c2-bc4a-41aee3f1875f_9.jpg saved to cache
2025-12-03 10:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8e0f346b-7415-543f-b77a-e7cf41a9044a
2025-12-03 10:03:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:03:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa27872ab10>
2025-12-03 10:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:03:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 10:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0c54a04-921a-5d40-8011-f4191f63cc27/b0c54a04-921a-5d40-8011-f4191f63cc27_image_8.jpg HTTP/1.1" 201 0
2025-12-03 10:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d70341d-8b2e-43bb-8d34-14045297dce4_9.jpg') HTTP/1.1" 204 0
2025-12-03 10:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d70341d-8b2e-43bb-8d34-14045297dce4_9.jpg saved to cache
2025-12-03 10:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b0c54a04-921a-5d40-8011-f4191f63cc27
2025-12-03 10:03:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b0c54a04-921a-5d40-8011-f4191f63cc27, skipping ID generation
2025-12-03 10:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b0c54a04-921a-5d40-8011-f4191f63cc27 from tracking dictionaries
2025-12-03 10:03:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b0c54a04-921a-5d40-8011-f4191f63cc27 sending to next pipeline
2025-12-03 10:03:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: b0c54a04-921a-5d40-8011-f4191f63cc27, identifier: 3004217
2025-12-03 10:03:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:03:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa276aeb390>
2025-12-03 10:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:03:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 10:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_735dda5c-9a02-59fc-9457-d3988eccaae5/735dda5c-9a02-59fc-9457-d3988eccaae5_image_12.jpg HTTP/1.1" 201 0
2025-12-03 10:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_ext_4.jpg') HTTP/1.1" 204 0
2025-12-03 10:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_ext_4.jpg saved to cache
2025-12-03 10:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 735dda5c-9a02-59fc-9457-d3988eccaae5
2025-12-03 10:03:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: b0c54a04-921a-5d40-8011-f4191f63cc27 with identifier: 3004217
2025-12-03 10:03:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: b0c54a04-921a-5d40-8011-f4191f63cc27 with identifier: 3004217
2025-12-03 10:03:23 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 167511 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    167511
2025-12-03 10:03:23 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: b0c54a04-921a-5d40-8011-f4191f63cc27 spider: manheim.gb
2025-12-03 10:03:23 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: b0c54a04-921a-5d40-8011-f4191f63cc27 due to rule: high_mileage_for_country.json, error: 167511 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    167511
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0c54a04-921a-5d40-8011-f4191f63cc27/b0c54a04-921a-5d40-8011-f4191f63cc27_expert_report_file_661ba74f-7553-4c62-954e-747a0774e6d7.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003004217-01989667-002.pdf',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '2.2L',
 'expiration_date': '2025-12-10T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'b0c54a04-921a-5d40-8011-f4191f63cc27',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'OW62JJU',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MAZDA/CX-5?id=3004217',
 'listing': 'auction',
 'location': 'Plymouth',
 'make': 'MAZDA',
 'model': 'CX-5',
 'odometer': 104087,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 31,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0c54a04-921a-5d40-8011-f4191f63cc27/b0c54a04-921a-5d40-8011-f4191f63cc27_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 213086,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0d70341d-8b2e-43bb-8d34-14045297dce4_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0c54a04-921a-5d40-8011-f4191f63cc27/b0c54a04-921a-5d40-8011-f4191f63cc27_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 213086,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0d70341d-8b2e-43bb-8d34-14045297dce4_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0c54a04-921a-5d40-8011-f4191f63cc27/b0c54a04-921a-5d40-8011-f4191f63cc27_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 335578,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0d70341d-8b2e-43bb-8d34-14045297dce4_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0c54a04-921a-5d40-8011-f4191f63cc27/b0c54a04-921a-5d40-8011-f4191f63cc27_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 196028,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0d70341d-8b2e-43bb-8d34-14045297dce4_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0c54a04-921a-5d40-8011-f4191f63cc27/b0c54a04-921a-5d40-8011-f4191f63cc27_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 211224,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0d70341d-8b2e-43bb-8d34-14045297dce4_5.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0c54a04-921a-5d40-8011-f4191f63cc27/b0c54a04-921a-5d40-8011-f4191f63cc27_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 208874,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0d70341d-8b2e-43bb-8d34-14045297dce4_4.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0c54a04-921a-5d40-8011-f4191f63cc27/b0c54a04-921a-5d40-8011-f4191f63cc27_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 212016,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0d70341d-8b2e-43bb-8d34-14045297dce4_11.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0c54a04-921a-5d40-8011-f4191f63cc27/b0c54a04-921a-5d40-8011-f4191f63cc27_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 200257,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0d70341d-8b2e-43bb-8d34-14045297dce4_10.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0c54a04-921a-5d40-8011-f4191f63cc27/b0c54a04-921a-5d40-8011-f4191f63cc27_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 200332,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0d70341d-8b2e-43bb-8d34-14045297dce4_9.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0c54a04-921a-5d40-8011-f4191f63cc27/b0c54a04-921a-5d40-8011-f4191f63cc27_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 326574,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0d70341d-8b2e-43bb-8d34-14045297dce4_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0c54a04-921a-5d40-8011-f4191f63cc27/b0c54a04-921a-5d40-8011-f4191f63cc27_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 344849,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0d70341d-8b2e-43bb-8d34-14045297dce4_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0c54a04-921a-5d40-8011-f4191f63cc27/b0c54a04-921a-5d40-8011-f4191f63cc27_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 334228,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0d70341d-8b2e-43bb-8d34-14045297dce4_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0c54a04-921a-5d40-8011-f4191f63cc27/b0c54a04-921a-5d40-8011-f4191f63cc27_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 253103,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0d70341d-8b2e-43bb-8d34-14045297dce4_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0c54a04-921a-5d40-8011-f4191f63cc27/b0c54a04-921a-5d40-8011-f4191f63cc27_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 236760,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3004217-4005654-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0c54a04-921a-5d40-8011-f4191f63cc27/b0c54a04-921a-5d40-8011-f4191f63cc27_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 313543,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3004217-4005654-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0c54a04-921a-5d40-8011-f4191f63cc27/b0c54a04-921a-5d40-8011-f4191f63cc27_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 185597,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3004217-4005654-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0c54a04-921a-5d40-8011-f4191f63cc27/b0c54a04-921a-5d40-8011-f4191f63cc27_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 286071,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3004217-4005654-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0c54a04-921a-5d40-8011-f4191f63cc27/b0c54a04-921a-5d40-8011-f4191f63cc27_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 268154,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3004217-4005654-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0c54a04-921a-5d40-8011-f4191f63cc27/b0c54a04-921a-5d40-8011-f4191f63cc27_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 184507,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3004217-4005654-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0c54a04-921a-5d40-8011-f4191f63cc27/b0c54a04-921a-5d40-8011-f4191f63cc27_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 301643,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3004217-4005654-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-08',
 'seller_name': 'Vospers Group',
 'title': 'MAZDA CX-5 2.2d [175] Sport Nav 5dr AWD',
 'transmission': 'manual',
 'trim': '2.2d [175] Sport Nav 5dr AWD',
 'year': 2013}
2025-12-03 10:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273004217%27 HTTP/1.1" 200 None
2025-12-03 10:03:23 [manheim.gb] INFO: Saving data for 3004217: {'created_time': 1764756203.418337, 'last_price_update_time': 1764756203.418348, 'auction_closing_time': 1765357200.0}
2025-12-03 10:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3004217') HTTP/1.1" 204 0
2025-12-03 10:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003017186-01988386-005.pdf)
2025-12-03 10:03:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:03:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa2774f21d0>
2025-12-03 10:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:03:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 10:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_735dda5c-9a02-59fc-9457-d3988eccaae5/735dda5c-9a02-59fc-9457-d3988eccaae5_image_13.jpg HTTP/1.1" 201 0
2025-12-03 10:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3017186-4001924-13.jpg') HTTP/1.1" 204 0
2025-12-03 10:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3017186-4001924-13.jpg saved to cache
2025-12-03 10:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 735dda5c-9a02-59fc-9457-d3988eccaae5
2025-12-03 10:03:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:03:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa277386590>
2025-12-03 10:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:03:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 10:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e0f346b-7415-543f-b77a-e7cf41a9044a/8e0f346b-7415-543f-b77a-e7cf41a9044a_image_12.jpg HTTP/1.1" 201 0
2025-12-03 10:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff9af9736-a54e-48c2-bc4a-41aee3f1875f_ext_4.jpg') HTTP/1.1" 204 0
2025-12-03 10:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f9af9736-a54e-48c2-bc4a-41aee3f1875f_ext_4.jpg saved to cache
2025-12-03 10:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 8e0f346b-7415-543f-b77a-e7cf41a9044a
2025-12-03 10:03:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:03:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa2761f1d50>
2025-12-03 10:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:03:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 10:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_735dda5c-9a02-59fc-9457-d3988eccaae5/735dda5c-9a02-59fc-9457-d3988eccaae5_image_11.jpg HTTP/1.1" 201 0
2025-12-03 10:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_ext_3.jpg') HTTP/1.1" 204 0
2025-12-03 10:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_ext_3.jpg saved to cache
2025-12-03 10:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 735dda5c-9a02-59fc-9457-d3988eccaae5
2025-12-03 10:03:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:03:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa277111650>
2025-12-03 10:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:03:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 10:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e0f346b-7415-543f-b77a-e7cf41a9044a/8e0f346b-7415-543f-b77a-e7cf41a9044a_image_10.jpg HTTP/1.1" 201 0
2025-12-03 10:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff9af9736-a54e-48c2-bc4a-41aee3f1875f_ext_5.jpg') HTTP/1.1" 204 0
2025-12-03 10:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f9af9736-a54e-48c2-bc4a-41aee3f1875f_ext_5.jpg saved to cache
2025-12-03 10:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 8e0f346b-7415-543f-b77a-e7cf41a9044a
2025-12-03 10:03:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:03:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa276af5fd0>
2025-12-03 10:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:03:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 10:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e0f346b-7415-543f-b77a-e7cf41a9044a/8e0f346b-7415-543f-b77a-e7cf41a9044a_image_9.jpg HTTP/1.1" 201 0
2025-12-03 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff9af9736-a54e-48c2-bc4a-41aee3f1875f_ext_2.jpg') HTTP/1.1" 204 0
2025-12-03 10:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f9af9736-a54e-48c2-bc4a-41aee3f1875f_ext_2.jpg saved to cache
2025-12-03 10:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8e0f346b-7415-543f-b77a-e7cf41a9044a
2025-12-03 10:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003017186-01988386-005.pdf)
2025-12-03 10:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3046148-4001338-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003046148-01980592-004.pdf)
2025-12-03 10:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003017186-01988386-005.pdf)
2025-12-03 10:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3046148-4001338-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003046148-01980592-004.pdf)
2025-12-03 10:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3046148-4001338-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003046148-01980592-004.pdf)
2025-12-03 10:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3046148-4001338-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003046148-01980592-004.pdf)
2025-12-03 10:03:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:03:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa277012750>
2025-12-03 10:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:03:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 10:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_735dda5c-9a02-59fc-9457-d3988eccaae5/735dda5c-9a02-59fc-9457-d3988eccaae5_image_8.jpg HTTP/1.1" 201 0
2025-12-03 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_9.jpg') HTTP/1.1" 204 0
2025-12-03 10:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_9.jpg saved to cache
2025-12-03 10:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 735dda5c-9a02-59fc-9457-d3988eccaae5
2025-12-03 10:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3046148-4001338-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003046148-01980592-004.pdf)
2025-12-03 10:03:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:03:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa27716e190>
2025-12-03 10:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:03:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 10:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_735dda5c-9a02-59fc-9457-d3988eccaae5/735dda5c-9a02-59fc-9457-d3988eccaae5_image_10.jpg HTTP/1.1" 201 0
2025-12-03 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_ext_5.jpg') HTTP/1.1" 204 0
2025-12-03 10:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_ext_5.jpg saved to cache
2025-12-03 10:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 735dda5c-9a02-59fc-9457-d3988eccaae5
2025-12-03 10:03:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:03:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa2772ed110>
2025-12-03 10:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:03:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-03 10:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e0f346b-7415-543f-b77a-e7cf41a9044a/8e0f346b-7415-543f-b77a-e7cf41a9044a_image_13.jpg HTTP/1.1" 201 0
2025-12-03 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3046148-4001338-13.jpg') HTTP/1.1" 204 0
2025-12-03 10:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3046148-4001338-13.jpg saved to cache
2025-12-03 10:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 8e0f346b-7415-543f-b77a-e7cf41a9044a
2025-12-03 10:03:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:03:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa276160290>
2025-12-03 10:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:03:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-03 10:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_735dda5c-9a02-59fc-9457-d3988eccaae5/735dda5c-9a02-59fc-9457-d3988eccaae5_image_9.jpg HTTP/1.1" 201 0
2025-12-03 10:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_ext_2.jpg') HTTP/1.1" 204 0
2025-12-03 10:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_ext_2.jpg saved to cache
2025-12-03 10:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 735dda5c-9a02-59fc-9457-d3988eccaae5
2025-12-03 10:03:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 735dda5c-9a02-59fc-9457-d3988eccaae5, skipping ID generation
2025-12-03 10:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 735dda5c-9a02-59fc-9457-d3988eccaae5 from tracking dictionaries
2025-12-03 10:03:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 735dda5c-9a02-59fc-9457-d3988eccaae5 sending to next pipeline
2025-12-03 10:03:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 735dda5c-9a02-59fc-9457-d3988eccaae5, identifier: 3017186
2025-12-03 10:03:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:03:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa27613bed0>
2025-12-03 10:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:03:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 10:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e0f346b-7415-543f-b77a-e7cf41a9044a/8e0f346b-7415-543f-b77a-e7cf41a9044a_image_14.jpg HTTP/1.1" 201 0
2025-12-03 10:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3046148-4001338-1000.jpg') HTTP/1.1" 204 0
2025-12-03 10:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3046148-4001338-1000.jpg saved to cache
2025-12-03 10:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 8e0f346b-7415-543f-b77a-e7cf41a9044a
2025-12-03 10:03:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:03:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa277357810>
2025-12-03 10:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:03:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 10:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e0f346b-7415-543f-b77a-e7cf41a9044a/8e0f346b-7415-543f-b77a-e7cf41a9044a_image_15.jpg HTTP/1.1" 201 0
2025-12-03 10:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3046148-4001338-1001.jpg') HTTP/1.1" 204 0
2025-12-03 10:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3046148-4001338-1001.jpg saved to cache
2025-12-03 10:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 8e0f346b-7415-543f-b77a-e7cf41a9044a
2025-12-03 10:03:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:03:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa2773fa5d0>
2025-12-03 10:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:03:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-03 10:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e0f346b-7415-543f-b77a-e7cf41a9044a/8e0f346b-7415-543f-b77a-e7cf41a9044a_image_16.jpg HTTP/1.1" 201 0
2025-12-03 10:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3046148-4001338-1002.jpg') HTTP/1.1" 204 0
2025-12-03 10:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3046148-4001338-1002.jpg saved to cache
2025-12-03 10:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 8e0f346b-7415-543f-b77a-e7cf41a9044a
2025-12-03 10:03:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 735dda5c-9a02-59fc-9457-d3988eccaae5 with identifier: 3017186
2025-12-03 10:03:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 735dda5c-9a02-59fc-9457-d3988eccaae5 with identifier: 3017186
2025-12-03 10:03:27 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 735dda5c-9a02-59fc-9457-d3988eccaae5 with identifier: 3017186 to the API
2025-12-03 10:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 10:03:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 10:03:27 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_ext_2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_735dda5c-9a02-59fc-9457-d3988eccaae5/735dda5c-9a02-59fc-9457-d3988eccaae5_expert_report_file_81c6e962-1ad1-42d9-a26e-6cdec9265bc7.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003017186-01988386-005.pdf',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '735dda5c-9a02-59fc-9457-d3988eccaae5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'KP70FMY',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/PEUGEOT/2008?id=3017186',
 'listing': 'auction',
 'location': 'Northampton',
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 67594,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 27,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_735dda5c-9a02-59fc-9457-d3988eccaae5/735dda5c-9a02-59fc-9457-d3988eccaae5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 236429,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_735dda5c-9a02-59fc-9457-d3988eccaae5/735dda5c-9a02-59fc-9457-d3988eccaae5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 236429,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_735dda5c-9a02-59fc-9457-d3988eccaae5/735dda5c-9a02-59fc-9457-d3988eccaae5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 285768,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_735dda5c-9a02-59fc-9457-d3988eccaae5/735dda5c-9a02-59fc-9457-d3988eccaae5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 193796,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_735dda5c-9a02-59fc-9457-d3988eccaae5/735dda5c-9a02-59fc-9457-d3988eccaae5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 218585,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_735dda5c-9a02-59fc-9457-d3988eccaae5/735dda5c-9a02-59fc-9457-d3988eccaae5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 212521,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_735dda5c-9a02-59fc-9457-d3988eccaae5/735dda5c-9a02-59fc-9457-d3988eccaae5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 213145,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_735dda5c-9a02-59fc-9457-d3988eccaae5/735dda5c-9a02-59fc-9457-d3988eccaae5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 212239,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_735dda5c-9a02-59fc-9457-d3988eccaae5/735dda5c-9a02-59fc-9457-d3988eccaae5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 226218,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_735dda5c-9a02-59fc-9457-d3988eccaae5/735dda5c-9a02-59fc-9457-d3988eccaae5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 352740,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_735dda5c-9a02-59fc-9457-d3988eccaae5/735dda5c-9a02-59fc-9457-d3988eccaae5_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 267401,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_735dda5c-9a02-59fc-9457-d3988eccaae5/735dda5c-9a02-59fc-9457-d3988eccaae5_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 260451,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_735dda5c-9a02-59fc-9457-d3988eccaae5/735dda5c-9a02-59fc-9457-d3988eccaae5_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 246632,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/5df7f5ef-f5ad-4d2a-b4bf-642577bb383d_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_735dda5c-9a02-59fc-9457-d3988eccaae5/735dda5c-9a02-59fc-9457-d3988eccaae5_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 445659,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3017186-4001924-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_735dda5c-9a02-59fc-9457-d3988eccaae5/735dda5c-9a02-59fc-9457-d3988eccaae5_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 552709,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3017186-4001924-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_735dda5c-9a02-59fc-9457-d3988eccaae5/735dda5c-9a02-59fc-9457-d3988eccaae5_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 520200,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3017186-4001924-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_735dda5c-9a02-59fc-9457-d3988eccaae5/735dda5c-9a02-59fc-9457-d3988eccaae5_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 302170,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3017186-4001924-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_735dda5c-9a02-59fc-9457-d3988eccaae5/735dda5c-9a02-59fc-9457-d3988eccaae5_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 322181,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3017186-4001924-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_735dda5c-9a02-59fc-9457-d3988eccaae5/735dda5c-9a02-59fc-9457-d3988eccaae5_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 265389,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3017186-4001924-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_735dda5c-9a02-59fc-9457-d3988eccaae5/735dda5c-9a02-59fc-9457-d3988eccaae5_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 401207,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3017186-4001924-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-23',
 'seller_name': 'FCA Group',
 'title': 'PEUGEOT 2008 1.2 PureTech 130 GT 5dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech 130 GT 5dr',
 'year': 2021}
2025-12-03 10:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273017186%27 HTTP/1.1" 200 None
2025-12-03 10:03:27 [manheim.gb] INFO: Saving data for 3017186: {'created_time': 1764756207.769192, 'last_price_update_time': 1764756207.769201, 'auction_closing_time': 1764838800.0}
2025-12-03 10:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3017186') HTTP/1.1" 204 0
2025-12-03 10:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3046148-4001338-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003046148-01980592-004.pdf)
2025-12-03 10:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3046148-4001338-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003046148-01980592-004.pdf)
2025-12-03 10:03:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:03:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa27727be50>
2025-12-03 10:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:03:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-03 10:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e0f346b-7415-543f-b77a-e7cf41a9044a/8e0f346b-7415-543f-b77a-e7cf41a9044a_image_17.jpg HTTP/1.1" 201 0
2025-12-03 10:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3046148-4001338-1003.jpg') HTTP/1.1" 204 0
2025-12-03 10:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3046148-4001338-1003.jpg saved to cache
2025-12-03 10:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 8e0f346b-7415-543f-b77a-e7cf41a9044a
2025-12-03 10:03:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:03:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa2770b5610>
2025-12-03 10:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:03:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-03 10:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e0f346b-7415-543f-b77a-e7cf41a9044a/8e0f346b-7415-543f-b77a-e7cf41a9044a_image_19.jpg HTTP/1.1" 201 0
2025-12-03 10:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3046148-4001338-1005.jpg') HTTP/1.1" 204 0
2025-12-03 10:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3046148-4001338-1005.jpg saved to cache
2025-12-03 10:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 8e0f346b-7415-543f-b77a-e7cf41a9044a
2025-12-03 10:03:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-03 10:03:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-03 10:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-03 10:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa276160e10>
2025-12-03 10:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-03 10:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-03 10:03:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-03 10:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-03 10:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-03 10:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-03 10:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e0f346b-7415-543f-b77a-e7cf41a9044a/8e0f346b-7415-543f-b77a-e7cf41a9044a_image_18.jpg HTTP/1.1" 201 0
2025-12-03 10:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3046148-4001338-1004.jpg') HTTP/1.1" 204 0
2025-12-03 10:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3046148-4001338-1004.jpg saved to cache
2025-12-03 10:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 8e0f346b-7415-543f-b77a-e7cf41a9044a
2025-12-03 10:03:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8e0f346b-7415-543f-b77a-e7cf41a9044a, skipping ID generation
2025-12-03 10:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 8e0f346b-7415-543f-b77a-e7cf41a9044a from tracking dictionaries
2025-12-03 10:03:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8e0f346b-7415-543f-b77a-e7cf41a9044a sending to next pipeline
2025-12-03 10:03:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 8e0f346b-7415-543f-b77a-e7cf41a9044a, identifier: 3046148
2025-12-03 10:03:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 8e0f346b-7415-543f-b77a-e7cf41a9044a with identifier: 3046148
2025-12-03 10:03:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 8e0f346b-7415-543f-b77a-e7cf41a9044a with identifier: 3046148
2025-12-03 10:03:29 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 8e0f346b-7415-543f-b77a-e7cf41a9044a with identifier: 3046148 to the API
2025-12-03 10:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-03 10:03:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-03 10:03:29 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/insp-0001-3046148-4001338-1004.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e0f346b-7415-543f-b77a-e7cf41a9044a/8e0f346b-7415-543f-b77a-e7cf41a9044a_expert_report_file_bc6a500e-3e7f-497b-9c6e-f02f0dd44169.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003046148-01980592-004.pdf',
 'color': 'BLUE',
 'currency': 'GBP',
 'engine': '1.5L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '8e0f346b-7415-543f-b77a-e7cf41a9044a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'YV19BXG',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FORD/FOCUS?id=3046148',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'FORD',
 'model': 'FOCUS',
 'odometer': 85296,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e0f346b-7415-543f-b77a-e7cf41a9044a/8e0f346b-7415-543f-b77a-e7cf41a9044a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 222294,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f9af9736-a54e-48c2-bc4a-41aee3f1875f_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e0f346b-7415-543f-b77a-e7cf41a9044a/8e0f346b-7415-543f-b77a-e7cf41a9044a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 222294,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f9af9736-a54e-48c2-bc4a-41aee3f1875f_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e0f346b-7415-543f-b77a-e7cf41a9044a/8e0f346b-7415-543f-b77a-e7cf41a9044a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 221263,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f9af9736-a54e-48c2-bc4a-41aee3f1875f_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e0f346b-7415-543f-b77a-e7cf41a9044a/8e0f346b-7415-543f-b77a-e7cf41a9044a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120335,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f9af9736-a54e-48c2-bc4a-41aee3f1875f_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e0f346b-7415-543f-b77a-e7cf41a9044a/8e0f346b-7415-543f-b77a-e7cf41a9044a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 218526,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f9af9736-a54e-48c2-bc4a-41aee3f1875f_5.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e0f346b-7415-543f-b77a-e7cf41a9044a/8e0f346b-7415-543f-b77a-e7cf41a9044a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 214782,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f9af9736-a54e-48c2-bc4a-41aee3f1875f_4.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e0f346b-7415-543f-b77a-e7cf41a9044a/8e0f346b-7415-543f-b77a-e7cf41a9044a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 208707,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f9af9736-a54e-48c2-bc4a-41aee3f1875f_11.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e0f346b-7415-543f-b77a-e7cf41a9044a/8e0f346b-7415-543f-b77a-e7cf41a9044a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 200855,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f9af9736-a54e-48c2-bc4a-41aee3f1875f_10.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e0f346b-7415-543f-b77a-e7cf41a9044a/8e0f346b-7415-543f-b77a-e7cf41a9044a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 216783,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f9af9736-a54e-48c2-bc4a-41aee3f1875f_9.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e0f346b-7415-543f-b77a-e7cf41a9044a/8e0f346b-7415-543f-b77a-e7cf41a9044a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 223223,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f9af9736-a54e-48c2-bc4a-41aee3f1875f_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e0f346b-7415-543f-b77a-e7cf41a9044a/8e0f346b-7415-543f-b77a-e7cf41a9044a_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 218693,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f9af9736-a54e-48c2-bc4a-41aee3f1875f_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e0f346b-7415-543f-b77a-e7cf41a9044a/8e0f346b-7415-543f-b77a-e7cf41a9044a_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 181752,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f9af9736-a54e-48c2-bc4a-41aee3f1875f_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e0f346b-7415-543f-b77a-e7cf41a9044a/8e0f346b-7415-543f-b77a-e7cf41a9044a_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121034,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f9af9736-a54e-48c2-bc4a-41aee3f1875f_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e0f346b-7415-543f-b77a-e7cf41a9044a/8e0f346b-7415-543f-b77a-e7cf41a9044a_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 305276,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3046148-4001338-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e0f346b-7415-543f-b77a-e7cf41a9044a/8e0f346b-7415-543f-b77a-e7cf41a9044a_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 330480,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3046148-4001338-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e0f346b-7415-543f-b77a-e7cf41a9044a/8e0f346b-7415-543f-b77a-e7cf41a9044a_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328182,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3046148-4001338-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e0f346b-7415-543f-b77a-e7cf41a9044a/8e0f346b-7415-543f-b77a-e7cf41a9044a_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 282537,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3046148-4001338-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e0f346b-7415-543f-b77a-e7cf41a9044a/8e0f346b-7415-543f-b77a-e7cf41a9044a_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 309565,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3046148-4001338-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e0f346b-7415-543f-b77a-e7cf41a9044a/8e0f346b-7415-543f-b77a-e7cf41a9044a_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 292507,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3046148-4001338-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e0f346b-7415-543f-b77a-e7cf41a9044a/8e0f346b-7415-543f-b77a-e7cf41a9044a_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 406271,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3046148-4001338-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-30',
 'seller_name': 'MotoNovo Finance',
 'title': 'FORD FOCUS 2.0 TDCi ST-Line X 5dr',
 'transmission': 'manual',
 'trim': '2.0 TDCi ST-Line X 5dr',
 'year': 2019}
2025-12-03 10:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273046148%27 HTTP/1.1" 200 None
2025-12-03 10:03:29 [manheim.gb] INFO: Saving data for 3046148: {'created_time': 1764756209.463036, 'last_price_update_time': 1764756209.463045, 'auction_closing_time': 1764838800.0}
2025-12-03 10:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3046148') HTTP/1.1" 204 0
2025-12-03 10:03:29 [scrapy.core.engine] INFO: Closing spider (finished)
2025-12-03 10:03:29 [manheim.gb] INFO: manheim.gb Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 3, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0}
2025-12-03 10:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273052566%27 HTTP/1.1" 200 None
2025-12-03 10:03:29 [manheim.gb] INFO: Saving data for 3052566: {'created_time': 1764756209.600786}
2025-12-03 10:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3052566') HTTP/1.1" 204 0
2025-12-03 10:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-03 10:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20last_price_update_time%20lt%201764324209 HTTP/1.1" 200 None
2025-12-03 10:03:29 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (8 items) in: file:///var/lib/scrapyd/items/sourcing_v2/manheim.gb/task_37_2025-12-03T10_00_03.jl
2025-12-03 10:03:29 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 302288,
 'downloader/request_count': 247,
 'downloader/request_method_count/GET': 244,
 'downloader/request_method_count/POST': 3,
 'downloader/response_bytes': 76085099,
 'downloader/response_count': 247,
 'downloader/response_status_count/200': 246,
 'downloader/response_status_count/404': 1,
 'elapsed_time_seconds': 193.766998,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2025, 12, 3, 10, 3, 29, 694017, tzinfo=datetime.timezone.utc),
 'item_dropped_count': 18,
 'item_dropped_reasons_count/DropItem': 18,
 'item_scraped_count': 8,
 'log_count/DEBUG': 2901,
 'log_count/ERROR': 10,
 'log_count/INFO': 2574,
 'memusage/max': 185712640,
 'memusage/startup': 127647744,
 'photo_download_count': 208,
 'playwright/context_count': 1,
 'playwright/context_count/max_concurrent': 1,
 'playwright/context_count/persistent/False': 1,
 'playwright/context_count/remote/False': 1,
 'playwright/page_count': 1,
 'playwright/page_count/max_concurrent': 1,
 'playwright/request_count': 85,
 'playwright/request_count/aborted': 47,
 'playwright/request_count/method/GET': 82,
 'playwright/request_count/method/POST': 3,
 'playwright/request_count/navigation': 4,
 'playwright/request_count/resource_type/document': 4,
 'playwright/request_count/resource_type/font': 8,
 'playwright/request_count/resource_type/image': 41,
 'playwright/request_count/resource_type/script': 22,
 'playwright/request_count/resource_type/stylesheet': 8,
 'playwright/request_count/resource_type/xhr': 2,
 'playwright/response_count': 38,
 'playwright/response_count/method/GET': 35,
 'playwright/response_count/method/POST': 3,
 'playwright/response_count/resource_type/document': 4,
 'playwright/response_count/resource_type/font': 8,
 'playwright/response_count/resource_type/script': 16,
 'playwright/response_count/resource_type/stylesheet': 8,
 'playwright/response_count/resource_type/xhr': 2,
 'request_depth_max': 6,
 'response_received_count': 39,
 'scheduler/dequeued': 247,
 'scheduler/dequeued/memory': 247,
 'scheduler/enqueued': 247,
 'scheduler/enqueued/memory': 247,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 30,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 29.878296803531704,
 'scrapy-zyte-api/mean_response_seconds': 30.062283383360285,
 'scrapy-zyte-api/processed': 30,
 'scrapy-zyte-api/request_args/actions': 27,
 'scrapy-zyte-api/request_args/browserHtml': 27,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 3,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 30,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 30,
 'scrapy-zyte-api/request_args/httpRequestBody': 3,
 'scrapy-zyte-api/request_args/httpRequestMethod': 3,
 'scrapy-zyte-api/request_args/httpResponseBody': 3,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 3,
 'scrapy-zyte-api/request_args/requestHeaders': 27,
 'scrapy-zyte-api/request_args/sessionContext': 27,
 'scrapy-zyte-api/request_args/url': 30,
 'scrapy-zyte-api/status_codes/200': 30,
 'scrapy-zyte-api/success': 30,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'spider_exceptions/HttpError': 1,
 'spider_exceptions/ValueError': 1,
 'start_time': datetime.datetime(2025, 12, 3, 10, 0, 15, 927019, tzinfo=datetime.timezone.utc)}
2025-12-03 10:03:29 [scrapy.core.engine] INFO: Spider closed (finished)